-- Logs begin at Thu 2022-09-01 04:39:42 UTC, end at Thu 2022-09-01 05:53:00 UTC. -- Sep 01 05:16:24.863320 dv-cinder-852208-15-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 05:16:24.877159 dv-cinder-852208-15-smb devstack@keystone.service[81743]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 05:16:24 2022] *** Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: nodename: dv-cinder-852208-15-smb Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: machine: x86_64 Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: clock source: unix Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: pcre jit disabled Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: detected number of CPU cores: 4 Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: current working directory: / Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: detected binary path: /usr/bin/uwsgi-core Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: your processes number limit is 47680 Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: your memory page size is 4096 bytes Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: detected max file descriptor number: 2048 Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: lock engine: pthread robust mutexes Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: thunder lock: enabled Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 05:16:24.883817 dv-cinder-852208-15-smb devstack@keystone.service[81743]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 05:16:24.946112 dv-cinder-852208-15-smb devstack@keystone.service[81743]: Python main interpreter initialized at 0x564f53ec99c0 Sep 01 05:16:24.946112 dv-cinder-852208-15-smb devstack@keystone.service[81743]: python threads support enabled Sep 01 05:16:24.946112 dv-cinder-852208-15-smb devstack@keystone.service[81743]: your server socket listen backlog is limited to 100 connections Sep 01 05:16:24.946112 dv-cinder-852208-15-smb devstack@keystone.service[81743]: your mercy for graceful operations on workers is 90 seconds Sep 01 05:16:24.946623 dv-cinder-852208-15-smb devstack@keystone.service[81743]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 05:16:24.946735 dv-cinder-852208-15-smb devstack@keystone.service[81743]: *** Operational MODE: preforking *** Sep 01 05:16:24.947270 dv-cinder-852208-15-smb devstack@keystone.service[81743]: *** uWSGI is running in multiple interpreter mode *** Sep 01 05:16:24.947270 dv-cinder-852208-15-smb devstack@keystone.service[81743]: spawned uWSGI master process (pid: 81743) Sep 01 05:16:24.947564 dv-cinder-852208-15-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 05:16:24.948330 dv-cinder-852208-15-smb devstack@keystone.service[81743]: spawned uWSGI worker 1 (pid: 81756, cores: 1) Sep 01 05:16:24.948813 dv-cinder-852208-15-smb devstack@keystone.service[81743]: spawned uWSGI worker 2 (pid: 81757, cores: 1) Sep 01 05:16:24.948974 dv-cinder-852208-15-smb devstack@keystone.service[81743]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 05:16:29.812933 dv-cinder-852208-15-smb devstack@keystone.service[81757]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:16:29.812933 dv-cinder-852208-15-smb devstack@keystone.service[81757]: from cryptography.utils import int_from_bytes Sep 01 05:16:29.813770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:16:29.813770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: from cryptography.utils import int_from_bytes Sep 01 05:16:29.867950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:16:29.868239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:16:29.868389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] command line args: [] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:16:29.868587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:16:29.868755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ================================================================================ {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:16:29.869015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] admin_token = **** {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.869269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] config_dir = [] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.869482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.869668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] config_source = [] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.869851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] debug = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.870055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.870448 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.870680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.871065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.871293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.871537 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] list_limit = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.871721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] log_config_append = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.871903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.872083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] log_dir = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.872259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] log_file = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.872506 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.872824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.873075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.873334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.873523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.873713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.873950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.874249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.874589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.874826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.875067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.875306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.875564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.875792 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.876091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.876608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.876811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] publish_errors = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.877010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.877443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.877654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.877884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.878102 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.878355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] standard_threads = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.878578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.878823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.879010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.879182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] use_journal = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.879358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] use_json = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.879525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] use_stderr = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.879708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] use_syslog = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.879892 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:29.880133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.880377 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.880646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.880889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.881141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.881408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.881649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.881891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.882141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.882391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.882646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.882889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.883137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.883396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.883648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.883947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.884229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.884446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.884846 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.885045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.885270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.885609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.885908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.886170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.886438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.886706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.886941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.887170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.887403 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.887655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.887905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.888146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.888425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.888667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.888934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.889148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.889455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.889720 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.890020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.890261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.890494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.890728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.890960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.891192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.891487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.891702 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.891957 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.892211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.892442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.892717 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.892953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.893204 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.893517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.893760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.893997 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.894235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.894472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.894710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.894941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.895192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.895429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.895670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.895903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.896170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.896412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.896645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.896886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.897123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.897426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.897662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.897912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.898164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.898404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.898642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.898880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.899245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.899498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.899792 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.900044 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.900283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.900533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.900776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.901013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.901252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.901514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.906549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.906549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.906549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.906549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.906549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.906549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.906549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.906549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.906549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.907931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.907931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.907931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.907931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.907931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.907931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.907931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.907931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.907931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.908954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.908954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.908954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.908954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.908954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] auth.external = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.908954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.908954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.908954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.909833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] auth.password = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.909833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] auth.token = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.909833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.909833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.910302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.910302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.910578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.910714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.910848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.911070 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] credential.caching = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.911313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.911622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.911874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.912119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.912366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.912605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.912854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.913106 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.913348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.913634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.913927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.914414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.914414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.914803 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.914989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.915196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] federation.caching = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.915358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.915608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.915858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.916088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.916340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.916581 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.916901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.917212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.917485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.917663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.917915 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.918158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.caching = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.918406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.918653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.918890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.919125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.919375 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.920253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.920549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.920979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.921321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.921588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.921820 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.922058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.922339 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.922582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.922835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.923163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.923411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.923724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.923914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.924160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.924399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.924638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.924871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.925110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.925356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.925624 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.925874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.926107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.926352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.926604 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.926840 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.927094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.927339 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.927573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.927868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.928042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.928283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.928522 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.928768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.929012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.929249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.929581 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.929831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.930059 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.930295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.930554 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.930780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.931017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.931255 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.931493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.931723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.931965 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.932231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.932462 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.932713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.932960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.933208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.933467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.933704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.933941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.934176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.934416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.934643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.934893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.935208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.935463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.935711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.935956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.936190 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.936441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.936682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.936921 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.937158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.937422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.937675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.937926 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.938167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.938405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.938638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.938886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.939127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.939362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.939599 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.939988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.940454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.940611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.940859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.941106 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] resource.caching = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.941362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.941644 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.941883 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.942135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.942392 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.942632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.942884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.943125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.943370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.943616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] role.caching = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.943867 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] role.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.944103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.944356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.944607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.944856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.945103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.945353 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.945628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.945880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.946134 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.946371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.946618 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.946868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.947114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.947381 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.947824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.948066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.948318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.948670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.948953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.949206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.949472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.952394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.952394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.952394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.952394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.952394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.952394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.952394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.952394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.952394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.953523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.953523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.953523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.953523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] token.caching = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.953523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.953523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.953523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.954276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.954276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.954276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.954562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.954636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.954872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.955110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.955346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.955587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.955832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.956117 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.956347 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.956592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.956897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.957276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.connection = **** {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.957583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.957784 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.958027 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.958273 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.958512 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.958752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.958994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.959231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.959479 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.959718 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.959963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.960201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.960452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.960693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.960936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.961167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.961459 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.961928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:29.962101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81757) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:16:29.994922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:29.995158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:29.995340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.004746 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.035548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.035811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.094443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.146823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.147077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.255481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:16:30.255481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: from cryptography.utils import int_from_bytes Sep 01 05:16:30.256475 dv-cinder-852208-15-smb devstack@keystone.service[81756]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 05:16:30.256475 dv-cinder-852208-15-smb devstack@keystone.service[81756]: from cryptography.utils import int_from_bytes Sep 01 05:16:30.313017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.313284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.313523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.313700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.313894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.314116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.322572 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 05:16:30.322834 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 05:16:30.323044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] command line args: [] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 05:16:30.323223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 05:16:30.323362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ================================================================================ {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 05:16:30.323651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] admin_token = **** {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.323903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] config_dir = [] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.324093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.324278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] config_source = [] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.324463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] debug = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.324735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.324891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.325069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.325336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.325620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.326412 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] list_limit = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.326733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] log_config_append = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.326902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.327066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] log_dir = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.327224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] log_file = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.327329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.327586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.327841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.328195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.328435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.328668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.328918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.329407 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.329750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.329995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.330236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.330476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.330735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.330987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.331272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.331781 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.331989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] publish_errors = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.332230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.332468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.332649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.332904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.333146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.333426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] standard_threads = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.333653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.333943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.334123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.334309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] use_journal = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.334491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] use_json = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.334668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] use_stderr = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.334847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] use_syslog = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.335086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 05:16:30.335354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.335598 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.335865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.336110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.336365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.336868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.337128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.337400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.337647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.337905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.338162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.338401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.338658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.338930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.339137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.339395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.339481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.339639 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.339780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.339923 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.340057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.340188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.340323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.340449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.340586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.340708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.340833 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.340960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.341100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.341100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.342752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.342752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.342752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.343120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.343978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.343978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.343978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.344356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.344356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.344649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.344792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.345026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.345266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.345549 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.345796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.346052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.346298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.346539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.346775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.347015 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.347252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.347497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.347760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.348000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.348242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.348477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.348722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.348962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.349216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.349477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.349722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.349966 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.350207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.350450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.350693 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.350927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.351184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.351456 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.351703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.351939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.352207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.352448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.352685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.352927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.353166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.353469 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.353610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.353748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.353954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.354210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.354447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.354689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.354926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.355181 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.355422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.355668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.355916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.356155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.356409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.356651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.356891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.357193 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.357507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.357942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.358544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.358797 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.359058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.359311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.359564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.359817 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.360065 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.360311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.360552 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.360793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.361033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.361272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.361542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.361783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.362034 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.362277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.362540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.362783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.363049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.363316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.363564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.363802 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] auth.external = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.364038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.364341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.364581 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.364821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] auth.password = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.365058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] auth.token = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.365306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.365574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.365830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.366067 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.366330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.366588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.366826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.366961 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.367106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] credential.caching = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.367238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.367382 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.367512 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.367646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.367781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.367915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.368045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.368045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.368302 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.368427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81757) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.368558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.368558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.368778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.369032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.369279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.369565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.369862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.370117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.370387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.370634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.370895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.371136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] federation.caching = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.371378 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.371630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.371882 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.372119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.372384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.372669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.373129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.373498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.373965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.374221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.374480 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.374726 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.caching = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.374984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.375239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.375483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.375723 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.375979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.376217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.376463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.376719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.376974 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.377214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.377481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.377727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.377975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.378225 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.378476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.378737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.378990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.379265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.379510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.379758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.379993 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.380236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.380478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.380717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.380969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.381212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.381492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.381733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.381989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.382240 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.382481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.382729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.382984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.383221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.383465 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.383692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.383941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.384179 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.384427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.384667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.384909 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.385160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.385447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.385715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.385876 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.386017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.386102 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 05:16:30.386188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.386422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.386519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.386625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 05:16:30.386714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.386896 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.386974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.387145 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.387239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.387383 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.387505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.387623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.387705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.387892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.388126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.388908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.389269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.389775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.390124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.390365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.390619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.390863 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.391154 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.391395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.391647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.391900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.392150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.392408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.392655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.392890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.393141 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.393408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.393656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.393900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.394146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.394396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.394650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.394900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.395161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.395398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.395649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.395892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.396135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.396381 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.396632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.396881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.397119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.397360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.397636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] resource.caching = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.397888 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.397998 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.398147 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.398265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.398371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.398515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.398628 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.398804 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.398896 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.399116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.399367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.399610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.399861 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.400097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] role.caching = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.400351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] role.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.400592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.400848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.401111 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.401361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.401639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.401893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.402148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.402399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.402672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.402924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.403180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.403426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.403678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.404036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.404539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.404973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.405470 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.405748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.406006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.406110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.406268 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.406513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.406783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.407051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.407295 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.407543 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.407787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.408040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.408306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.408572 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.408829 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.409057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.409154 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.409302 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.409423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.409580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.409662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.409826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] token.caching = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.409919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.410078 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.410208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.410333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.410459 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.410602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.410735 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.410868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.410960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.411055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.411211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.411303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.411548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.411684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.411781 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.411960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.412054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.412273 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.412521 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.412761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.413015 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.413307 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.413570 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.413827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.414098 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.414398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.connection = **** {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.414647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.414901 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.415147 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.415395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.415639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.415887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.416127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.416374 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.416621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.416863 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.417114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.417357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.417638 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.417877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.418135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.418447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.418700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.418952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 05:16:30.419134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81756) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 05:16:30.436150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.437800 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.438088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.442813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.443108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.443394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.448137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.448380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.448615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.450067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.450366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.455015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.455313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.455601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.455888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.456162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.458195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.458399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.458695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.458991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.475672 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.475964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.478409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.478646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.479886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.483391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.483693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.488072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.491212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.494783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.495091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.495382 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.495675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.495957 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.496355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.512780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.513082 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.513550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.513827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.518316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.520983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.522738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.524311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.524591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.527312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.527606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.527906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.528192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.528484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.541168 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.541479 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.541771 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.542053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.542345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.542626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.542934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.557512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.557765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.559201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.562978 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.565954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.567411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.568909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.569208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.569538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.576399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.577958 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.580890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.581196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.581632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.581918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.590317 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.590620 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.590904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.599439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81757) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.599665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.599954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.600239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.600520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.600809 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.601089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.601394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.601682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.601960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.602236 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.602502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.602823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.603037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81757) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.603989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.604223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.604449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.604670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.604892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.605112 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.619755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.620010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.620218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.620443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.620741 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.620915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.621061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.632252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.639318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564f53ec99c0 pid: 81757 (default app) Sep 01 05:16:30.643292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ec597-cc4e-4e35-99ee-555ebd7797ad None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:30.643554 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ec597-cc4e-4e35-99ee-555ebd7797ad None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:30.643837 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ec597-cc4e-4e35-99ee-555ebd7797ad None None] PATH_INFO: `/v3` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:30.648378 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Thu Sep 1 05:16:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:30.727993 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.728281 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.728422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.728643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.728863 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.729141 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.729304 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81756) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 05:16:30.740391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.740647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 05:16:30.740940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.741144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 05:16:30.741459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.741736 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.742004 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.742289 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.753525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.753734 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.755146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.755146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.762767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.767734 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.768695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.769358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.770177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.770707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.771142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.772231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.772231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.773629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.773629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.773629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.800978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.802543 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.803034 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.807997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.808559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.809053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.816766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.816980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.821155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.821490 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.821788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.822163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.822486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.822778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.823058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.823359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.840861 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.841159 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.845952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.849297 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.849684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.854231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.858317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.861942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.862294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.862592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.863032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.863322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.863633 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.881580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.881890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.882168 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.882441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.890010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.893315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.895116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.895537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.898421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.898832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.899237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.899647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.900199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.912798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.913278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.913734 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.914144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.914567 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.914994 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.915397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.933359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.937850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.941049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.942636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.944215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.944506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.944797 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.951983 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.953852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.957110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.957461 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.957754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.958036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.966988 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.967524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.967903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.975402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81756) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 05:16:30.975707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.976001 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.976287 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.976571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.976864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.977163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.977482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.977783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.978068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.978347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.978617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.978889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:30.979174 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81756) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 05:16:31.016210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564f53ec99c0 pid: 81756 (default app) Sep 01 05:16:39.143689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02671b88-668b-4aea-b06d-68893e78e15b None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:39.144522 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02671b88-668b-4aea-b06d-68893e78e15b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:39.144522 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02671b88-668b-4aea-b06d-68893e78e15b None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:39.146699 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:16:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:39.160891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea7af1-5d97-4b8d-b3ec-816c2eaa3fd2 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:39.161574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea7af1-5d97-4b8d-b3ec-816c2eaa3fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:39.161898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea7af1-5d97-4b8d-b3ec-816c2eaa3fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:39.309603 dv-cinder-852208-15-smb devstack@keystone.service[81756]: INFO dbcounter [None req-ceea7af1-5d97-4b8d-b3ec-816c2eaa3fd2 None None] Registered counter for database keystone Sep 01 05:16:39.350780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG oslo_db.sqlalchemy.engines [None req-ceea7af1-5d97-4b8d-b3ec-816c2eaa3fd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81756) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:16:39.359590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writer thread running {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:16:39.658584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG passlib.handlers.bcrypt [None req-ceea7af1-5d97-4b8d-b3ec-816c2eaa3fd2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81756) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 05:16:39.658584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG passlib.handlers.bcrypt [None req-ceea7af1-5d97-4b8d-b3ec-816c2eaa3fd2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81756) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 05:16:39.658584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ceea7af1-5d97-4b8d-b3ec-816c2eaa3fd2 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:39.658584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ceea7af1-5d97-4b8d-b3ec-816c2eaa3fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:39.784708 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1/3] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 630 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 05:16:40.304517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02671b88-668b-4aea-b06d-68893e78e15b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:40.383301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: INFO dbcounter [None req-02671b88-668b-4aea-b06d-68893e78e15b None None] Registered counter for database keystone Sep 01 05:16:40.406831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG oslo_db.sqlalchemy.engines [None req-02671b88-668b-4aea-b06d-68893e78e15b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81757) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 05:16:40.414376 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writer thread running {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 05:16:40.566789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02671b88-668b-4aea-b06d-68893e78e15b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:40.571600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e2933-75e5-4722-b68c-199a81f5e203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:40.572286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e2933-75e5-4722-b68c-199a81f5e203 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:40.572570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e2933-75e5-4722-b68c-199a81f5e203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:40.572846 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e2933-75e5-4722-b68c-199a81f5e203 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:40.584048 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e2933-75e5-4722-b68c-199a81f5e203 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:40.646455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: WARNING keystone.common.rbac_enforcer.enforcer [None req-dc5e2933-75e5-4722-b68c-199a81f5e203 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 05:16:40.646891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e2933-75e5-4722-b68c-199a81f5e203 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:40.659483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Sep 1 05:16:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:16:40.668632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea7af1-5d97-4b8d-b3ec-816c2eaa3fd2 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:40.695531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea7af1-5d97-4b8d-b3ec-816c2eaa3fd2 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:40.703255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8f44e-9ca8-4bca-916b-a8a82570d5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:40.705227 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8f44e-9ca8-4bca-916b-a8a82570d5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:40.705708 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8f44e-9ca8-4bca-916b-a8a82570d5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:40.706137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8f44e-9ca8-4bca-916b-a8a82570d5e6 admin admin] PATH_INFO: `/v3/projects/08e8d7d100674ce3a5c0d91110f5524d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:40.708825 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8f44e-9ca8-4bca-916b-a8a82570d5e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=08e8d7d100674ce3a5c0d91110f5524d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:40.808921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: WARNING keystone.common.rbac_enforcer.enforcer [None req-33c8f44e-9ca8-4bca-916b-a8a82570d5e6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 05:16:40.809470 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8f44e-9ca8-4bca-916b-a8a82570d5e6 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:40.818019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 2/5] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Sep 1 05:16:40 2022] GET /identity/v3/projects/08e8d7d100674ce3a5c0d91110f5524d => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:42.859698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1035d-8a9f-4b00-a3db-1d2ef4889c05 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:42.860227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1035d-8a9f-4b00-a3db-1d2ef4889c05 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:42.860227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1035d-8a9f-4b00-a3db-1d2ef4889c05 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:42.864613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 4/6] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:16:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:16:42.871241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede974d4-4790-4d33-a1d7-ead386679a21 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:42.872069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede974d4-4790-4d33-a1d7-ead386679a21 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:42.872069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede974d4-4790-4d33-a1d7-ead386679a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:42.895648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ede974d4-4790-4d33-a1d7-ead386679a21 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:42.897254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ede974d4-4790-4d33-a1d7-ead386679a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:42.906001 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 05:16:43.393224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1035d-8a9f-4b00-a3db-1d2ef4889c05 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:43.412739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1035d-8a9f-4b00-a3db-1d2ef4889c05 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:43.419753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239197c-9a83-4076-b6c2-763f492f4800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:43.420834 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239197c-9a83-4076-b6c2-763f492f4800 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:43.421340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239197c-9a83-4076-b6c2-763f492f4800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:43.421867 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239197c-9a83-4076-b6c2-763f492f4800 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:43.437312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239197c-9a83-4076-b6c2-763f492f4800 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:43.440309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239197c-9a83-4076-b6c2-763f492f4800 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:43.457516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Sep 1 05:16:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:16:43.466897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede974d4-4790-4d33-a1d7-ead386679a21 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:43.477366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede974d4-4790-4d33-a1d7-ead386679a21 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:43.482854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faf6ec-5ed8-4272-a452-4107cc3bb65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:43.483532 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faf6ec-5ed8-4272-a452-4107cc3bb65f admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:43.483816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faf6ec-5ed8-4272-a452-4107cc3bb65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:43.484097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faf6ec-5ed8-4272-a452-4107cc3bb65f admin admin] PATH_INFO: `/v3/users/b2b7855ba5724e86b7da7d610ca3fc58` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:43.486460 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faf6ec-5ed8-4272-a452-4107cc3bb65f admin admin] RBAC: Authorizing `identity:get_user(user_id=b2b7855ba5724e86b7da7d610ca3fc58)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:43.490128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faf6ec-5ed8-4272-a452-4107cc3bb65f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:43.493329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 4/9] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Sep 1 05:16:43 2022] GET /identity/v3/users/b2b7855ba5724e86b7da7d610ca3fc58 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:46.137105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b8b9f-3456-4f52-8f94-98eabc51c9a9 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:46.138394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b8b9f-3456-4f52-8f94-98eabc51c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:46.138600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b8b9f-3456-4f52-8f94-98eabc51c9a9 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:46.140874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:16:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:46.146665 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903ab8-cb11-437b-aad7-47c82d768342 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:46.147166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903ab8-cb11-437b-aad7-47c82d768342 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:46.147247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d903ab8-cb11-437b-aad7-47c82d768342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:46.155869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d26d8-3ecf-4acc-b228-a4ac39315859 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:46.156301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d26d8-3ecf-4acc-b228-a4ac39315859 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:46.156598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d26d8-3ecf-4acc-b228-a4ac39315859 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:46.158339 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 7/11] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:46.165827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ff98a-5dcb-4cae-8812-d4d0626bf2a9 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:46.166294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ff98a-5dcb-4cae-8812-d4d0626bf2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:46.166751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ff98a-5dcb-4cae-8812-d4d0626bf2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:46.167639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-8d903ab8-cb11-437b-aad7-47c82d768342 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:46.169226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8d903ab8-cb11-437b-aad7-47c82d768342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:46.218107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG passlib.handlers.bcrypt [None req-d92ff98a-5dcb-4cae-8812-d4d0626bf2a9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81757) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 05:16:46.218533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG passlib.handlers.bcrypt [None req-d92ff98a-5dcb-4cae-8812-d4d0626bf2a9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81757) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 05:16:46.267826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 5/12] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:16:46.270447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-d92ff98a-5dcb-4cae-8812-d4d0626bf2a9 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:46.272306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d92ff98a-5dcb-4cae-8812-d4d0626bf2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:46.416200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 8/13] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:16:46.555897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903ab8-cb11-437b-aad7-47c82d768342 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:46.586379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:46.683992 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d903ab8-cb11-437b-aad7-47c82d768342 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:46.723941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d45f4b-8570-42ee-883e-35785984b235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:46.724569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d45f4b-8570-42ee-883e-35785984b235 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:46.724853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d45f4b-8570-42ee-883e-35785984b235 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:46.725135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d45f4b-8570-42ee-883e-35785984b235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:46.829627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d45f4b-8570-42ee-883e-35785984b235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:46.831342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d45f4b-8570-42ee-883e-35785984b235 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:46.865027 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:46.899174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ff98a-5dcb-4cae-8812-d4d0626bf2a9 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:46.980430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 6/14] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:16:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:16:46.986959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d45f4b-8570-42ee-883e-35785984b235 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:47.036662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ff98a-5dcb-4cae-8812-d4d0626bf2a9 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:47.039133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:47.082669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7577eb-5098-435f-8abe-da2e6c40620d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:47.083810 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7577eb-5098-435f-8abe-da2e6c40620d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:47.084089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7577eb-5098-435f-8abe-da2e6c40620d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:47.084372 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7577eb-5098-435f-8abe-da2e6c40620d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:47.099599 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7577eb-5098-435f-8abe-da2e6c40620d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:16:47.107595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d45f4b-8570-42ee-883e-35785984b235 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-8b7577eb-5098-435f-8abe-da2e6c40620d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:16:47.108286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:16:47.110042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:16:47.110831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:16:47.110831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:16:47.110831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:16:47.110831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:16:47.110831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:16:47.110831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:16:47.110831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:16:47.110831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:16:47.110831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:16:47.110831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:16:47.110831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:16:47.110831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:16:47.111779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 9/15] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:16:47.115694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7577eb-5098-435f-8abe-da2e6c40620d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:47.139339 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:47.160902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3653731-9868-4046-8c99-332f4d54a8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:47.162056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653731-9868-4046-8c99-332f4d54a8df None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:47.162647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653731-9868-4046-8c99-332f4d54a8df None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:47.163147 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653731-9868-4046-8c99-332f4d54a8df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:47.180378 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3653731-9868-4046-8c99-332f4d54a8df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:47.183300 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3653731-9868-4046-8c99-332f4d54a8df None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-e3653731-9868-4046-8c99-332f4d54a8df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:16:47.214349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:16:47.216035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:16:47.217062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:16:47.217062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:16:47.217062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:16:47.217062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 7/16] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:16:47.225116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3653731-9868-4046-8c99-332f4d54a8df None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:47.244681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7577eb-5098-435f-8abe-da2e6c40620d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:47.291367 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828b936-294c-4905-8fc5-cd6bf27ea365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:47.292341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828b936-294c-4905-8fc5-cd6bf27ea365 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:47.292798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828b936-294c-4905-8fc5-cd6bf27ea365 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:47.293254 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828b936-294c-4905-8fc5-cd6bf27ea365 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:47.295042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828b936-294c-4905-8fc5-cd6bf27ea365 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:16:47.295532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828b936-294c-4905-8fc5-cd6bf27ea365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:47.298145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828b936-294c-4905-8fc5-cd6bf27ea365 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:47.317911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 10/17] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:16:47.323964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828b936-294c-4905-8fc5-cd6bf27ea365 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:47.358084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:47.364655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3653731-9868-4046-8c99-332f4d54a8df None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:47.407065 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb827b3-656c-4b95-a069-fca73924406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:47.408088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb827b3-656c-4b95-a069-fca73924406b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:47.408596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb827b3-656c-4b95-a069-fca73924406b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:47.409108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb827b3-656c-4b95-a069-fca73924406b None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:47.410202 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb827b3-656c-4b95-a069-fca73924406b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:16:47.410515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb827b3-656c-4b95-a069-fca73924406b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:47.411996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb827b3-656c-4b95-a069-fca73924406b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:47.439193 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 8/18] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:16:47.489016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828b936-294c-4905-8fc5-cd6bf27ea365 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:47.558963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4fea-2337-4a24-8911-13c09e7157c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:47.560013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4fea-2337-4a24-8911-13c09e7157c1 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:47.560518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4fea-2337-4a24-8911-13c09e7157c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:47.561016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4fea-2337-4a24-8911-13c09e7157c1 None admin] PATH_INFO: `/v3/users/b2b7855ba5724e86b7da7d610ca3fc58` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:47.564106 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b4fea-2337-4a24-8911-13c09e7157c1 None admin] RBAC: Authorizing `identity:get_user(user_id=b2b7855ba5724e86b7da7d610ca3fc58)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:47.567095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b4fea-2337-4a24-8911-13c09e7157c1 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:47.570681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 11/19] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:16:47 2022] GET /identity/v3/users/b2b7855ba5724e86b7da7d610ca3fc58 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:16:47.585645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb827b3-656c-4b95-a069-fca73924406b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:47.643219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:47.744618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb827b3-656c-4b95-a069-fca73924406b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:47.799709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42519072-0786-45fa-983a-421274513a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:47.800379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42519072-0786-45fa-983a-421274513a46 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:47.800670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42519072-0786-45fa-983a-421274513a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:47.800936 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42519072-0786-45fa-983a-421274513a46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:47.802308 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42519072-0786-45fa-983a-421274513a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:47.804506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42519072-0786-45fa-983a-421274513a46 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:47.810160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 9/20] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:16:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:16:47.814879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4fea-2337-4a24-8911-13c09e7157c1 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:47.968308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:47.977407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4fea-2337-4a24-8911-13c09e7157c1 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:48.042899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f5486-db61-493b-a889-8ec7c12d6902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:48.043589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f5486-db61-493b-a889-8ec7c12d6902 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:48.044368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f5486-db61-493b-a889-8ec7c12d6902 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:48.044640 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f5486-db61-493b-a889-8ec7c12d6902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:48.045424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f5486-db61-493b-a889-8ec7c12d6902 None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.domain.id=default, user.id=b2b7855ba5724e86b7da7d610ca3fc58) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:16:48.045735 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f5486-db61-493b-a889-8ec7c12d6902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:48.047320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f5486-db61-493b-a889-8ec7c12d6902 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:48.057875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 12/21] 10.222.0.48 () {56 vars in 1322 bytes} [Thu Sep 1 05:16:47 2022] GET /identity/v3/role_assignments?user.id=b2b7855ba5724e86b7da7d610ca3fc58&scope.domain.id=default&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 233 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:50.716536 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad213f7-99b3-41e9-8111-e39ea2f3c4b4 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:50.717426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad213f7-99b3-41e9-8111-e39ea2f3c4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:50.717426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad213f7-99b3-41e9-8111-e39ea2f3c4b4 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:50.719056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 10/22] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:50.729455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed42e7-a99c-47ac-bacb-f9252dcfa70f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:50.729969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed42e7-a99c-47ac-bacb-f9252dcfa70f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:50.730433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed42e7-a99c-47ac-bacb-f9252dcfa70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:50.789799 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-8fed42e7-a99c-47ac-bacb-f9252dcfa70f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:50.791732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8fed42e7-a99c-47ac-bacb-f9252dcfa70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:50.975916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 13/23] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:16:51.376638 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c80a68-10c7-4855-960e-9375f1213b79 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:51.377060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c80a68-10c7-4855-960e-9375f1213b79 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:51.377449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c80a68-10c7-4855-960e-9375f1213b79 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:51.380410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 11/24] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:16:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:51.398991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636237c-4882-4f4c-8760-9b21ed27bc2b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:51.399468 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636237c-4882-4f4c-8760-9b21ed27bc2b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:51.399963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636237c-4882-4f4c-8760-9b21ed27bc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:51.446381 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-d636237c-4882-4f4c-8760-9b21ed27bc2b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:51.448216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d636237c-4882-4f4c-8760-9b21ed27bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:51.498028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47962e54-eb15-45e2-a67c-6c688786ee18 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:51.498743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47962e54-eb15-45e2-a67c-6c688786ee18 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:51.499259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47962e54-eb15-45e2-a67c-6c688786ee18 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:51.504203 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 12/25] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:16:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:51.510118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59837b1-5d88-46a1-abd9-827c6d94d0ad None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:51.511026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59837b1-5d88-46a1-abd9-827c6d94d0ad None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:51.511575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59837b1-5d88-46a1-abd9-827c6d94d0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:51.554539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-f59837b1-5d88-46a1-abd9-827c6d94d0ad None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:51.557033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f59837b1-5d88-46a1-abd9-827c6d94d0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:51.612321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 14/26] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:16:51.647822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636237c-4882-4f4c-8760-9b21ed27bc2b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:51.689872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:51.744229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 13/27] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 05:16:51.897602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636237c-4882-4f4c-8760-9b21ed27bc2b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:51.958818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc028e5-6cf4-4fb2-ac50-c9ea7bfe1e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:51.959378 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc028e5-6cf4-4fb2-ac50-c9ea7bfe1e97 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:51.959665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc028e5-6cf4-4fb2-ac50-c9ea7bfe1e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:51.959944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc028e5-6cf4-4fb2-ac50-c9ea7bfe1e97 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:51.960670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc028e5-6cf4-4fb2-ac50-c9ea7bfe1e97 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:51.962440 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc028e5-6cf4-4fb2-ac50-c9ea7bfe1e97 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:52.031991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af04f6a-8c45-4cd8-a09b-386ce18c895b None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:52.032611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af04f6a-8c45-4cd8-a09b-386ce18c895b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:52.033188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af04f6a-8c45-4cd8-a09b-386ce18c895b None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:52.034919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 14/28] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:16:52.045131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0242101-73d9-475b-80fa-6ba701ccdd52 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:52.045953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0242101-73d9-475b-80fa-6ba701ccdd52 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:52.046387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0242101-73d9-475b-80fa-6ba701ccdd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:52.075202 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-c0242101-73d9-475b-80fa-6ba701ccdd52 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:52.077107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c0242101-73d9-475b-80fa-6ba701ccdd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:52.109807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:52.169585 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 15/29] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 05:16:52.170259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0242101-73d9-475b-80fa-6ba701ccdd52 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:52.326962 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 15/30] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Sep 1 05:16:51 2022] POST /identity/v3/roles => generated 219 bytes in 680 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:16:52.423648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0242101-73d9-475b-80fa-6ba701ccdd52 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:52.483976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc028e5-6cf4-4fb2-ac50-c9ea7bfe1e97 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:52.538768 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6170442-0e92-45e1-bbf7-5f484ec540ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:52.540079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6170442-0e92-45e1-bbf7-5f484ec540ad None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:52.541013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6170442-0e92-45e1-bbf7-5f484ec540ad None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:52.541714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6170442-0e92-45e1-bbf7-5f484ec540ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:52.599632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6170442-0e92-45e1-bbf7-5f484ec540ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:52.601254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6170442-0e92-45e1-bbf7-5f484ec540ad None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-c6170442-0e92-45e1-bbf7-5f484ec540ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:16:52.633184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:16:52.634913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:16:52.636410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:16:52.636410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:16:52.636410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:16:52.636410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 16/31] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:16:52.647763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6170442-0e92-45e1-bbf7-5f484ec540ad None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:52.713948 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:52.760653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:52.804453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc028e5-6cf4-4fb2-ac50-c9ea7bfe1e97 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:52.904145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51cdc8-9e05-46db-b1aa-01f402b4ec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:52.906572 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51cdc8-9e05-46db-b1aa-01f402b4ec6a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:52.907953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51cdc8-9e05-46db-b1aa-01f402b4ec6a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:52.908751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51cdc8-9e05-46db-b1aa-01f402b4ec6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:52.931634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51cdc8-9e05-46db-b1aa-01f402b4ec6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:16:52.940236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6170442-0e92-45e1-bbf7-5f484ec540ad None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-5a51cdc8-9e05-46db-b1aa-01f402b4ec6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:16:52.942386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:16:52.943692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:16:52.944880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:16:52.944880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:16:52.944880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:16:52.944880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:16:52.944880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:16:52.944880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:16:52.944880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:16:52.944880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:16:52.944880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:16:52.944880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:16:52.944880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:16:52.944880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:16:52.948889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 16/32] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:16:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:16:52.957313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51cdc8-9e05-46db-b1aa-01f402b4ec6a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:53.006191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795128e9-de6d-4d5b-a6d8-0754f3f9782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:53.007294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795128e9-de6d-4d5b-a6d8-0754f3f9782a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.008056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795128e9-de6d-4d5b-a6d8-0754f3f9782a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.008744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795128e9-de6d-4d5b-a6d8-0754f3f9782a None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.010160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795128e9-de6d-4d5b-a6d8-0754f3f9782a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:16:53.011009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795128e9-de6d-4d5b-a6d8-0754f3f9782a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:53.014720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795128e9-de6d-4d5b-a6d8-0754f3f9782a None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:53.042912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 17/33] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:53.045482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795128e9-de6d-4d5b-a6d8-0754f3f9782a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:53.154679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51cdc8-9e05-46db-b1aa-01f402b4ec6a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:53.217632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:53.218583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f51dd-0f2d-4204-b8b0-b9ee22864803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:53.219624 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f51dd-0f2d-4204-b8b0-b9ee22864803 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.220099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f51dd-0f2d-4204-b8b0-b9ee22864803 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.220544 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f51dd-0f2d-4204-b8b0-b9ee22864803 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.221807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f51dd-0f2d-4204-b8b0-b9ee22864803 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:53.225310 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f51dd-0f2d-4204-b8b0-b9ee22864803 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:53.254771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795128e9-de6d-4d5b-a6d8-0754f3f9782a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:53.321461 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389ce2-5509-48a5-b1fd-c6385cf21ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:53.322154 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389ce2-5509-48a5-b1fd-c6385cf21ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.322661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389ce2-5509-48a5-b1fd-c6385cf21ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.322982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389ce2-5509-48a5-b1fd-c6385cf21ad1 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.323742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389ce2-5509-48a5-b1fd-c6385cf21ad1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:16:53.324086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389ce2-5509-48a5-b1fd-c6385cf21ad1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:53.326286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389ce2-5509-48a5-b1fd-c6385cf21ad1 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:53.343674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:53.345423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 18/34] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:16:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:53.345941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389ce2-5509-48a5-b1fd-c6385cf21ad1 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:53.355374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 17/35] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Sep 1 05:16:52 2022] POST /identity/v3/roles => generated 225 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:53.358271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531f8cf-bba8-4494-8914-c30592a7a8db None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.358731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531f8cf-bba8-4494-8914-c30592a7a8db None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.359189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531f8cf-bba8-4494-8914-c30592a7a8db None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.361903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 18/36] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:16:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:53.369510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa3ac3-8adb-4d14-94c9-b5bfb8502ccf None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.369510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa3ac3-8adb-4d14-94c9-b5bfb8502ccf None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.369510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa3ac3-8adb-4d14-94c9-b5bfb8502ccf None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.369510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 19/37] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:16:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:53.370259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa3ac3-8adb-4d14-94c9-b5bfb8502ccf None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:53.573591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa3ac3-8adb-4d14-94c9-b5bfb8502ccf None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:53.589263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389ce2-5509-48a5-b1fd-c6385cf21ad1 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:53.643480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215b9bd-de2a-4d0b-8e13-d5bb54afc888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:53.644667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215b9bd-de2a-4d0b-8e13-d5bb54afc888 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.645446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215b9bd-de2a-4d0b-8e13-d5bb54afc888 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.646163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215b9bd-de2a-4d0b-8e13-d5bb54afc888 None admin] PATH_INFO: `/v3/users/b2b7855ba5724e86b7da7d610ca3fc58` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.648266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215b9bd-de2a-4d0b-8e13-d5bb54afc888 None admin] RBAC: Authorizing `identity:get_user(user_id=b2b7855ba5724e86b7da7d610ca3fc58)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:53.651024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215b9bd-de2a-4d0b-8e13-d5bb54afc888 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:53.652895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:16:53 2022] GET /identity/v3/users/b2b7855ba5724e86b7da7d610ca3fc58 => generated 247 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:53.654766 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60058bc9-68d3-4096-bbca-1ff96e77742a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.655064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60058bc9-68d3-4096-bbca-1ff96e77742a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.655318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60058bc9-68d3-4096-bbca-1ff96e77742a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.677661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bb709-2bee-4a0d-830a-fc690c4e74f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:53.678313 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bb709-2bee-4a0d-830a-fc690c4e74f3 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.678597 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bb709-2bee-4a0d-830a-fc690c4e74f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.678918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bb709-2bee-4a0d-830a-fc690c4e74f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.679674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bb709-2bee-4a0d-830a-fc690c4e74f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:53.681320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bb709-2bee-4a0d-830a-fc690c4e74f3 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:53.688762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-60058bc9-68d3-4096-bbca-1ff96e77742a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:53.689505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-60058bc9-68d3-4096-bbca-1ff96e77742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:53.698442 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:53.806294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:53.819022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 21/39] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:16:53.820360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb88cfd-4acd-40d2-8b49-7ecaae867485 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.821492 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb88cfd-4acd-40d2-8b49-7ecaae867485 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.821492 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb88cfd-4acd-40d2-8b49-7ecaae867485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.852245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-6eb88cfd-4acd-40d2-8b49-7ecaae867485 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:53.854429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6eb88cfd-4acd-40d2-8b49-7ecaae867485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:54.002354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 22/40] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:16:54.004411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb88cfd-4acd-40d2-8b49-7ecaae867485 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.033855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 19/41] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:16:53 2022] POST /identity/v3/projects => generated 301 bytes in 689 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:54.161832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb88cfd-4acd-40d2-8b49-7ecaae867485 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:54.172347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bb709-2bee-4a0d-830a-fc690c4e74f3 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.216979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:54.233611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8e487-e126-4547-9eec-3654344fc599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:54.234646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8e487-e126-4547-9eec-3654344fc599 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.235086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8e487-e126-4547-9eec-3654344fc599 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.235515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8e487-e126-4547-9eec-3654344fc599 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.237908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8e487-e126-4547-9eec-3654344fc599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:54.240676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8e487-e126-4547-9eec-3654344fc599 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:54.243701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 23/42] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:16:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:54.256194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8e487-e126-4547-9eec-3654344fc599 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.353422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bb709-2bee-4a0d-830a-fc690c4e74f3 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:54.420699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2418208-0a12-46a9-bb14-baa60e840ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:54.421900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2418208-0a12-46a9-bb14-baa60e840ceb None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.422421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2418208-0a12-46a9-bb14-baa60e840ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.422913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2418208-0a12-46a9-bb14-baa60e840ceb None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.424661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2418208-0a12-46a9-bb14-baa60e840ceb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:54.428101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2418208-0a12-46a9-bb14-baa60e840ceb None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:54.455387 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8e487-e126-4547-9eec-3654344fc599 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:54.517506 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f911cbc-900b-4806-bbfb-23192b2346dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:54.518192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f911cbc-900b-4806-bbfb-23192b2346dd None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.518477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f911cbc-900b-4806-bbfb-23192b2346dd None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.518783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f911cbc-900b-4806-bbfb-23192b2346dd None admin] PATH_INFO: `/v3/domains/default/users/b2b7855ba5724e86b7da7d610ca3fc58/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.520968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f911cbc-900b-4806-bbfb-23192b2346dd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b2b7855ba5724e86b7da7d610ca3fc58, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:54.522670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f911cbc-900b-4806-bbfb-23192b2346dd None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:54.547286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 20/43] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Sep 1 05:16:54 2022] POST /identity/v3/roles => generated 223 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:54.548925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2418208-0a12-46a9-bb14-baa60e840ceb None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.642479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:54.679485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 24/44] 10.222.0.48 () {58 vars in 1361 bytes} [Thu Sep 1 05:16:54 2022] PUT /identity/v3/domains/default/users/b2b7855ba5724e86b7da7d610ca3fc58/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:16:54.728593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2418208-0a12-46a9-bb14-baa60e840ceb None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:54.796328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949598a-41ea-4557-8c89-a4053cee1a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:54.797124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949598a-41ea-4557-8c89-a4053cee1a93 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.797598 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949598a-41ea-4557-8c89-a4053cee1a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.797883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949598a-41ea-4557-8c89-a4053cee1a93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.799476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949598a-41ea-4557-8c89-a4053cee1a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:54.801054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949598a-41ea-4557-8c89-a4053cee1a93 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:54.803260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 21/45] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:16:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:54.810258 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f911cbc-900b-4806-bbfb-23192b2346dd None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.896974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:54.972797 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f911cbc-900b-4806-bbfb-23192b2346dd None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:55.045968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f4df2-a669-4c49-b18c-effb548c34de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:55.047081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4df2-a669-4c49-b18c-effb548c34de None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:55.047566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4df2-a669-4c49-b18c-effb548c34de None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:55.048049 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f4df2-a669-4c49-b18c-effb548c34de None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:55.049288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f4df2-a669-4c49-b18c-effb548c34de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:55.052159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f4df2-a669-4c49-b18c-effb548c34de None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:55.234416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 25/46] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:16:54 2022] POST /identity/v3/projects => generated 312 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:56.878688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b872a-5669-4411-a814-d025f8fc0e54 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:56.879545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b872a-5669-4411-a814-d025f8fc0e54 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:56.879545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b872a-5669-4411-a814-d025f8fc0e54 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:56.880648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 22/47] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:56.887705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4823-48f1-43da-867a-6ec150eccbb6 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:56.888376 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4823-48f1-43da-867a-6ec150eccbb6 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:56.888863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4823-48f1-43da-867a-6ec150eccbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:56.923579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-24eb4823-48f1-43da-867a-6ec150eccbb6 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:56.925813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-24eb4823-48f1-43da-867a-6ec150eccbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:57.055253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 26/48] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:16:57.331468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b872a-5669-4411-a814-d025f8fc0e54 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:57.378745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaaa5b-6268-4f62-8d7e-9132389072a8 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:57.379207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaaa5b-6268-4f62-8d7e-9132389072a8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:57.379354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeaaa5b-6268-4f62-8d7e-9132389072a8 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:57.380777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 27/49] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:16:57.387490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66412-f456-4946-8891-dd3c816260ff None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:57.387859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66412-f456-4946-8891-dd3c816260ff None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:57.388744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab66412-f456-4946-8891-dd3c816260ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:57.408655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-0ab66412-f456-4946-8891-dd3c816260ff None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:57.409984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0ab66412-f456-4946-8891-dd3c816260ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:57.445781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:57.495346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 28/50] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:16:57.513806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b872a-5669-4411-a814-d025f8fc0e54 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:57.548270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:57.575453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff32867-dd63-45a1-a231-94270a1b1aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:57.576669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff32867-dd63-45a1-a231-94270a1b1aca None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:57.577158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff32867-dd63-45a1-a231-94270a1b1aca None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:57.577832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff32867-dd63-45a1-a231-94270a1b1aca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:57.714495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff32867-dd63-45a1-a231-94270a1b1aca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-6ff32867-dd63-45a1-a231-94270a1b1aca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:16:57.721397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:16:57.723158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:16:57.724698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 23/51] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:16:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:16:57.729550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab66412-f456-4946-8891-dd3c816260ff None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:57.778967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff32867-dd63-45a1-a231-94270a1b1aca None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:57.895040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab66412-f456-4946-8891-dd3c816260ff None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:57.924841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff32867-dd63-45a1-a231-94270a1b1aca None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:57.943413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fded39c-1c94-4b9f-a609-ff892893300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:57.944308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fded39c-1c94-4b9f-a609-ff892893300a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:57.944664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fded39c-1c94-4b9f-a609-ff892893300a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:57.945010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fded39c-1c94-4b9f-a609-ff892893300a None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:57.945974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fded39c-1c94-4b9f-a609-ff892893300a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:16:57.946363 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fded39c-1c94-4b9f-a609-ff892893300a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:57.948021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fded39c-1c94-4b9f-a609-ff892893300a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:57.959110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 29/52] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:16:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:57.965903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fded39c-1c94-4b9f-a609-ff892893300a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:57.970036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5dbf1-77ed-4d5e-ae03-b112d4a6690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:57.970699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5dbf1-77ed-4d5e-ae03-b112d4a6690b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:57.970993 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5dbf1-77ed-4d5e-ae03-b112d4a6690b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:57.971361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5dbf1-77ed-4d5e-ae03-b112d4a6690b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:57.972464 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5dbf1-77ed-4d5e-ae03-b112d4a6690b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:57.974008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5dbf1-77ed-4d5e-ae03-b112d4a6690b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:57.975671 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 24/53] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:16:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:16:57.982116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5dbf1-77ed-4d5e-ae03-b112d4a6690b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:58.001179 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:58.041587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:58.114643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5dbf1-77ed-4d5e-ae03-b112d4a6690b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:58.176751 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845c2e8-d6cf-438e-a55c-286ab280c789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:58.177976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845c2e8-d6cf-438e-a55c-286ab280c789 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:58.178531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845c2e8-d6cf-438e-a55c-286ab280c789 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:58.178963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845c2e8-d6cf-438e-a55c-286ab280c789 None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:58.180037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845c2e8-d6cf-438e-a55c-286ab280c789 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:58.182590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845c2e8-d6cf-438e-a55c-286ab280c789 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:58.210140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fded39c-1c94-4b9f-a609-ff892893300a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:58.265601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17263940-3435-45dc-8ab8-42b5e82464bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:58.266486 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17263940-3435-45dc-8ab8-42b5e82464bd None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:58.266954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17263940-3435-45dc-8ab8-42b5e82464bd None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:58.267449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17263940-3435-45dc-8ab8-42b5e82464bd None admin] PATH_INFO: `/v3/users/b2b7855ba5724e86b7da7d610ca3fc58` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:58.269705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17263940-3435-45dc-8ab8-42b5e82464bd None admin] RBAC: Authorizing `identity:get_user(user_id=b2b7855ba5724e86b7da7d610ca3fc58)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:58.272212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17263940-3435-45dc-8ab8-42b5e82464bd None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:58.275215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 30/54] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:16:57 2022] GET /identity/v3/users/b2b7855ba5724e86b7da7d610ca3fc58 => generated 247 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:16:58.281965 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17263940-3435-45dc-8ab8-42b5e82464bd None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:58.389411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 25/55] 10.222.0.48 () {60 vars in 1140 bytes} [Thu Sep 1 05:16:57 2022] POST /identity/v3/projects => generated 298 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:16:58.397574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:58.406494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17263940-3435-45dc-8ab8-42b5e82464bd None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:58.454182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a80d52-0103-49f2-b803-16a3a6701f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:58.454952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a80d52-0103-49f2-b803-16a3a6701f44 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:58.455329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a80d52-0103-49f2-b803-16a3a6701f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:58.455704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a80d52-0103-49f2-b803-16a3a6701f44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:58.457267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a80d52-0103-49f2-b803-16a3a6701f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:58.458967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a80d52-0103-49f2-b803-16a3a6701f44 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:58.461035 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 31/56] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:16:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:16:58.473292 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845c2e8-d6cf-438e-a55c-286ab280c789 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:58.621055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:58.627857 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845c2e8-d6cf-438e-a55c-286ab280c789 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:58.666055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ead307-0f56-4e19-90ad-f4ffb9fec46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:58.666684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ead307-0f56-4e19-90ad-f4ffb9fec46c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:58.666966 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ead307-0f56-4e19-90ad-f4ffb9fec46c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:58.667239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ead307-0f56-4e19-90ad-f4ffb9fec46c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:58.668675 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ead307-0f56-4e19-90ad-f4ffb9fec46c None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.domain.id=default, user.id=b2b7855ba5724e86b7da7d610ca3fc58) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:16:58.668982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ead307-0f56-4e19-90ad-f4ffb9fec46c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:58.670549 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ead307-0f56-4e19-90ad-f4ffb9fec46c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:58.679700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 26/57] 10.222.0.48 () {56 vars in 1322 bytes} [Thu Sep 1 05:16:58 2022] GET /identity/v3/role_assignments?user.id=b2b7855ba5724e86b7da7d610ca3fc58&scope.domain.id=default&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 530 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:00.562619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd8b8b-1ca2-4f60-bcc0-0d021a25f378 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:00.563219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd8b8b-1ca2-4f60-bcc0-0d021a25f378 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:00.563219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd8b8b-1ca2-4f60-bcc0-0d021a25f378 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:00.564605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 32/58] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:17:00.570771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b11c25-742f-4feb-8f83-b76e292b0f68 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:00.571348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b11c25-742f-4feb-8f83-b76e292b0f68 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:00.571348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b11c25-742f-4feb-8f83-b76e292b0f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:00.594048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-51b11c25-742f-4feb-8f83-b76e292b0f68 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:00.595678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-51b11c25-742f-4feb-8f83-b76e292b0f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:00.677987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 27/59] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:00.966447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd8b8b-1ca2-4f60-bcc0-0d021a25f378 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:01.085449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd8b8b-1ca2-4f60-bcc0-0d021a25f378 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:01.127303 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375eb23-3711-48a9-a513-09084fcf862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:01.127964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375eb23-3711-48a9-a513-09084fcf862d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:01.128254 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375eb23-3711-48a9-a513-09084fcf862d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:01.128537 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375eb23-3711-48a9-a513-09084fcf862d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:01.129875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375eb23-3711-48a9-a513-09084fcf862d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:01.131380 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375eb23-3711-48a9-a513-09084fcf862d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:01.133079 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 33/60] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:17:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:01.140241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b11c25-742f-4feb-8f83-b76e292b0f68 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:01.248780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:01.258907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b11c25-742f-4feb-8f83-b76e292b0f68 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:01.299793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b93bc-fd5f-44c3-89d7-07388471922f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:01.300425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b93bc-fd5f-44c3-89d7-07388471922f None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:01.300735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b93bc-fd5f-44c3-89d7-07388471922f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:01.301020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b93bc-fd5f-44c3-89d7-07388471922f None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:01.301750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b93bc-fd5f-44c3-89d7-07388471922f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:01.303290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b93bc-fd5f-44c3-89d7-07388471922f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:01.432855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 28/61] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:17:01 2022] POST /identity/v3/users => generated 275 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:17:05.501217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab9c01-6481-406a-ada1-fca40f549b23 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:05.502907 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab9c01-6481-406a-ada1-fca40f549b23 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:05.503691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab9c01-6481-406a-ada1-fca40f549b23 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:05.507121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 34/62] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:05.513844 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1e647-6f54-41ac-bd02-249d8999c26e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:05.515422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1e647-6f54-41ac-bd02-249d8999c26e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:05.516189 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1e647-6f54-41ac-bd02-249d8999c26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:05.563302 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-c2b1e647-6f54-41ac-bd02-249d8999c26e None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:05.566027 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c2b1e647-6f54-41ac-bd02-249d8999c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:05.628214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdd303-3739-4f9b-8c95-43f34bdbf976 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:05.629156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdd303-3739-4f9b-8c95-43f34bdbf976 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:05.630074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bdd303-3739-4f9b-8c95-43f34bdbf976 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:05.632992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 35/63] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:17:05.650717 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56ebaa-7a8c-4ba6-8d22-db91b826fd4a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:05.651219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56ebaa-7a8c-4ba6-8d22-db91b826fd4a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:05.651729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56ebaa-7a8c-4ba6-8d22-db91b826fd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:05.719476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-cc56ebaa-7a8c-4ba6-8d22-db91b826fd4a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:05.721830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-cc56ebaa-7a8c-4ba6-8d22-db91b826fd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:05.730674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 29/64] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:05.776014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee32fb-29f7-4589-b55a-3e309d9877aa None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:05.777466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee32fb-29f7-4589-b55a-3e309d9877aa None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:05.778296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee32fb-29f7-4589-b55a-3e309d9877aa None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:05.781561 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 30/65] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:05.784293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:05.790935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787372d0-c2ff-4879-abb6-c3a845543efb None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:05.791622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787372d0-c2ff-4879-abb6-c3a845543efb None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:05.792145 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787372d0-c2ff-4879-abb6-c3a845543efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:05.863373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-787372d0-c2ff-4879-abb6-c3a845543efb None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:05.867062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-787372d0-c2ff-4879-abb6-c3a845543efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:05.908451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 36/66] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:06.030523 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 31/67] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:06.054380 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56ebaa-7a8c-4ba6-8d22-db91b826fd4a None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:06.182661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56ebaa-7a8c-4ba6-8d22-db91b826fd4a None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:06.245439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c192b1f-ed13-42d3-af11-503918524369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:06.246286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c192b1f-ed13-42d3-af11-503918524369 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:06.246569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c192b1f-ed13-42d3-af11-503918524369 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:06.246900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c192b1f-ed13-42d3-af11-503918524369 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:06.264539 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c192b1f-ed13-42d3-af11-503918524369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-1c192b1f-ed13-42d3-af11-503918524369 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:06.270066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:06.271812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:06.273213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:06.273213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:06.273213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:06.273213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:06.273213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:06.273213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:06.273213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:06.273213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:06.273213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:06.273213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:06.273213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:17:06.273213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:06.277467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 37/68] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:17:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:06.284400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787372d0-c2ff-4879-abb6-c3a845543efb None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:06.297819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:06.414826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c192b1f-ed13-42d3-af11-503918524369 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:06.441894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787372d0-c2ff-4879-abb6-c3a845543efb None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:06.447688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:06.484858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bab94-aae0-40c8-b863-098989de048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:06.485899 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bab94-aae0-40c8-b863-098989de048b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:06.486412 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bab94-aae0-40c8-b863-098989de048b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:06.486953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8bab94-aae0-40c8-b863-098989de048b None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:06.488029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bab94-aae0-40c8-b863-098989de048b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:06.488555 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bab94-aae0-40c8-b863-098989de048b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:06.490285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8bab94-aae0-40c8-b863-098989de048b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:06.501596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 32/69] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:06.502902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bab94-aae0-40c8-b863-098989de048b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:06.546531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c192b1f-ed13-42d3-af11-503918524369 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:06.582309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:06.586112 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae344c14-cc2a-4280-b790-8fed39cef241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:06.587025 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae344c14-cc2a-4280-b790-8fed39cef241 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:06.587325 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae344c14-cc2a-4280-b790-8fed39cef241 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:06.587657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae344c14-cc2a-4280-b790-8fed39cef241 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:06.600441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae344c14-cc2a-4280-b790-8fed39cef241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-ae344c14-cc2a-4280-b790-8fed39cef241 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:06.605670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:06.607294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:06.608764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 38/70] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:17:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:06.610533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f874e-9905-43be-9544-f4e76105fc51 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:06.611088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f874e-9905-43be-9544-f4e76105fc51 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:06.611498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f874e-9905-43be-9544-f4e76105fc51 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:06.614055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 39/71] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:06.615104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f874e-9905-43be-9544-f4e76105fc51 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:06.623587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8bab94-aae0-40c8-b863-098989de048b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:06.669879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0360f0-25af-4800-a5b8-462d64792cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:06.670678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0360f0-25af-4800-a5b8-462d64792cfe None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:06.671063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0360f0-25af-4800-a5b8-462d64792cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:06.671486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0360f0-25af-4800-a5b8-462d64792cfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:06.685187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0360f0-25af-4800-a5b8-462d64792cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-de0360f0-25af-4800-a5b8-462d64792cfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:06.691217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:06.693053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 33/72] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:06.694617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245aa03-a590-4dc8-be7c-e9292b532260 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:06.696107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245aa03-a590-4dc8-be7c-e9292b532260 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:06.696107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245aa03-a590-4dc8-be7c-e9292b532260 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:06.697795 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 34/73] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:06.699841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245aa03-a590-4dc8-be7c-e9292b532260 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:06.743835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:06.767709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f874e-9905-43be-9544-f4e76105fc51 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:06.807158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c82d3d-01e7-438e-9a95-46472593eadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:06.807698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c82d3d-01e7-438e-9a95-46472593eadb None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:06.807978 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c82d3d-01e7-438e-9a95-46472593eadb None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:06.808348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c82d3d-01e7-438e-9a95-46472593eadb None admin] PATH_INFO: `/v3/users/b2b7855ba5724e86b7da7d610ca3fc58` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:06.809842 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c82d3d-01e7-438e-9a95-46472593eadb None admin] RBAC: Authorizing `identity:get_user(user_id=b2b7855ba5724e86b7da7d610ca3fc58)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:06.811375 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c82d3d-01e7-438e-9a95-46472593eadb None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:06.813080 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 40/74] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:06 2022] GET /identity/v3/users/b2b7855ba5724e86b7da7d610ca3fc58 => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:06.814348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2f20e-8b0c-44b3-a992-0bc1e2e666f3 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:06.815056 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2f20e-8b0c-44b3-a992-0bc1e2e666f3 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:06.815610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2f20e-8b0c-44b3-a992-0bc1e2e666f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:06.836472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-2cf2f20e-8b0c-44b3-a992-0bc1e2e666f3 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:06.837937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2cf2f20e-8b0c-44b3-a992-0bc1e2e666f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:06.853954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245aa03-a590-4dc8-be7c-e9292b532260 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:06.896008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:06.906918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e575b90-4b18-4593-8281-703cf5221f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:06.907989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e575b90-4b18-4593-8281-703cf5221f0e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:06.908484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e575b90-4b18-4593-8281-703cf5221f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:06.917142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e575b90-4b18-4593-8281-703cf5221f0e None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:06.917142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e575b90-4b18-4593-8281-703cf5221f0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:06.917142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e575b90-4b18-4593-8281-703cf5221f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:06.917142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e575b90-4b18-4593-8281-703cf5221f0e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:06.922022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 41/75] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:06.922917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2f20e-8b0c-44b3-a992-0bc1e2e666f3 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:06.929897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 35/76] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:17:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:06.932255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b905-0a48-4385-9b58-986e4150c6fc None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:06.933039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b905-0a48-4385-9b58-986e4150c6fc None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:06.933275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8b905-0a48-4385-9b58-986e4150c6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:06.960071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-51a8b905-0a48-4385-9b58-986e4150c6fc None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:06.961983 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-51a8b905-0a48-4385-9b58-986e4150c6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:07.038718 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:07.066137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2f20e-8b0c-44b3-a992-0bc1e2e666f3 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:07.077432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 36/77] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:07.077432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8b905-0a48-4385-9b58-986e4150c6fc None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:07.117668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3434b02-5cb1-4a78-ba0d-81d2c379e529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:07.118545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3434b02-5cb1-4a78-ba0d-81d2c379e529 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:07.118979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3434b02-5cb1-4a78-ba0d-81d2c379e529 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:07.119401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3434b02-5cb1-4a78-ba0d-81d2c379e529 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:07.120377 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3434b02-5cb1-4a78-ba0d-81d2c379e529 None admin] RBAC: Adding query filter params (name=member) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:07.120809 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3434b02-5cb1-4a78-ba0d-81d2c379e529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:07.122470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3434b02-5cb1-4a78-ba0d-81d2c379e529 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:07.134421 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 42/78] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:07.140786 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3434b02-5cb1-4a78-ba0d-81d2c379e529 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:07.236784 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8b905-0a48-4385-9b58-986e4150c6fc None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:07.265131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:07.284958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeef01e-5c79-4b2d-8e00-1917107f78f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:07.286000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeef01e-5c79-4b2d-8e00-1917107f78f5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:07.286517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeef01e-5c79-4b2d-8e00-1917107f78f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:07.287340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeef01e-5c79-4b2d-8e00-1917107f78f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:07.299908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3434b02-5cb1-4a78-ba0d-81d2c379e529 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:07.345269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e180e-56af-422e-acaf-95b8e738c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:07.346156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e180e-56af-422e-acaf-95b8e738c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:07.346366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e180e-56af-422e-acaf-95b8e738c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:07.346668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e180e-56af-422e-acaf-95b8e738c9a9 None admin] PATH_INFO: `/v3/users/997f08f01dbe4348bbce534fb3b4be8b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:07.373338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:07.376348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e180e-56af-422e-acaf-95b8e738c9a9 None admin] RBAC: Authorizing `identity:get_user(user_id=997f08f01dbe4348bbce534fb3b4be8b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:07.377687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeef01e-5c79-4b2d-8e00-1917107f78f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:07.377922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e180e-56af-422e-acaf-95b8e738c9a9 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:07.379225 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeef01e-5c79-4b2d-8e00-1917107f78f5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:07.384562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 43/79] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:07 2022] GET /identity/v3/users/997f08f01dbe4348bbce534fb3b4be8b => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:07.384562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e180e-56af-422e-acaf-95b8e738c9a9 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:07.519787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e180e-56af-422e-acaf-95b8e738c9a9 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:07.543768 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 37/80] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:07.544665 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeef01e-5c79-4b2d-8e00-1917107f78f5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:07.565462 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f68a59-3dd5-4cb0-8dbf-c231c439ca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:07.566330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f68a59-3dd5-4cb0-8dbf-c231c439ca3c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:07.566494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f68a59-3dd5-4cb0-8dbf-c231c439ca3c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:07.566767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f68a59-3dd5-4cb0-8dbf-c231c439ca3c None admin] PATH_INFO: `/v3/users/997f08f01dbe4348bbce534fb3b4be8b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:07.567999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f68a59-3dd5-4cb0-8dbf-c231c439ca3c None admin] RBAC: Authorizing `identity:get_user(user_id=997f08f01dbe4348bbce534fb3b4be8b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:07.569508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f68a59-3dd5-4cb0-8dbf-c231c439ca3c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:07.571493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 44/81] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:07 2022] GET /identity/v3/users/997f08f01dbe4348bbce534fb3b4be8b => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:07.572111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f68a59-3dd5-4cb0-8dbf-c231c439ca3c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:07.582608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:07.652559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:07.677874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeef01e-5c79-4b2d-8e00-1917107f78f5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:07.695267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f68a59-3dd5-4cb0-8dbf-c231c439ca3c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:07.727840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679fbec-40f3-4c3d-8e04-7b70b86210b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:07.728960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679fbec-40f3-4c3d-8e04-7b70b86210b6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:07.729517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679fbec-40f3-4c3d-8e04-7b70b86210b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:07.730546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679fbec-40f3-4c3d-8e04-7b70b86210b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:07.732983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9e33d-cf9d-44be-a984-43a6d5768060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:07.733595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679fbec-40f3-4c3d-8e04-7b70b86210b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:07.733692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9e33d-cf9d-44be-a984-43a6d5768060 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:07.733920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9e33d-cf9d-44be-a984-43a6d5768060 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:07.734200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9e33d-cf9d-44be-a984-43a6d5768060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:07.736421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679fbec-40f3-4c3d-8e04-7b70b86210b6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:07.741750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 38/82] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:17:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:07.741750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679fbec-40f3-4c3d-8e04-7b70b86210b6 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:07.819708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9e33d-cf9d-44be-a984-43a6d5768060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:07.820950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9e33d-cf9d-44be-a984-43a6d5768060 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:07.862630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:07.879084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679fbec-40f3-4c3d-8e04-7b70b86210b6 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:07.912850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:07.928695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63bba7-3154-4a25-8120-752bba7df8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:07.929756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63bba7-3154-4a25-8120-752bba7df8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:07.930128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63bba7-3154-4a25-8120-752bba7df8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:07.930575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63bba7-3154-4a25-8120-752bba7df8e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:07.948597 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63bba7-3154-4a25-8120-752bba7df8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-3b63bba7-3154-4a25-8120-752bba7df8e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:07.958593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:07.959914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:07.960754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 39/83] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:07.963279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63bba7-3154-4a25-8120-752bba7df8e9 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:07.963439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 45/84] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:07.963439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9e33d-cf9d-44be-a984-43a6d5768060 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:08.114196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9e33d-cf9d-44be-a984-43a6d5768060 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:08.119449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63bba7-3154-4a25-8120-752bba7df8e9 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:08.172034 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335eb18-d083-4feb-b5b3-e4e04f608252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:08.172701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335eb18-d083-4feb-b5b3-e4e04f608252 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:08.173074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0127c-d01d-48b7-8b36-b65a2394e2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:08.173254 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335eb18-d083-4feb-b5b3-e4e04f608252 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:08.173605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335eb18-d083-4feb-b5b3-e4e04f608252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:08.173899 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0127c-d01d-48b7-8b36-b65a2394e2fe None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:08.174252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0127c-d01d-48b7-8b36-b65a2394e2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:08.174661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f0127c-d01d-48b7-8b36-b65a2394e2fe None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:08.176009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0127c-d01d-48b7-8b36-b65a2394e2fe None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:08.177831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f0127c-d01d-48b7-8b36-b65a2394e2fe None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:08.180380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 40/85] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:07 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:08.181803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0127c-d01d-48b7-8b36-b65a2394e2fe None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:08.207492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:08.220998 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:08.260591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335eb18-d083-4feb-b5b3-e4e04f608252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:08.262291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335eb18-d083-4feb-b5b3-e4e04f608252 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:08.327709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f0127c-d01d-48b7-8b36-b65a2394e2fe None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:08.381770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9512bd-d083-4752-bf63-ed5ffb8741c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:08.382510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9512bd-d083-4752-bf63-ed5ffb8741c2 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:08.382929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9512bd-d083-4752-bf63-ed5ffb8741c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:08.383393 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9512bd-d083-4752-bf63-ed5ffb8741c2 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:08.384306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9512bd-d083-4752-bf63-ed5ffb8741c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:08.386578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9512bd-d083-4752-bf63-ed5ffb8741c2 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:08.408568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 46/86] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:08.410054 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335eb18-d083-4feb-b5b3-e4e04f608252 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:08.491997 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:08.534270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335eb18-d083-4feb-b5b3-e4e04f608252 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:08.555265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 41/87] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:17:08 2022] POST /identity/v3/users => generated 289 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:08.556831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9512bd-d083-4752-bf63-ed5ffb8741c2 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:08.596215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331dac-a013-4e0b-bce6-b862f02a0f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:08.597255 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331dac-a013-4e0b-bce6-b862f02a0f3c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:08.597701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331dac-a013-4e0b-bce6-b862f02a0f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:08.598394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0331dac-a013-4e0b-bce6-b862f02a0f3c None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:08.599575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331dac-a013-4e0b-bce6-b862f02a0f3c None admin] RBAC: Adding query filter params (name=member) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:08.600012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331dac-a013-4e0b-bce6-b862f02a0f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:08.602038 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0331dac-a013-4e0b-bce6-b862f02a0f3c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:08.624891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 47/88] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:08.624891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331dac-a013-4e0b-bce6-b862f02a0f3c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:08.699089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:08.755604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9512bd-d083-4752-bf63-ed5ffb8741c2 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:08.823066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0331dac-a013-4e0b-bce6-b862f02a0f3c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:08.827566 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b003e9-b3d5-4127-b6e2-5dbec60e19f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:08.829500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b003e9-b3d5-4127-b6e2-5dbec60e19f9 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:08.829810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b003e9-b3d5-4127-b6e2-5dbec60e19f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:08.830065 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b003e9-b3d5-4127-b6e2-5dbec60e19f9 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:08.831428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b003e9-b3d5-4127-b6e2-5dbec60e19f9 None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:08.832923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b003e9-b3d5-4127-b6e2-5dbec60e19f9 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:08.835595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 42/89] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:08 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:08.837178 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b003e9-b3d5-4127-b6e2-5dbec60e19f9 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:08.880468 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:08.892052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c88fc-f27a-46c0-b066-d4d9c99a9fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:08.893410 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c88fc-f27a-46c0-b066-d4d9c99a9fdc None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:08.893867 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c88fc-f27a-46c0-b066-d4d9c99a9fdc None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:08.894296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c88fc-f27a-46c0-b066-d4d9c99a9fdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:08.895391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c88fc-f27a-46c0-b066-d4d9c99a9fdc None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=82a264f4d0584bc8bcd438643dbbb167, user.id=b2b7855ba5724e86b7da7d610ca3fc58) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:08.895928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c88fc-f27a-46c0-b066-d4d9c99a9fdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:08.898587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c88fc-f27a-46c0-b066-d4d9c99a9fdc None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:08.907529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 48/90] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:08 2022] GET /identity/v3/role_assignments?user.id=b2b7855ba5724e86b7da7d610ca3fc58&scope.project.id=82a264f4d0584bc8bcd438643dbbb167&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:08.909338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c88fc-f27a-46c0-b066-d4d9c99a9fdc None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:09.068730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b003e9-b3d5-4127-b6e2-5dbec60e19f9 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:09.148781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c88fc-f27a-46c0-b066-d4d9c99a9fdc None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:09.150508 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36c222-da2c-4491-bf8a-350b6a71c5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:09.152458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36c222-da2c-4491-bf8a-350b6a71c5cc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:09.153255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36c222-da2c-4491-bf8a-350b6a71c5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:09.155362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36c222-da2c-4491-bf8a-350b6a71c5cc None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:09.157962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36c222-da2c-4491-bf8a-350b6a71c5cc None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:09.161119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36c222-da2c-4491-bf8a-350b6a71c5cc None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:09.165586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 43/91] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:08 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:09.168050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36c222-da2c-4491-bf8a-350b6a71c5cc None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:09.194760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:09.221774 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa16f4-3e1f-4ed0-9b12-0422c9ab1593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:09.222804 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa16f4-3e1f-4ed0-9b12-0422c9ab1593 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:09.223284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa16f4-3e1f-4ed0-9b12-0422c9ab1593 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:09.224475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa16f4-3e1f-4ed0-9b12-0422c9ab1593 None admin] PATH_INFO: `/v3/users/997f08f01dbe4348bbce534fb3b4be8b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:09.226079 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa16f4-3e1f-4ed0-9b12-0422c9ab1593 None admin] RBAC: Authorizing `identity:get_user(user_id=997f08f01dbe4348bbce534fb3b4be8b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:09.228889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa16f4-3e1f-4ed0-9b12-0422c9ab1593 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:09.233408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 49/92] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:08 2022] GET /identity/v3/users/997f08f01dbe4348bbce534fb3b4be8b => generated 275 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:09.234838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa16f4-3e1f-4ed0-9b12-0422c9ab1593 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:09.411577 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36c222-da2c-4491-bf8a-350b6a71c5cc None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:09.445441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:09.486760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c503d6-004f-430c-9e95-fb3ea614b463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:09.487401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c503d6-004f-430c-9e95-fb3ea614b463 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:09.487689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c503d6-004f-430c-9e95-fb3ea614b463 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:09.488057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c503d6-004f-430c-9e95-fb3ea614b463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:09.488913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c503d6-004f-430c-9e95-fb3ea614b463 None admin] RBAC: Adding query filter params (role.id=5183ce055fde4522816e3cdce43ed4e9, scope.project.id=82a264f4d0584bc8bcd438643dbbb167, user.id=997f08f01dbe4348bbce534fb3b4be8b) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:09.489238 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c503d6-004f-430c-9e95-fb3ea614b463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:09.490839 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c503d6-004f-430c-9e95-fb3ea614b463 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:09.498673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 44/93] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:09 2022] GET /identity/v3/role_assignments?user.id=997f08f01dbe4348bbce534fb3b4be8b&scope.project.id=82a264f4d0584bc8bcd438643dbbb167&role.id=5183ce055fde4522816e3cdce43ed4e9 => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:09.499683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c503d6-004f-430c-9e95-fb3ea614b463 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:09.585349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa16f4-3e1f-4ed0-9b12-0422c9ab1593 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:09.699896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab305581-3d3b-4c90-817e-383e949849b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:09.700952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab305581-3d3b-4c90-817e-383e949849b2 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:09.701308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab305581-3d3b-4c90-817e-383e949849b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:09.701893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab305581-3d3b-4c90-817e-383e949849b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:09.703290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab305581-3d3b-4c90-817e-383e949849b2 None admin] RBAC: Adding query filter params (role.id=d27b7d5ab3274b85a416d9f8f7f75648, scope.project.id=82a264f4d0584bc8bcd438643dbbb167, user.id=997f08f01dbe4348bbce534fb3b4be8b) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:09.703825 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab305581-3d3b-4c90-817e-383e949849b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:09.712139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab305581-3d3b-4c90-817e-383e949849b2 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:09.712887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:09.729411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 50/94] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:09 2022] GET /identity/v3/role_assignments?user.id=997f08f01dbe4348bbce534fb3b4be8b&scope.project.id=82a264f4d0584bc8bcd438643dbbb167&role.id=d27b7d5ab3274b85a416d9f8f7f75648 => generated 259 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:09.801534 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c503d6-004f-430c-9e95-fb3ea614b463 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:09.880901 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe190e-8ce6-426a-9aee-a71f3ae90a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:09.881976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe190e-8ce6-426a-9aee-a71f3ae90a30 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:09.882431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe190e-8ce6-426a-9aee-a71f3ae90a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:09.882872 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe190e-8ce6-426a-9aee-a71f3ae90a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:10.025649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe190e-8ce6-426a-9aee-a71f3ae90a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:10.028955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe190e-8ce6-426a-9aee-a71f3ae90a30 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:10.175057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:10.240016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 45/95] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:10.249080 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab305581-3d3b-4c90-817e-383e949849b2 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:10.477068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab305581-3d3b-4c90-817e-383e949849b2 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:10.525684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:10.546273 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082db424-c791-4264-80df-93dd2e693cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:10.547326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082db424-c791-4264-80df-93dd2e693cca None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:10.551642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082db424-c791-4264-80df-93dd2e693cca None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:10.551642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082db424-c791-4264-80df-93dd2e693cca None admin] PATH_INFO: `/v3/projects/e11d9f96b0e84fe2870d462e51a8262b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:10.552038 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082db424-c791-4264-80df-93dd2e693cca None admin] RBAC: Authorizing `identity:get_project(project_id=e11d9f96b0e84fe2870d462e51a8262b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:10.554722 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082db424-c791-4264-80df-93dd2e693cca None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:10.558253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 51/96] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:10 2022] GET /identity/v3/projects/e11d9f96b0e84fe2870d462e51a8262b => generated 312 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:10.567504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe190e-8ce6-426a-9aee-a71f3ae90a30 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:10.788059 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe190e-8ce6-426a-9aee-a71f3ae90a30 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:10.842017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d01d1e-0722-4253-a8d9-aa935b165925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:10.842666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d01d1e-0722-4253-a8d9-aa935b165925 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:10.842942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d01d1e-0722-4253-a8d9-aa935b165925 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:10.843221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d01d1e-0722-4253-a8d9-aa935b165925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:10.843983 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d01d1e-0722-4253-a8d9-aa935b165925 None admin] RBAC: Adding query filter params (role.id=d27b7d5ab3274b85a416d9f8f7f75648, scope.project.id=e11d9f96b0e84fe2870d462e51a8262b, user.id=997f08f01dbe4348bbce534fb3b4be8b) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:10.844296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d01d1e-0722-4253-a8d9-aa935b165925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:10.845853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d01d1e-0722-4253-a8d9-aa935b165925 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:10.852883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 46/97] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:10 2022] GET /identity/v3/role_assignments?user.id=997f08f01dbe4348bbce534fb3b4be8b&scope.project.id=e11d9f96b0e84fe2870d462e51a8262b&role.id=d27b7d5ab3274b85a416d9f8f7f75648 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:12.415189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63eb20-52c8-40fa-bf85-7b5c0a733e6e None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:12.416209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63eb20-52c8-40fa-bf85-7b5c0a733e6e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:12.416209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63eb20-52c8-40fa-bf85-7b5c0a733e6e None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:12.417259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 52/98] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:17:12.430730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f1ea0-3b29-4db4-894e-8b9ab4f64362 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:12.431641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f1ea0-3b29-4db4-894e-8b9ab4f64362 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:12.431641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f1ea0-3b29-4db4-894e-8b9ab4f64362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:12.497093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-383f1ea0-3b29-4db4-894e-8b9ab4f64362 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:12.498437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-383f1ea0-3b29-4db4-894e-8b9ab4f64362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:12.539254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:12.584758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 47/99] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:12.882815 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63eb20-52c8-40fa-bf85-7b5c0a733e6e None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:13.030128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63eb20-52c8-40fa-bf85-7b5c0a733e6e None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:13.081170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f790d-db7b-444a-b80b-70bb42db567f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:13.081760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f790d-db7b-444a-b80b-70bb42db567f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:13.082046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f790d-db7b-444a-b80b-70bb42db567f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:13.082321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f790d-db7b-444a-b80b-70bb42db567f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:13.086734 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd816e4-eedb-4672-9d65-8b83bbaf4ab0 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:13.087062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd816e4-eedb-4672-9d65-8b83bbaf4ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:13.087299 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd816e4-eedb-4672-9d65-8b83bbaf4ab0 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:13.088712 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 48/100] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:13.102039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c54cbc-28eb-4c08-98a8-d2b3bc6a91a8 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:13.102353 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c54cbc-28eb-4c08-98a8-d2b3bc6a91a8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:13.102598 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c54cbc-28eb-4c08-98a8-d2b3bc6a91a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:13.128275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f790d-db7b-444a-b80b-70bb42db567f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-948f790d-db7b-444a-b80b-70bb42db567f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:13.133523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:13.134461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:13.135228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:13.135228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:13.135228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:13.135228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:13.135228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:13.135228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:13.135228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:13.135228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:13.135228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:13.135228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:13.135228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:13.135228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:13.139346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 53/101] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:13.140364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-60c54cbc-28eb-4c08-98a8-d2b3bc6a91a8 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:13.145981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-60c54cbc-28eb-4c08-98a8-d2b3bc6a91a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:13.154566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65044adc-cb0f-4c6d-9902-c40b66bbe685 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:13.154867 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65044adc-cb0f-4c6d-9902-c40b66bbe685 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:13.155119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65044adc-cb0f-4c6d-9902-c40b66bbe685 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:13.156844 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 54/102] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:13.163488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65044adc-cb0f-4c6d-9902-c40b66bbe685 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:13.261849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:13.267515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 49/103] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 05:17:13.270153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4686d-3cb2-4af9-ae50-fa7419132dcc None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:13.270899 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4686d-3cb2-4af9-ae50-fa7419132dcc None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:13.277124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4686d-3cb2-4af9-ae50-fa7419132dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:13.307058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-e3c4686d-3cb2-4af9-ae50-fa7419132dcc None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:13.310840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e3c4686d-3cb2-4af9-ae50-fa7419132dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:13.333318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65044adc-cb0f-4c6d-9902-c40b66bbe685 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:13.416776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2be4cc-1a78-44d9-b0a3-7efd94463455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:13.418291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2be4cc-1a78-44d9-b0a3-7efd94463455 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:13.418885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2be4cc-1a78-44d9-b0a3-7efd94463455 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:13.419192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2be4cc-1a78-44d9-b0a3-7efd94463455 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:13.420233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2be4cc-1a78-44d9-b0a3-7efd94463455 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:13.420427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2be4cc-1a78-44d9-b0a3-7efd94463455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:13.421767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2be4cc-1a78-44d9-b0a3-7efd94463455 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:13.440920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 55/104] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:13.446869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77cf06-abf0-42dd-b28d-acecc95a9aee None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:13.447261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77cf06-abf0-42dd-b28d-acecc95a9aee None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:13.447582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce77cf06-abf0-42dd-b28d-acecc95a9aee None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:13.449972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 56/105] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:13.450804 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77cf06-abf0-42dd-b28d-acecc95a9aee None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:13.469623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 50/106] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:13.472990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67224b8b-a6a6-452a-9288-a1f4c8d7764f None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:13.473837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67224b8b-a6a6-452a-9288-a1f4c8d7764f None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:13.474645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67224b8b-a6a6-452a-9288-a1f4c8d7764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:13.544114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-67224b8b-a6a6-452a-9288-a1f4c8d7764f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:13.547303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-67224b8b-a6a6-452a-9288-a1f4c8d7764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:13.590745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:13.663148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 51/107] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:13.699833 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67224b8b-a6a6-452a-9288-a1f4c8d7764f None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:13.758634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce77cf06-abf0-42dd-b28d-acecc95a9aee None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:13.822009 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:13.880212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d991e-c930-4fd2-9147-86d888f96c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:13.881306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d991e-c930-4fd2-9147-86d888f96c00 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:13.881896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d991e-c930-4fd2-9147-86d888f96c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:13.882371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d991e-c930-4fd2-9147-86d888f96c00 None admin] PATH_INFO: `/v3/users/7d52041f9db44b73a4c78593eb8ebf6c` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:13.914883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67224b8b-a6a6-452a-9288-a1f4c8d7764f None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:13.916270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d991e-c930-4fd2-9147-86d888f96c00 None admin] RBAC: Authorizing `identity:get_user(user_id=7d52041f9db44b73a4c78593eb8ebf6c)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:13.917913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d991e-c930-4fd2-9147-86d888f96c00 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:13.921573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 57/108] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:13 2022] GET /identity/v3/users/7d52041f9db44b73a4c78593eb8ebf6c => generated 289 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:13.923365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820565a-2e65-47c4-acdc-a3386c35f8c9 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:13.923876 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820565a-2e65-47c4-acdc-a3386c35f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:13.924357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820565a-2e65-47c4-acdc-a3386c35f8c9 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:13.926405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 58/109] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:13.927577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820565a-2e65-47c4-acdc-a3386c35f8c9 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:13.967897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56fb64-1e3b-4f02-99c7-6a89316ac515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:13.969000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56fb64-1e3b-4f02-99c7-6a89316ac515 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:13.969544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56fb64-1e3b-4f02-99c7-6a89316ac515 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:13.970025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56fb64-1e3b-4f02-99c7-6a89316ac515 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:13.971617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56fb64-1e3b-4f02-99c7-6a89316ac515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:13.973330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a56fb64-1e3b-4f02-99c7-6a89316ac515 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:13.975278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 52/110] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:17:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:13.976575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56fb64-1e3b-4f02-99c7-6a89316ac515 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:14.009298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:14.121798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56fb64-1e3b-4f02-99c7-6a89316ac515 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:14.141722 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820565a-2e65-47c4-acdc-a3386c35f8c9 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:14.193197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1216a0e-1668-4db6-b8a7-2beebef3c66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:14.194201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1216a0e-1668-4db6-b8a7-2beebef3c66c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:14.195342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1216a0e-1668-4db6-b8a7-2beebef3c66c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:14.195643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1216a0e-1668-4db6-b8a7-2beebef3c66c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:14.197031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15693683-386f-4691-9866-5e0b7ffe1b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:14.198093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15693683-386f-4691-9866-5e0b7ffe1b1b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:14.198610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15693683-386f-4691-9866-5e0b7ffe1b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:14.199079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15693683-386f-4691-9866-5e0b7ffe1b1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:14.219330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1216a0e-1668-4db6-b8a7-2beebef3c66c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-e1216a0e-1668-4db6-b8a7-2beebef3c66c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:14.225444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:14.227115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:14.228661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 59/111] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:17:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:14.231186 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c7219-0f0b-4e1b-b0d3-0dd454f513b7 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:14.231186 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c7219-0f0b-4e1b-b0d3-0dd454f513b7 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:14.231656 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c7219-0f0b-4e1b-b0d3-0dd454f513b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:14.261446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5b1c7219-0f0b-4e1b-b0d3-0dd454f513b7 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:14.263661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5b1c7219-0f0b-4e1b-b0d3-0dd454f513b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:14.313635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:14.325273 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15693683-386f-4691-9866-5e0b7ffe1b1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:14.327941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15693683-386f-4691-9866-5e0b7ffe1b1b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:14.361549 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:14.367606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 60/112] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:14.368883 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c7219-0f0b-4e1b-b0d3-0dd454f513b7 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:14.520298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 53/113] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:14.520988 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15693683-386f-4691-9866-5e0b7ffe1b1b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:14.537932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c7219-0f0b-4e1b-b0d3-0dd454f513b7 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:14.607510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25f7fd-92d3-4f70-ae3d-634d783a3bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:14.608233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25f7fd-92d3-4f70-ae3d-634d783a3bff None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:14.608550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25f7fd-92d3-4f70-ae3d-634d783a3bff None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:14.608847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25f7fd-92d3-4f70-ae3d-634d783a3bff None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:14.609623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25f7fd-92d3-4f70-ae3d-634d783a3bff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:14.611502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25f7fd-92d3-4f70-ae3d-634d783a3bff None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:14.700156 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15693683-386f-4691-9866-5e0b7ffe1b1b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:14.736562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 61/114] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:17:14 2022] POST /identity/v3/projects => generated 302 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:14.737591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25f7fd-92d3-4f70-ae3d-634d783a3bff None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:14.747357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:14.760598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:14.767870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb5322-e08f-4151-bab4-c0ce688f5edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:14.768581 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb5322-e08f-4151-bab4-c0ce688f5edd None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:14.768871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb5322-e08f-4151-bab4-c0ce688f5edd None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:14.769152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb5322-e08f-4151-bab4-c0ce688f5edd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:14.786383 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbb5322-e08f-4151-bab4-c0ce688f5edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-4bbb5322-e08f-4151-bab4-c0ce688f5edd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:14.792763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:14.803071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 54/115] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:14.804580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85809ba0-9420-44fe-abb4-11a793cb74bf None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:14.805962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85809ba0-9420-44fe-abb4-11a793cb74bf None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:14.805962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85809ba0-9420-44fe-abb4-11a793cb74bf None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:14.805962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 55/116] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:14.805962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85809ba0-9420-44fe-abb4-11a793cb74bf None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:14.899194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25f7fd-92d3-4f70-ae3d-634d783a3bff None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:14.946731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcddd6d-09e2-4200-984b-0c6b45a542dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:14.947750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcddd6d-09e2-4200-984b-0c6b45a542dc None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:14.948030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcddd6d-09e2-4200-984b-0c6b45a542dc None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:14.948420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcddd6d-09e2-4200-984b-0c6b45a542dc None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:14.949171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcddd6d-09e2-4200-984b-0c6b45a542dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:14.949749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcddd6d-09e2-4200-984b-0c6b45a542dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:14.951448 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcddd6d-09e2-4200-984b-0c6b45a542dc None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:14.964604 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 62/117] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:14.969434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcddd6d-09e2-4200-984b-0c6b45a542dc None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:14.992489 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85809ba0-9420-44fe-abb4-11a793cb74bf None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:15.062266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9b4e4-d4e0-4f8e-bdad-db03d1e16061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:15.062854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9b4e4-d4e0-4f8e-bdad-db03d1e16061 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:15.063142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9b4e4-d4e0-4f8e-bdad-db03d1e16061 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:15.063426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9b4e4-d4e0-4f8e-bdad-db03d1e16061 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:15.064664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9b4e4-d4e0-4f8e-bdad-db03d1e16061 None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:15.066217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9b4e4-d4e0-4f8e-bdad-db03d1e16061 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:15.073912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 56/118] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:14 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:15.073912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9b4e4-d4e0-4f8e-bdad-db03d1e16061 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:15.123445 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:15.153713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcddd6d-09e2-4200-984b-0c6b45a542dc None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:15.164316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:15.217258 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70566a11-bf27-44bc-9645-1e16111a8dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:15.217954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70566a11-bf27-44bc-9645-1e16111a8dbf None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:15.218443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70566a11-bf27-44bc-9645-1e16111a8dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:15.218728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70566a11-bf27-44bc-9645-1e16111a8dbf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:15.231954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70566a11-bf27-44bc-9645-1e16111a8dbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:15.232508 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9b4e4-d4e0-4f8e-bdad-db03d1e16061 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-70566a11-bf27-44bc-9645-1e16111a8dbf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:15.237632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:15.238626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 63/119] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:17:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:15.242461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866d583-f2f4-49c8-993b-2d30ec7fa591 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:15.243163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866d583-f2f4-49c8-993b-2d30ec7fa591 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:15.243163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866d583-f2f4-49c8-993b-2d30ec7fa591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:15.266503 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-f866d583-f2f4-49c8-993b-2d30ec7fa591 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:15.268023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f866d583-f2f4-49c8-993b-2d30ec7fa591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:15.284822 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb909c01-f192-4135-820e-117add19c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:15.285609 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb909c01-f192-4135-820e-117add19c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:15.285888 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb909c01-f192-4135-820e-117add19c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:15.286168 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb909c01-f192-4135-820e-117add19c8b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:15.286872 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb909c01-f192-4135-820e-117add19c8b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:15.287346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb909c01-f192-4135-820e-117add19c8b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:15.288603 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb909c01-f192-4135-820e-117add19c8b9 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:15.303686 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 57/120] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:15.306304 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb909c01-f192-4135-820e-117add19c8b9 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:15.365064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 64/121] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:15.365064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866d583-f2f4-49c8-993b-2d30ec7fa591 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:15.462076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:15.483775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb909c01-f192-4135-820e-117add19c8b9 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:15.501585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f866d583-f2f4-49c8-993b-2d30ec7fa591 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:15.501872 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:15.530692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e0bf8-e5a4-4ea4-b330-5b08efa6793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:15.531766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e0bf8-e5a4-4ea4-b330-5b08efa6793c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:15.532270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e0bf8-e5a4-4ea4-b330-5b08efa6793c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:15.532876 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e0bf8-e5a4-4ea4-b330-5b08efa6793c None admin] PATH_INFO: `/v3/users/b2b7855ba5724e86b7da7d610ca3fc58` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:15.534891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e0bf8-e5a4-4ea4-b330-5b08efa6793c None admin] RBAC: Authorizing `identity:get_user(user_id=b2b7855ba5724e86b7da7d610ca3fc58)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:15.536739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e0bf8-e5a4-4ea4-b330-5b08efa6793c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:15.539180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 58/122] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:15 2022] GET /identity/v3/users/b2b7855ba5724e86b7da7d610ca3fc58 => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:15.546782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e0bf8-e5a4-4ea4-b330-5b08efa6793c None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:15.548775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e65515-286f-47ad-819b-a0e8a072ef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:15.550013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e65515-286f-47ad-819b-a0e8a072ef9b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:15.550465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e65515-286f-47ad-819b-a0e8a072ef9b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:15.550883 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e65515-286f-47ad-819b-a0e8a072ef9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:15.551838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e65515-286f-47ad-819b-a0e8a072ef9b None admin] RBAC: Adding query filter params (role.id=e3703da52f214166b433fe3405753808, scope.project.id=82a264f4d0584bc8bcd438643dbbb167, user.id=7d52041f9db44b73a4c78593eb8ebf6c) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:15.552299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e65515-286f-47ad-819b-a0e8a072ef9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:15.554387 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e65515-286f-47ad-819b-a0e8a072ef9b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:15.562169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 65/123] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:15 2022] GET /identity/v3/role_assignments?user.id=7d52041f9db44b73a4c78593eb8ebf6c&scope.project.id=82a264f4d0584bc8bcd438643dbbb167&role.id=e3703da52f214166b433fe3405753808 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:15.563330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e65515-286f-47ad-819b-a0e8a072ef9b None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:15.719150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e65515-286f-47ad-819b-a0e8a072ef9b None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:15.721070 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e0bf8-e5a4-4ea4-b330-5b08efa6793c None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:15.784857 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:15.794565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1826c0-fac7-43fb-af8c-a7ccbacff135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:15.794894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae5f94-9988-4345-8d0f-21b21d0beef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:15.795362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae5f94-9988-4345-8d0f-21b21d0beef5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:15.795648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae5f94-9988-4345-8d0f-21b21d0beef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:15.795923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae5f94-9988-4345-8d0f-21b21d0beef5 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:15.796703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae5f94-9988-4345-8d0f-21b21d0beef5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:15.797005 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae5f94-9988-4345-8d0f-21b21d0beef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:15.797351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1826c0-fac7-43fb-af8c-a7ccbacff135 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:15.798106 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1826c0-fac7-43fb-af8c-a7ccbacff135 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:15.798578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae5f94-9988-4345-8d0f-21b21d0beef5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:15.799171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1826c0-fac7-43fb-af8c-a7ccbacff135 None admin] PATH_INFO: `/v3/users/997f08f01dbe4348bbce534fb3b4be8b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:15.801775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1826c0-fac7-43fb-af8c-a7ccbacff135 None admin] RBAC: Authorizing `identity:get_user(user_id=997f08f01dbe4348bbce534fb3b4be8b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:15.804737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1826c0-fac7-43fb-af8c-a7ccbacff135 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:15.808594 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 66/124] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:15 2022] GET /identity/v3/users/997f08f01dbe4348bbce534fb3b4be8b => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:15.813019 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1826c0-fac7-43fb-af8c-a7ccbacff135 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:15.817602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 59/125] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:17:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:15.836806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae5f94-9988-4345-8d0f-21b21d0beef5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:15.898582 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:15.990143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae5f94-9988-4345-8d0f-21b21d0beef5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:16.023488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1826c0-fac7-43fb-af8c-a7ccbacff135 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:16.049080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fec04-589a-4607-945b-b15a0be5bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:16.050392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fec04-589a-4607-945b-b15a0be5bf3e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:16.051124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fec04-589a-4607-945b-b15a0be5bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:16.051397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fec04-589a-4607-945b-b15a0be5bf3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:16.076023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fec04-589a-4607-945b-b15a0be5bf3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:16.079218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb3993-0919-45e9-8dd6-da332b349906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:16.080091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb3993-0919-45e9-8dd6-da332b349906 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:16.080567 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb3993-0919-45e9-8dd6-da332b349906 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:16.080986 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb3993-0919-45e9-8dd6-da332b349906 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:16.082456 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb3993-0919-45e9-8dd6-da332b349906 None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-3f0fec04-589a-4607-945b-b15a0be5bf3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:16.083512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:16.084769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:16.085814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:16.085814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:16.085814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:16.085814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:16.085814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:16.085814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:16.085814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:16.085814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:16.085814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:16.085814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:16.085814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:16.085814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:16.092558 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb3993-0919-45e9-8dd6-da332b349906 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:16.092770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 60/126] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:16.092770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fec04-589a-4607-945b-b15a0be5bf3e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:16.096359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 67/127] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:15 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:16.098060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb3993-0919-45e9-8dd6-da332b349906 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:16.193928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:16.235359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fec04-589a-4607-945b-b15a0be5bf3e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:16.235554 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb3993-0919-45e9-8dd6-da332b349906 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:16.238757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:16.278173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74369798-8b96-4257-abf8-caf7246674a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:16.278778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74369798-8b96-4257-abf8-caf7246674a7 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:16.279091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74369798-8b96-4257-abf8-caf7246674a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:16.279340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74369798-8b96-4257-abf8-caf7246674a7 None admin] PATH_INFO: `/v3/users/997f08f01dbe4348bbce534fb3b4be8b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:16.280645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74369798-8b96-4257-abf8-caf7246674a7 None admin] RBAC: Authorizing `identity:get_user(user_id=997f08f01dbe4348bbce534fb3b4be8b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:16.282452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74369798-8b96-4257-abf8-caf7246674a7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:16.283052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc1eab-8839-4ca3-82a1-b26004b3f6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:16.283982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc1eab-8839-4ca3-82a1-b26004b3f6cb None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:16.289084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 68/128] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:16 2022] GET /identity/v3/users/997f08f01dbe4348bbce534fb3b4be8b => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:16.289084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74369798-8b96-4257-abf8-caf7246674a7 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:16.289328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc1eab-8839-4ca3-82a1-b26004b3f6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:16.289328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc1eab-8839-4ca3-82a1-b26004b3f6cb None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:16.292799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc1eab-8839-4ca3-82a1-b26004b3f6cb None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:16.294387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc1eab-8839-4ca3-82a1-b26004b3f6cb None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:16.297618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 61/129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:16 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:16.298457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc1eab-8839-4ca3-82a1-b26004b3f6cb None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:16.467379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc1eab-8839-4ca3-82a1-b26004b3f6cb None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:16.502047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74369798-8b96-4257-abf8-caf7246674a7 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:16.550140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf1e58-3899-4388-be6a-ed22eec3235d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:16.551699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf1e58-3899-4388-be6a-ed22eec3235d None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:16.552157 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf1e58-3899-4388-be6a-ed22eec3235d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:16.552947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf1e58-3899-4388-be6a-ed22eec3235d None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167/users/b2b7855ba5724e86b7da7d610ca3fc58/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:16.557230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf1e58-3899-4388-be6a-ed22eec3235d None admin] RBAC: Authorizing `identity:create_grant(project_id=82a264f4d0584bc8bcd438643dbbb167, user_id=b2b7855ba5724e86b7da7d610ca3fc58, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:16.560441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf1e58-3899-4388-be6a-ed22eec3235d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:16.564117 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85544a95-12ac-4eca-aa87-2ca1a355d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:16.565160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85544a95-12ac-4eca-aa87-2ca1a355d246 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:16.565660 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85544a95-12ac-4eca-aa87-2ca1a355d246 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:16.566109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85544a95-12ac-4eca-aa87-2ca1a355d246 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:16.567290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85544a95-12ac-4eca-aa87-2ca1a355d246 None admin] RBAC: Adding query filter params (name=member) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:16.567793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85544a95-12ac-4eca-aa87-2ca1a355d246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:16.570396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85544a95-12ac-4eca-aa87-2ca1a355d246 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:16.574131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:16.589443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 69/130] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:16.589443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85544a95-12ac-4eca-aa87-2ca1a355d246 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:16.650102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 62/131] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:17:16 2022] PUT /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167/users/b2b7855ba5724e86b7da7d610ca3fc58/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:16.651135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf1e58-3899-4388-be6a-ed22eec3235d None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:16.699286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:16.783655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85544a95-12ac-4eca-aa87-2ca1a355d246 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:16.843109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf1e58-3899-4388-be6a-ed22eec3235d None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:16.892702 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646fe1c-59cd-4f3f-9242-b66dbadca2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:16.893391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646fe1c-59cd-4f3f-9242-b66dbadca2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:16.893682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646fe1c-59cd-4f3f-9242-b66dbadca2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:16.893964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646fe1c-59cd-4f3f-9242-b66dbadca2e5 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:16.901430 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646fe1c-59cd-4f3f-9242-b66dbadca2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:16.901430 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646fe1c-59cd-4f3f-9242-b66dbadca2e5 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:16.902242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 70/132] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:16 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:16.903204 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646fe1c-59cd-4f3f-9242-b66dbadca2e5 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:16.929079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b747-a1f1-4f39-918a-e87bb80ad11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:16.930183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b747-a1f1-4f39-918a-e87bb80ad11f None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:16.930624 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b747-a1f1-4f39-918a-e87bb80ad11f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:16.931062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b747-a1f1-4f39-918a-e87bb80ad11f None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167/users/997f08f01dbe4348bbce534fb3b4be8b/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:16.934876 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5b747-a1f1-4f39-918a-e87bb80ad11f None admin] RBAC: Authorizing `identity:create_grant(project_id=82a264f4d0584bc8bcd438643dbbb167, user_id=997f08f01dbe4348bbce534fb3b4be8b, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:16.936800 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5b747-a1f1-4f39-918a-e87bb80ad11f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:17.046561 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:17.082966 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 63/133] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:17:16 2022] PUT /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167/users/997f08f01dbe4348bbce534fb3b4be8b/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:17.084329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b747-a1f1-4f39-918a-e87bb80ad11f None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:17.173804 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646fe1c-59cd-4f3f-9242-b66dbadca2e5 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:17.300970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72527ecd-ee4d-4ad6-bd56-e12e930bda83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:17.302040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72527ecd-ee4d-4ad6-bd56-e12e930bda83 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:17.302468 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72527ecd-ee4d-4ad6-bd56-e12e930bda83 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:17.302931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72527ecd-ee4d-4ad6-bd56-e12e930bda83 None admin] PATH_INFO: `/v3/users/997f08f01dbe4348bbce534fb3b4be8b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:17.310732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72527ecd-ee4d-4ad6-bd56-e12e930bda83 None admin] RBAC: Authorizing `identity:get_user(user_id=997f08f01dbe4348bbce534fb3b4be8b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:17.313519 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72527ecd-ee4d-4ad6-bd56-e12e930bda83 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:17.316430 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 71/134] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:16 2022] GET /identity/v3/users/997f08f01dbe4348bbce534fb3b4be8b => generated 275 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:17.324507 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72527ecd-ee4d-4ad6-bd56-e12e930bda83 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:17.368594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:17.400259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b747-a1f1-4f39-918a-e87bb80ad11f None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:17.534617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce71d0-fe4b-4c2e-bd67-b658be1e07b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:17.536100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce71d0-fe4b-4c2e-bd67-b658be1e07b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:17.536824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce71d0-fe4b-4c2e-bd67-b658be1e07b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:17.537586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce71d0-fe4b-4c2e-bd67-b658be1e07b6 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167/users/997f08f01dbe4348bbce534fb3b4be8b/roles/5183ce055fde4522816e3cdce43ed4e9` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:17.545175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce71d0-fe4b-4c2e-bd67-b658be1e07b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=82a264f4d0584bc8bcd438643dbbb167, user_id=997f08f01dbe4348bbce534fb3b4be8b, role_id=5183ce055fde4522816e3cdce43ed4e9)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:17.548466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce71d0-fe4b-4c2e-bd67-b658be1e07b6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:17.623984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72527ecd-ee4d-4ad6-bd56-e12e930bda83 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:17.662025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 64/135] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:17:17 2022] PUT /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167/users/997f08f01dbe4348bbce534fb3b4be8b/roles/5183ce055fde4522816e3cdce43ed4e9 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:17.665236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec60e4d-bbdd-4c61-981a-5911078eb479 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:17.666131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec60e4d-bbdd-4c61-981a-5911078eb479 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:17.667262 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec60e4d-bbdd-4c61-981a-5911078eb479 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:17.670391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 65/136] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:17.680082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41a64f-558a-4449-b58b-aa81cbe86195 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:17.681103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41a64f-558a-4449-b58b-aa81cbe86195 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:17.682031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41a64f-558a-4449-b58b-aa81cbe86195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:17.727105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-5c41a64f-558a-4449-b58b-aa81cbe86195 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:17.729727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5c41a64f-558a-4449-b58b-aa81cbe86195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:17.748465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e0be6-7b7a-4b08-80b2-8bb8371290e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:17.749603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e0be6-7b7a-4b08-80b2-8bb8371290e9 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:17.750087 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e0be6-7b7a-4b08-80b2-8bb8371290e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:17.750562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e0be6-7b7a-4b08-80b2-8bb8371290e9 None admin] PATH_INFO: `/v3/projects/e11d9f96b0e84fe2870d462e51a8262b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:17.754813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e0be6-7b7a-4b08-80b2-8bb8371290e9 None admin] RBAC: Authorizing `identity:get_project(project_id=e11d9f96b0e84fe2870d462e51a8262b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:17.757555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e0be6-7b7a-4b08-80b2-8bb8371290e9 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:17.760733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 72/137] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:17 2022] GET /identity/v3/projects/e11d9f96b0e84fe2870d462e51a8262b => generated 312 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:17.774734 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e0be6-7b7a-4b08-80b2-8bb8371290e9 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:17.785651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:17.884086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 66/138] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:18.088171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e0be6-7b7a-4b08-80b2-8bb8371290e9 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:18.162782 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c2dd2-bdbc-4cce-aab3-59a1a25bc024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:18.163490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c2dd2-bdbc-4cce-aab3-59a1a25bc024 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:18.163781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c2dd2-bdbc-4cce-aab3-59a1a25bc024 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:18.164075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c2dd2-bdbc-4cce-aab3-59a1a25bc024 None admin] PATH_INFO: `/v3/projects/e11d9f96b0e84fe2870d462e51a8262b/users/997f08f01dbe4348bbce534fb3b4be8b/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:18.169868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c2dd2-bdbc-4cce-aab3-59a1a25bc024 None admin] RBAC: Authorizing `identity:create_grant(project_id=e11d9f96b0e84fe2870d462e51a8262b, user_id=997f08f01dbe4348bbce534fb3b4be8b, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:18.171470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c2dd2-bdbc-4cce-aab3-59a1a25bc024 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:18.214982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f0b6-7ada-4fed-805a-0cb48c1ee01b None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:18.215988 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f0b6-7ada-4fed-805a-0cb48c1ee01b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:18.216752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f0b6-7ada-4fed-805a-0cb48c1ee01b None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:18.219686 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 67/139] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:18.226956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07feb8-0235-4655-912c-4b7504550687 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:18.227600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07feb8-0235-4655-912c-4b7504550687 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:18.228116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07feb8-0235-4655-912c-4b7504550687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:18.253198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-2d07feb8-0235-4655-912c-4b7504550687 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:18.254924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2d07feb8-0235-4655-912c-4b7504550687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:18.295590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 73/140] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:17:17 2022] PUT /identity/v3/projects/e11d9f96b0e84fe2870d462e51a8262b/users/997f08f01dbe4348bbce534fb3b4be8b/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:17:18.347584 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c2dd2-bdbc-4cce-aab3-59a1a25bc024 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:18.355355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 68/141] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:18.458933 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:18.520171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c2dd2-bdbc-4cce-aab3-59a1a25bc024 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:18.582535 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fefc86-fcd8-44c7-af47-5fbcbe3e57f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:18.583651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fefc86-fcd8-44c7-af47-5fbcbe3e57f7 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:18.584233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fefc86-fcd8-44c7-af47-5fbcbe3e57f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:18.584711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fefc86-fcd8-44c7-af47-5fbcbe3e57f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:18.587245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fefc86-fcd8-44c7-af47-5fbcbe3e57f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:18.674201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fefc86-fcd8-44c7-af47-5fbcbe3e57f7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:18.674201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 74/142] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:17:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:18.675153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07feb8-0235-4655-912c-4b7504550687 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:18.675153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:18.763750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d07feb8-0235-4655-912c-4b7504550687 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:18.817851 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd12ab6-3937-48a1-a31e-9cab39f02d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:18.818557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd12ab6-3937-48a1-a31e-9cab39f02d33 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:18.825411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd12ab6-3937-48a1-a31e-9cab39f02d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:18.825411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd12ab6-3937-48a1-a31e-9cab39f02d33 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:18.825411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd12ab6-3937-48a1-a31e-9cab39f02d33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:18.825411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd12ab6-3937-48a1-a31e-9cab39f02d33 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:19.000218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 69/143] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:17:18 2022] POST /identity/v3/users => generated 283 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:17:19.017505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fefc86-fcd8-44c7-af47-5fbcbe3e57f7 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:19.214148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fefc86-fcd8-44c7-af47-5fbcbe3e57f7 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:19.265209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:19.283064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc9fe-251d-4d72-9725-6e3d2425c065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:19.283064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc9fe-251d-4d72-9725-6e3d2425c065 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:19.283064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc9fe-251d-4d72-9725-6e3d2425c065 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:19.283064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dc9fe-251d-4d72-9725-6e3d2425c065 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:19.292280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dc9fe-251d-4d72-9725-6e3d2425c065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-aa8dc9fe-251d-4d72-9725-6e3d2425c065 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:19.298427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:19.299635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:19.300412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 75/144] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:19.307847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd12ab6-3937-48a1-a31e-9cab39f02d33 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:19.426184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:19.474859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd12ab6-3937-48a1-a31e-9cab39f02d33 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:19.567849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed0361-df23-4adc-9a23-f0baeb21c23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:19.568836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed0361-df23-4adc-9a23-f0baeb21c23f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:19.569348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed0361-df23-4adc-9a23-f0baeb21c23f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:19.569879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed0361-df23-4adc-9a23-f0baeb21c23f None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:19.571110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed0361-df23-4adc-9a23-f0baeb21c23f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:19.571681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed0361-df23-4adc-9a23-f0baeb21c23f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:19.574987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed0361-df23-4adc-9a23-f0baeb21c23f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:19.596939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 70/145] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:19.606779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc9fe-251d-4d72-9725-6e3d2425c065 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:19.858108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dc9fe-251d-4d72-9725-6e3d2425c065 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:19.931403 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639d1c1-08b3-4b84-b94a-000dfab8abaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:19.933266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d1c1-08b3-4b84-b94a-000dfab8abaa None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:19.933825 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d1c1-08b3-4b84-b94a-000dfab8abaa None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:19.934353 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639d1c1-08b3-4b84-b94a-000dfab8abaa None admin] PATH_INFO: `/v3/users/7d52041f9db44b73a4c78593eb8ebf6c` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:19.935964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639d1c1-08b3-4b84-b94a-000dfab8abaa None admin] RBAC: Authorizing `identity:get_user(user_id=7d52041f9db44b73a4c78593eb8ebf6c)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:19.937736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639d1c1-08b3-4b84-b94a-000dfab8abaa None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:19.939817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 76/146] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:19 2022] GET /identity/v3/users/7d52041f9db44b73a4c78593eb8ebf6c => generated 289 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:19.950492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed0361-df23-4adc-9a23-f0baeb21c23f None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:20.120445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed0361-df23-4adc-9a23-f0baeb21c23f None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:20.160225 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:20.169678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31257d20-64db-4dcb-94a2-433a9e0b3c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:20.170629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31257d20-64db-4dcb-94a2-433a9e0b3c59 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:20.170922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31257d20-64db-4dcb-94a2-433a9e0b3c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:20.171302 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31257d20-64db-4dcb-94a2-433a9e0b3c59 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:20.187158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31257d20-64db-4dcb-94a2-433a9e0b3c59 None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:20.189636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31257d20-64db-4dcb-94a2-433a9e0b3c59 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:20.191815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 71/147] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:19 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:20.202111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639d1c1-08b3-4b84-b94a-000dfab8abaa None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:20.324652 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:20.338337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca66ff8-aa4d-42ee-b8fc-843086665d35 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:20.338824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca66ff8-aa4d-42ee-b8fc-843086665d35 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:20.339176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca66ff8-aa4d-42ee-b8fc-843086665d35 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:20.341201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 72/148] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:20.347573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccdf12-8405-4026-93fd-1e56904db487 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:20.347947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccdf12-8405-4026-93fd-1e56904db487 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:20.348192 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fccdf12-8405-4026-93fd-1e56904db487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:20.385189 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-4fccdf12-8405-4026-93fd-1e56904db487 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:20.387958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4fccdf12-8405-4026-93fd-1e56904db487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:20.443534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639d1c1-08b3-4b84-b94a-000dfab8abaa None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:20.528604 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05204f-33b9-4b01-8594-f6b4c205d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:20.529686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05204f-33b9-4b01-8594-f6b4c205d496 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:20.530199 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05204f-33b9-4b01-8594-f6b4c205d496 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:20.530662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05204f-33b9-4b01-8594-f6b4c205d496 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167/users/7d52041f9db44b73a4c78593eb8ebf6c/roles/e3703da52f214166b433fe3405753808` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:20.540018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05204f-33b9-4b01-8594-f6b4c205d496 None admin] RBAC: Authorizing `identity:create_grant(project_id=82a264f4d0584bc8bcd438643dbbb167, user_id=7d52041f9db44b73a4c78593eb8ebf6c, role_id=e3703da52f214166b433fe3405753808)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:20.543338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05204f-33b9-4b01-8594-f6b4c205d496 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:20.579918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 73/149] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:20.651994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 77/150] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:17:20 2022] PUT /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167/users/7d52041f9db44b73a4c78593eb8ebf6c/roles/e3703da52f214166b433fe3405753808 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:21.355346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccdf12-8405-4026-93fd-1e56904db487 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.477052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d834233-d7e6-45fe-a1c9-5727af0b3475 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.477776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d834233-d7e6-45fe-a1c9-5727af0b3475 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.478078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d834233-d7e6-45fe-a1c9-5727af0b3475 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.485050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fccdf12-8405-4026-93fd-1e56904db487 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.485950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 78/151] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:21.496150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f92f0e-eee2-4392-ae39-65f6869f5950 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.496926 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f92f0e-eee2-4392-ae39-65f6869f5950 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.497592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f92f0e-eee2-4392-ae39-65f6869f5950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.529847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:21.551888 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ad8b8-a1e4-448a-b4ed-d98aa2ddbb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.552573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ad8b8-a1e4-448a-b4ed-d98aa2ddbb1a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.552866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ad8b8-a1e4-448a-b4ed-d98aa2ddbb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.553137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ad8b8-a1e4-448a-b4ed-d98aa2ddbb1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.558094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-a1f92f0e-eee2-4392-ae39-65f6869f5950 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:21.560706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a1f92f0e-eee2-4392-ae39-65f6869f5950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:21.579721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ad8b8-a1e4-448a-b4ed-d98aa2ddbb1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-9f4ad8b8-a1e4-448a-b4ed-d98aa2ddbb1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:21.585085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:21.587035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:21.589816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 74/152] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:17:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:21.614874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ad8b8-a1e4-448a-b4ed-d98aa2ddbb1a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.789456 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 79/153] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:21.921718 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ad8b8-a1e4-448a-b4ed-d98aa2ddbb1a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.995968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a05a3-ade4-473c-9c17-ab4da2b456e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.996636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a05a3-ade4-473c-9c17-ab4da2b456e3 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.996905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a05a3-ade4-473c-9c17-ab4da2b456e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.997186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a05a3-ade4-473c-9c17-ab4da2b456e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.997923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a05a3-ade4-473c-9c17-ab4da2b456e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:21.998306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a05a3-ade4-473c-9c17-ab4da2b456e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:21.999793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a05a3-ade4-473c-9c17-ab4da2b456e3 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:22.017975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 75/154] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:22.027726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f92f0e-eee2-4392-ae39-65f6869f5950 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:22.140627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:22.272911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f92f0e-eee2-4392-ae39-65f6869f5950 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:22.350241 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccd52b-bad3-4e35-9be4-9273932d1e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:22.351294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccd52b-bad3-4e35-9be4-9273932d1e49 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:22.351799 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccd52b-bad3-4e35-9be4-9273932d1e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:22.352356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccd52b-bad3-4e35-9be4-9273932d1e49 None admin] PATH_INFO: `/v3/users/b2b7855ba5724e86b7da7d610ca3fc58` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:22.355229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccd52b-bad3-4e35-9be4-9273932d1e49 None admin] RBAC: Authorizing `identity:get_user(user_id=b2b7855ba5724e86b7da7d610ca3fc58)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:22.361597 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccd52b-bad3-4e35-9be4-9273932d1e49 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:22.364796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 80/155] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:22 2022] GET /identity/v3/users/b2b7855ba5724e86b7da7d610ca3fc58 => generated 247 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:22.374865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a05a3-ade4-473c-9c17-ab4da2b456e3 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:22.480932 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:22.500346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099260d-ca98-4e6d-b31e-89b3ac6503d6 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:22.501091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099260d-ca98-4e6d-b31e-89b3ac6503d6 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:22.501435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099260d-ca98-4e6d-b31e-89b3ac6503d6 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:22.504223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 81/156] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:17:22.512362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23800fdd-6f3d-478d-abdf-bd8518ede4e7 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:22.512851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23800fdd-6f3d-478d-abdf-bd8518ede4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:22.513326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23800fdd-6f3d-478d-abdf-bd8518ede4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:22.554668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-23800fdd-6f3d-478d-abdf-bd8518ede4e7 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:22.556228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-23800fdd-6f3d-478d-abdf-bd8518ede4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:22.641268 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a05a3-ade4-473c-9c17-ab4da2b456e3 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:22.678555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 82/157] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:22.764350 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a76c0-3fe4-4232-8d4e-b2dada543c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:22.765765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a76c0-3fe4-4232-8d4e-b2dada543c64 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:22.766436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a76c0-3fe4-4232-8d4e-b2dada543c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:22.767091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a76c0-3fe4-4232-8d4e-b2dada543c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:22.873015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23800fdd-6f3d-478d-abdf-bd8518ede4e7 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:22.935896 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a76c0-3fe4-4232-8d4e-b2dada543c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:22.939950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a76c0-3fe4-4232-8d4e-b2dada543c64 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:22.973193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:23.059245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:23.144444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23800fdd-6f3d-478d-abdf-bd8518ede4e7 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:23.171727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 76/158] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:23.175063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a70d6-0cef-473f-a093-4762bb47e005 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:23.175842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a70d6-0cef-473f-a093-4762bb47e005 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:23.182762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a70d6-0cef-473f-a093-4762bb47e005 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:23.186008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 77/159] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:23 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:23.188212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a70d6-0cef-473f-a093-4762bb47e005 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:23.238419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebfc83-5fd7-4fc9-bbd8-a2bbaf04f57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:23.239562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebfc83-5fd7-4fc9-bbd8-a2bbaf04f57d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:23.240044 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebfc83-5fd7-4fc9-bbd8-a2bbaf04f57d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:23.240536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebfc83-5fd7-4fc9-bbd8-a2bbaf04f57d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:23.258900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebfc83-5fd7-4fc9-bbd8-a2bbaf04f57d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-58ebfc83-5fd7-4fc9-bbd8-a2bbaf04f57d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:23.271733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:23.273216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 83/160] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:23.274682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50428fce-b92f-43ef-839c-0f35a4812dff None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:23.276557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50428fce-b92f-43ef-839c-0f35a4812dff None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:23.276557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50428fce-b92f-43ef-839c-0f35a4812dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:23.325538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-50428fce-b92f-43ef-839c-0f35a4812dff None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:23.327308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-50428fce-b92f-43ef-839c-0f35a4812dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:23.392395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a70d6-0cef-473f-a093-4762bb47e005 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:23.483910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b15b3-5cb6-48b2-8ecb-ce938b0a0c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:23.484473 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b15b3-5cb6-48b2-8ecb-ce938b0a0c23 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:23.484758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b15b3-5cb6-48b2-8ecb-ce938b0a0c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:23.485034 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b15b3-5cb6-48b2-8ecb-ce938b0a0c23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:23.487338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 84/161] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:23.488651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50428fce-b92f-43ef-839c-0f35a4812dff None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:23.512365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b15b3-5cb6-48b2-8ecb-ce938b0a0c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-e67b15b3-5cb6-48b2-8ecb-ce938b0a0c23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:23.517673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:23.519459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 78/162] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:23.522136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b15b3-5cb6-48b2-8ecb-ce938b0a0c23 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:23.554057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:23.607073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:23.824498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50428fce-b92f-43ef-839c-0f35a4812dff None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:23.849459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b15b3-5cb6-48b2-8ecb-ce938b0a0c23 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:23.944731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaa1f6-9020-46cf-99be-8710848d3795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:23.945402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaa1f6-9020-46cf-99be-8710848d3795 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:23.945698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaa1f6-9020-46cf-99be-8710848d3795 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:23.945973 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaa1f6-9020-46cf-99be-8710848d3795 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:23.949253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaa1f6-9020-46cf-99be-8710848d3795 None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:23.950812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaa1f6-9020-46cf-99be-8710848d3795 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:23.952795 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 85/163] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:23 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:23.953424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaa1f6-9020-46cf-99be-8710848d3795 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:23.988010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668c869-a6cc-40a1-9f70-30c4e7885002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:23.989632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668c869-a6cc-40a1-9f70-30c4e7885002 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:23.989632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668c869-a6cc-40a1-9f70-30c4e7885002 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:23.990063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668c869-a6cc-40a1-9f70-30c4e7885002 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:23.991320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668c869-a6cc-40a1-9f70-30c4e7885002 None admin] RBAC: Adding query filter params (name=member) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:23.991987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668c869-a6cc-40a1-9f70-30c4e7885002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:24.000192 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668c869-a6cc-40a1-9f70-30c4e7885002 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:24.022181 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 79/164] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:24.023871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668c869-a6cc-40a1-9f70-30c4e7885002 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:24.201840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:24.277989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668c869-a6cc-40a1-9f70-30c4e7885002 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:24.347392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c303432-dc7a-450e-953d-9b07a3511512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:24.348505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c303432-dc7a-450e-953d-9b07a3511512 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.348998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c303432-dc7a-450e-953d-9b07a3511512 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.349510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c303432-dc7a-450e-953d-9b07a3511512 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.372453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c303432-dc7a-450e-953d-9b07a3511512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-5c303432-dc7a-450e-953d-9b07a3511512 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:24.383472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:24.384503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:24.386323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:24.386323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:24.386323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:24.386323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:24.386323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:24.386323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:24.386323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:24.386323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:24.386323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:24.386323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:24.386323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:24.386323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:24.387011 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaa1f6-9020-46cf-99be-8710848d3795 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:24.387097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 80/165] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:17:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:24.387671 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c303432-dc7a-450e-953d-9b07a3511512 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:24.394384 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:24.562712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa910-6210-47c5-9748-bfc60a85308d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:24.563683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa910-6210-47c5-9748-bfc60a85308d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.564175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa910-6210-47c5-9748-bfc60a85308d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.564654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aaa910-6210-47c5-9748-bfc60a85308d None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.565967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaa910-6210-47c5-9748-bfc60a85308d None admin] RBAC: Adding query filter params (name=member) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:24.566503 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaa910-6210-47c5-9748-bfc60a85308d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:24.569199 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aaa910-6210-47c5-9748-bfc60a85308d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:24.602792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c303432-dc7a-450e-953d-9b07a3511512 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:24.605626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 86/166] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 652 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:24.607246 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa910-6210-47c5-9748-bfc60a85308d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:24.709860 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:24.725798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b9bbb-1918-4378-a7ba-b5e26aea3c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:24.728369 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b9bbb-1918-4378-a7ba-b5e26aea3c90 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.729057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b9bbb-1918-4378-a7ba-b5e26aea3c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.729601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b9bbb-1918-4378-a7ba-b5e26aea3c90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.731014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b9bbb-1918-4378-a7ba-b5e26aea3c90 None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=82a264f4d0584bc8bcd438643dbbb167, user.id=b2b7855ba5724e86b7da7d610ca3fc58) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:24.731569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b9bbb-1918-4378-a7ba-b5e26aea3c90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:24.734424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b9bbb-1918-4378-a7ba-b5e26aea3c90 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:24.766213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 81/167] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:24 2022] GET /identity/v3/role_assignments?user.id=b2b7855ba5724e86b7da7d610ca3fc58&scope.project.id=82a264f4d0584bc8bcd438643dbbb167&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 608 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:24.768578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a26f51-cd97-4bb6-84e1-045aa6fdd315 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.769083 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a26f51-cd97-4bb6-84e1-045aa6fdd315 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.776713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a26f51-cd97-4bb6-84e1-045aa6fdd315 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.779424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 82/168] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:24 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:24.780895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a26f51-cd97-4bb6-84e1-045aa6fdd315 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:25.002547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aaa910-6210-47c5-9748-bfc60a85308d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:25.096689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb36bb-67e1-42e0-9c53-88b71e4f25ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:25.098085 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb36bb-67e1-42e0-9c53-88b71e4f25ba None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.099090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb36bb-67e1-42e0-9c53-88b71e4f25ba None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.099934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb36bb-67e1-42e0-9c53-88b71e4f25ba None admin] PATH_INFO: `/v3/users/997f08f01dbe4348bbce534fb3b4be8b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.102231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb36bb-67e1-42e0-9c53-88b71e4f25ba None admin] RBAC: Authorizing `identity:get_user(user_id=997f08f01dbe4348bbce534fb3b4be8b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:25.102790 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a26f51-cd97-4bb6-84e1-045aa6fdd315 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:25.106443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb36bb-67e1-42e0-9c53-88b71e4f25ba None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:25.111307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 87/169] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:24 2022] GET /identity/v3/users/997f08f01dbe4348bbce534fb3b4be8b => generated 275 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:25.112599 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb36bb-67e1-42e0-9c53-88b71e4f25ba None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:25.166434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:25.181068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f124b9-2d65-46b8-a030-60458963e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:25.183100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f124b9-2d65-46b8-a030-60458963e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.183100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f124b9-2d65-46b8-a030-60458963e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.183100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f124b9-2d65-46b8-a030-60458963e9d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.195934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f124b9-2d65-46b8-a030-60458963e9d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:25.195934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f124b9-2d65-46b8-a030-60458963e9d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:25.195934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f124b9-2d65-46b8-a030-60458963e9d6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:25.200918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 83/170] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:17:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:25.206750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16f9a2-8f8b-4aa8-b61e-479c8ffdcb84 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.206750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16f9a2-8f8b-4aa8-b61e-479c8ffdcb84 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.206750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16f9a2-8f8b-4aa8-b61e-479c8ffdcb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.229908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-5c16f9a2-8f8b-4aa8-b61e-479c8ffdcb84 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:25.231351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5c16f9a2-8f8b-4aa8-b61e-479c8ffdcb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:25.286692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb36bb-67e1-42e0-9c53-88b71e4f25ba None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:25.310883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:25.327418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 84/171] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:25.328754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105f635-9750-47c7-827f-ed65b4c088be None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.329039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105f635-9750-47c7-827f-ed65b4c088be None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.329314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105f635-9750-47c7-827f-ed65b4c088be None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.330767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 85/172] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:25.331925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fef31-72c5-423b-874d-e770a8835b47 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.332201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fef31-72c5-423b-874d-e770a8835b47 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.332441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fef31-72c5-423b-874d-e770a8835b47 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.334013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 86/173] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:25.339124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fef31-72c5-423b-874d-e770a8835b47 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:25.343950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8648d-7c33-4c36-94dd-92b1b1a34f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:25.345088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8648d-7c33-4c36-94dd-92b1b1a34f64 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.345719 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8648d-7c33-4c36-94dd-92b1b1a34f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.346161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8648d-7c33-4c36-94dd-92b1b1a34f64 None admin] PATH_INFO: `/v3/users/997f08f01dbe4348bbce534fb3b4be8b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.348527 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8648d-7c33-4c36-94dd-92b1b1a34f64 None admin] RBAC: Authorizing `identity:get_user(user_id=997f08f01dbe4348bbce534fb3b4be8b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:25.351490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8648d-7c33-4c36-94dd-92b1b1a34f64 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:25.355411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 88/174] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:25 2022] GET /identity/v3/users/997f08f01dbe4348bbce534fb3b4be8b => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:25.358049 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfce20-8fb4-48ae-82c7-acdae16d8d75 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.358559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfce20-8fb4-48ae-82c7-acdae16d8d75 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.359057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfce20-8fb4-48ae-82c7-acdae16d8d75 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.361984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 89/175] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:25.363276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfce20-8fb4-48ae-82c7-acdae16d8d75 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:25.507066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fef31-72c5-423b-874d-e770a8835b47 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:25.559283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baef09-8dd5-4b70-877d-532d6ee2c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:25.560281 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baef09-8dd5-4b70-877d-532d6ee2c393 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.560719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baef09-8dd5-4b70-877d-532d6ee2c393 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.561009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baef09-8dd5-4b70-877d-532d6ee2c393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.578899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfce20-8fb4-48ae-82c7-acdae16d8d75 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:25.582275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:25.639472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:25.646718 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c539f-a7e7-4e12-b7d6-f2c3deca288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:25.647951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c539f-a7e7-4e12-b7d6-f2c3deca288b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.648665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c539f-a7e7-4e12-b7d6-f2c3deca288b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.649347 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c539f-a7e7-4e12-b7d6-f2c3deca288b None admin] PATH_INFO: `/v3/users/997f08f01dbe4348bbce534fb3b4be8b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.653499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c539f-a7e7-4e12-b7d6-f2c3deca288b None admin] RBAC: Authorizing `identity:get_user(user_id=997f08f01dbe4348bbce534fb3b4be8b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:25.656231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c539f-a7e7-4e12-b7d6-f2c3deca288b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:25.658692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baef09-8dd5-4b70-877d-532d6ee2c393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:25.664321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 90/176] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:25 2022] GET /identity/v3/users/997f08f01dbe4348bbce534fb3b4be8b => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:25.664515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baef09-8dd5-4b70-877d-532d6ee2c393 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:25.664633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7c046-e712-4d6a-a705-fe1c38eb777a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.664633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7c046-e712-4d6a-a705-fe1c38eb777a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.664633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7c046-e712-4d6a-a705-fe1c38eb777a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.694986 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c3a7c046-e712-4d6a-a705-fe1c38eb777a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:25.697286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c3a7c046-e712-4d6a-a705-fe1c38eb777a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:25.809447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 87/177] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:25.809447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcac5f1-81be-4e37-be28-090480ad2ed8 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.809447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcac5f1-81be-4e37-be28-090480ad2ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.809447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcac5f1-81be-4e37-be28-090480ad2ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.834318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-9fcac5f1-81be-4e37-be28-090480ad2ed8 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:25.835619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9fcac5f1-81be-4e37-be28-090480ad2ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:25.841357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 91/178] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:25.843072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7c046-e712-4d6a-a705-fe1c38eb777a None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:25.954942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 88/179] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:25.967799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54513b-8fde-4b54-9b27-f0cd18ab3c0c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.968389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54513b-8fde-4b54-9b27-f0cd18ab3c0c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.968974 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54513b-8fde-4b54-9b27-f0cd18ab3c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.009685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-3e54513b-8fde-4b54-9b27-f0cd18ab3c0c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:26.011907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3e54513b-8fde-4b54-9b27-f0cd18ab3c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:26.046483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:26.052675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:26.058455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7c046-e712-4d6a-a705-fe1c38eb777a None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.110198 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdb666-b44d-4ce7-ad15-461ec7811d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.111537 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdb666-b44d-4ce7-ad15-461ec7811d3d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.111971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdb666-b44d-4ce7-ad15-461ec7811d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.112710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdb666-b44d-4ce7-ad15-461ec7811d3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.159875 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 89/180] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:26.161145 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54513b-8fde-4b54-9b27-f0cd18ab3c0c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.285023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdb666-b44d-4ce7-ad15-461ec7811d3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.286802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdb666-b44d-4ce7-ad15-461ec7811d3d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.302022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54513b-8fde-4b54-9b27-f0cd18ab3c0c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.344595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89502852-2826-4175-a124-85351331a695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.345242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89502852-2826-4175-a124-85351331a695 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.345609 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89502852-2826-4175-a124-85351331a695 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.345914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89502852-2826-4175-a124-85351331a695 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.372185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:26.418875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:26.423130 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 92/181] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:26.424150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdb666-b44d-4ce7-ad15-461ec7811d3d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.445089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89502852-2826-4175-a124-85351331a695 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.446857 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89502852-2826-4175-a124-85351331a695 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.563157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdb666-b44d-4ce7-ad15-461ec7811d3d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.589357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 90/182] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:26.595962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89502852-2826-4175-a124-85351331a695 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.611271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fbf90-928c-4082-87d5-a36997f17df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.611925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fbf90-928c-4082-87d5-a36997f17df8 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.612203 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fbf90-928c-4082-87d5-a36997f17df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.612477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fbf90-928c-4082-87d5-a36997f17df8 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.613876 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fbf90-928c-4082-87d5-a36997f17df8 None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.615427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fbf90-928c-4082-87d5-a36997f17df8 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.617748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 93/183] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:26 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:26.618252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fbf90-928c-4082-87d5-a36997f17df8 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.659745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:26.699793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:26.723612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89502852-2826-4175-a124-85351331a695 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.742080 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fbf90-928c-4082-87d5-a36997f17df8 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.765347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f33aa-2e26-4665-83b9-0a0e1a041286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.766047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f33aa-2e26-4665-83b9-0a0e1a041286 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.766327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f33aa-2e26-4665-83b9-0a0e1a041286 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.766616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f33aa-2e26-4665-83b9-0a0e1a041286 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.779576 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f33aa-2e26-4665-83b9-0a0e1a041286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-003f33aa-2e26-4665-83b9-0a0e1a041286 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:26.785218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:26.786962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 91/184] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:17:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:26.788375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f33aa-2e26-4665-83b9-0a0e1a041286 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.800244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d599b-aff2-4699-851b-3ce72a3a5350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.801168 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d599b-aff2-4699-851b-3ce72a3a5350 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.801649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d599b-aff2-4699-851b-3ce72a3a5350 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.801978 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d599b-aff2-4699-851b-3ce72a3a5350 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.803331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d599b-aff2-4699-851b-3ce72a3a5350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.805107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d599b-aff2-4699-851b-3ce72a3a5350 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.807633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 94/185] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:17:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:26.808893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d599b-aff2-4699-851b-3ce72a3a5350 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.943937 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f33aa-2e26-4665-83b9-0a0e1a041286 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.956907 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d599b-aff2-4699-851b-3ce72a3a5350 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.014935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d3e30-87eb-4028-9b1e-be4d52814215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.014935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3e30-87eb-4028-9b1e-be4d52814215 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.014935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3e30-87eb-4028-9b1e-be4d52814215 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.014935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d3e30-87eb-4028-9b1e-be4d52814215 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.015303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d3e30-87eb-4028-9b1e-be4d52814215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:27.015391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070da2b-6155-49af-b31b-ab63ca530f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.015391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070da2b-6155-49af-b31b-ab63ca530f83 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-dc7d3e30-87eb-4028-9b1e-be4d52814215 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:27.015533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:27.016348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:27.017175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:27.017175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:27.017175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:27.017175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:27.017175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:27.017175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:27.017175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:27.017175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:27.017175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:27.017175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:27.017175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:27.017175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:27.017884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070da2b-6155-49af-b31b-ab63ca530f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.017884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070da2b-6155-49af-b31b-ab63ca530f83 None admin] PATH_INFO: `/v3/projects/e11d9f96b0e84fe2870d462e51a8262b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.018023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 92/186] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:27.018090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070da2b-6155-49af-b31b-ab63ca530f83 None admin] RBAC: Authorizing `identity:get_project(project_id=e11d9f96b0e84fe2870d462e51a8262b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.018157 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d3e30-87eb-4028-9b1e-be4d52814215 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.018223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070da2b-6155-49af-b31b-ab63ca530f83 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.018223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 95/187] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:26 2022] GET /identity/v3/projects/e11d9f96b0e84fe2870d462e51a8262b => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:27.018223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070da2b-6155-49af-b31b-ab63ca530f83 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.055162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:27.117534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070da2b-6155-49af-b31b-ab63ca530f83 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.123119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:27.123829 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d3e30-87eb-4028-9b1e-be4d52814215 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.162517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f02c6e-2dab-408b-b6bf-08351af4ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.163179 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02c6e-2dab-408b-b6bf-08351af4ea7b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.163467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02c6e-2dab-408b-b6bf-08351af4ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.163740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f02c6e-2dab-408b-b6bf-08351af4ea7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.165642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4484c-2f26-49a2-ba55-255573628782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.166371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4484c-2f26-49a2-ba55-255573628782 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.166652 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4484c-2f26-49a2-ba55-255573628782 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.166944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4484c-2f26-49a2-ba55-255573628782 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.168291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4484c-2f26-49a2-ba55-255573628782 None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.169859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4484c-2f26-49a2-ba55-255573628782 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.171611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 96/188] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:27 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:27.172423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4484c-2f26-49a2-ba55-255573628782 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.181928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f02c6e-2dab-408b-b6bf-08351af4ea7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-38f02c6e-2dab-408b-b6bf-08351af4ea7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:27.187952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:27.189898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 93/189] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:17:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:27.191571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f02c6e-2dab-408b-b6bf-08351af4ea7b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.232182 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:27.307570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4484c-2f26-49a2-ba55-255573628782 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.328730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f02c6e-2dab-408b-b6bf-08351af4ea7b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.354212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f797d-9d74-4f77-ba9d-94bf8c52f810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.354880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f797d-9d74-4f77-ba9d-94bf8c52f810 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.355360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f797d-9d74-4f77-ba9d-94bf8c52f810 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.355685 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f797d-9d74-4f77-ba9d-94bf8c52f810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.358822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f797d-9d74-4f77-ba9d-94bf8c52f810 None admin] RBAC: Adding query filter params (role.id=d27b7d5ab3274b85a416d9f8f7f75648, scope.project.id=82a264f4d0584bc8bcd438643dbbb167, user.id=997f08f01dbe4348bbce534fb3b4be8b) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:27.359180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f797d-9d74-4f77-ba9d-94bf8c52f810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.360739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f797d-9d74-4f77-ba9d-94bf8c52f810 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.369663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 97/190] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:27 2022] GET /identity/v3/role_assignments?user.id=997f08f01dbe4348bbce534fb3b4be8b&scope.project.id=82a264f4d0584bc8bcd438643dbbb167&role.id=d27b7d5ab3274b85a416d9f8f7f75648 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:27.371217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f797d-9d74-4f77-ba9d-94bf8c52f810 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.382199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f842c-adf0-4d18-b0b0-4d6fa9f4aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.382838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f842c-adf0-4d18-b0b0-4d6fa9f4aacc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.383118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f842c-adf0-4d18-b0b0-4d6fa9f4aacc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.383391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f842c-adf0-4d18-b0b0-4d6fa9f4aacc None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.384106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f842c-adf0-4d18-b0b0-4d6fa9f4aacc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:27.384386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f842c-adf0-4d18-b0b0-4d6fa9f4aacc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.386493 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f842c-adf0-4d18-b0b0-4d6fa9f4aacc None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.396613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 94/191] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:27.397432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f842c-adf0-4d18-b0b0-4d6fa9f4aacc None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.513043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f797d-9d74-4f77-ba9d-94bf8c52f810 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.532755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f842c-adf0-4d18-b0b0-4d6fa9f4aacc None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.555194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe04b5c-6613-4932-9e4b-d444868a9ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.555819 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe04b5c-6613-4932-9e4b-d444868a9ed6 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.556097 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe04b5c-6613-4932-9e4b-d444868a9ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.556375 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe04b5c-6613-4932-9e4b-d444868a9ed6 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.557860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe04b5c-6613-4932-9e4b-d444868a9ed6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.559384 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe04b5c-6613-4932-9e4b-d444868a9ed6 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.585932 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f69a8-5338-406d-92c1-bfe81ee75f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.586972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f69a8-5338-406d-92c1-bfe81ee75f84 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.587489 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f69a8-5338-406d-92c1-bfe81ee75f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.587882 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f69a8-5338-406d-92c1-bfe81ee75f84 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.589210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f69a8-5338-406d-92c1-bfe81ee75f84 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:27.589760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f69a8-5338-406d-92c1-bfe81ee75f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.592114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f69a8-5338-406d-92c1-bfe81ee75f84 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.605312 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 95/192] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:27.606382 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f69a8-5338-406d-92c1-bfe81ee75f84 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.658157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:27.726508 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f69a8-5338-406d-92c1-bfe81ee75f84 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.747510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:27.766742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46becbdf-a15e-4a6d-9333-5ef9d2c29585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.769121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46becbdf-a15e-4a6d-9333-5ef9d2c29585 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.769121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46becbdf-a15e-4a6d-9333-5ef9d2c29585 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.769121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46becbdf-a15e-4a6d-9333-5ef9d2c29585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.769121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46becbdf-a15e-4a6d-9333-5ef9d2c29585 None admin] RBAC: Adding query filter params (role.id=d27b7d5ab3274b85a416d9f8f7f75648, scope.project.id=e11d9f96b0e84fe2870d462e51a8262b, user.id=997f08f01dbe4348bbce534fb3b4be8b) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:27.769121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46becbdf-a15e-4a6d-9333-5ef9d2c29585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.770613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46becbdf-a15e-4a6d-9333-5ef9d2c29585 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.783060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 96/193] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:27 2022] GET /identity/v3/role_assignments?user.id=997f08f01dbe4348bbce534fb3b4be8b&scope.project.id=e11d9f96b0e84fe2870d462e51a8262b&role.id=d27b7d5ab3274b85a416d9f8f7f75648 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:27.783981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46becbdf-a15e-4a6d-9333-5ef9d2c29585 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.816672 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:27.902263 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 98/194] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:17:27 2022] POST /identity/v3/users => generated 297 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:27.903326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe04b5c-6613-4932-9e4b-d444868a9ed6 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.984499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46becbdf-a15e-4a6d-9333-5ef9d2c29585 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:28.005431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:28.079703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87e477-521b-4a1d-be7e-f84e0ab084df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:28.081432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87e477-521b-4a1d-be7e-f84e0ab084df None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:28.082601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87e477-521b-4a1d-be7e-f84e0ab084df None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:28.083071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87e477-521b-4a1d-be7e-f84e0ab084df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:28.084918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87e477-521b-4a1d-be7e-f84e0ab084df None admin] RBAC: Adding query filter params (role.id=5183ce055fde4522816e3cdce43ed4e9, scope.project.id=82a264f4d0584bc8bcd438643dbbb167, user.id=997f08f01dbe4348bbce534fb3b4be8b) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:28.085843 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87e477-521b-4a1d-be7e-f84e0ab084df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:28.092391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87e477-521b-4a1d-be7e-f84e0ab084df None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:28.099639 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe04b5c-6613-4932-9e4b-d444868a9ed6 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:28.104290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 97/195] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:27 2022] GET /identity/v3/role_assignments?user.id=997f08f01dbe4348bbce534fb3b4be8b&scope.project.id=82a264f4d0584bc8bcd438643dbbb167&role.id=5183ce055fde4522816e3cdce43ed4e9 => generated 608 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:28.122427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87e477-521b-4a1d-be7e-f84e0ab084df None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:28.148004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a52e0f-f98e-41a1-8af0-e024190fbfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:28.148661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a52e0f-f98e-41a1-8af0-e024190fbfcc None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:28.148951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a52e0f-f98e-41a1-8af0-e024190fbfcc None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:28.149241 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a52e0f-f98e-41a1-8af0-e024190fbfcc None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:28.149957 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a52e0f-f98e-41a1-8af0-e024190fbfcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:28.150259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a52e0f-f98e-41a1-8af0-e024190fbfcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:28.151871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a52e0f-f98e-41a1-8af0-e024190fbfcc None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:28.179739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 99/196] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:17:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:28.182493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a52e0f-f98e-41a1-8af0-e024190fbfcc None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:28.295276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:28.313490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:28.334975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87e477-521b-4a1d-be7e-f84e0ab084df None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:28.394578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e70f7-4e89-4810-9db0-b6dc157e588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:28.395647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e70f7-4e89-4810-9db0-b6dc157e588b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:28.396239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e70f7-4e89-4810-9db0-b6dc157e588b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:28.396817 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e70f7-4e89-4810-9db0-b6dc157e588b None admin] PATH_INFO: `/v3/users/7d8ee9878fc7449f83aa009f2c136102` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:28.397491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a52e0f-f98e-41a1-8af0-e024190fbfcc None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:28.417031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e70f7-4e89-4810-9db0-b6dc157e588b None admin] RBAC: Authorizing `identity:get_user(user_id=7d8ee9878fc7449f83aa009f2c136102)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:28.419128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e70f7-4e89-4810-9db0-b6dc157e588b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:28.421894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 98/197] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:28 2022] GET /identity/v3/users/7d8ee9878fc7449f83aa009f2c136102 => generated 283 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:28.423055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e70f7-4e89-4810-9db0-b6dc157e588b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:28.483918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c35e1-1753-4ddd-ab70-1ade40f39c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:28.485114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c35e1-1753-4ddd-ab70-1ade40f39c4d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:28.485625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c35e1-1753-4ddd-ab70-1ade40f39c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:28.486057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c35e1-1753-4ddd-ab70-1ade40f39c4d None admin] PATH_INFO: `/v3/users/7d52041f9db44b73a4c78593eb8ebf6c` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:28.488431 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c35e1-1753-4ddd-ab70-1ade40f39c4d None admin] RBAC: Authorizing `identity:get_user(user_id=7d52041f9db44b73a4c78593eb8ebf6c)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:28.492808 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c35e1-1753-4ddd-ab70-1ade40f39c4d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:28.497509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 100/198] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:28 2022] GET /identity/v3/users/7d52041f9db44b73a4c78593eb8ebf6c => generated 289 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:28.505662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c35e1-1753-4ddd-ab70-1ade40f39c4d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:28.628476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e70f7-4e89-4810-9db0-b6dc157e588b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:28.709133 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c724ce0-a215-4fc6-a17d-bf10ac036581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:28.710328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c724ce0-a215-4fc6-a17d-bf10ac036581 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:28.710826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c724ce0-a215-4fc6-a17d-bf10ac036581 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:28.711581 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c724ce0-a215-4fc6-a17d-bf10ac036581 None admin] PATH_INFO: `/v3/users/7d8ee9878fc7449f83aa009f2c136102` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:28.713978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c724ce0-a215-4fc6-a17d-bf10ac036581 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8ee9878fc7449f83aa009f2c136102)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:28.717154 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c724ce0-a215-4fc6-a17d-bf10ac036581 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:28.720375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 99/199] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:28 2022] GET /identity/v3/users/7d8ee9878fc7449f83aa009f2c136102 => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:28.722042 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c724ce0-a215-4fc6-a17d-bf10ac036581 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:28.742227 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:28.751649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c35e1-1753-4ddd-ab70-1ade40f39c4d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:28.802003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:28.820858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214284-d023-4415-b475-a1cd07b86669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:28.821942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214284-d023-4415-b475-a1cd07b86669 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:28.823151 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214284-d023-4415-b475-a1cd07b86669 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:28.823491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b214284-d023-4415-b475-a1cd07b86669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:28.879857 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c724ce0-a215-4fc6-a17d-bf10ac036581 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:28.941594 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b214284-d023-4415-b475-a1cd07b86669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:28.943484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b214284-d023-4415-b475-a1cd07b86669 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:28.948525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b982-125a-4551-8763-951bea8373ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:28.949914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b982-125a-4551-8763-951bea8373ee None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:28.950504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b982-125a-4551-8763-951bea8373ee None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:28.951047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b982-125a-4551-8763-951bea8373ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:29.080419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 101/200] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:29.081752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214284-d023-4415-b475-a1cd07b86669 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:29.085209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b982-125a-4551-8763-951bea8373ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:29.088207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b982-125a-4551-8763-951bea8373ee None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:29.100465 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:29.120849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:29.242723 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 100/201] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:29.243889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b982-125a-4551-8763-951bea8373ee None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:29.260119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b214284-d023-4415-b475-a1cd07b86669 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:29.334781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f46c1c-cc18-4fd7-b8f3-71a116cc2e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:29.336524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f46c1c-cc18-4fd7-b8f3-71a116cc2e63 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:29.337302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f46c1c-cc18-4fd7-b8f3-71a116cc2e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:29.339591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f46c1c-cc18-4fd7-b8f3-71a116cc2e63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:29.390705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b982-125a-4551-8763-951bea8373ee None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:29.404684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:29.444255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f1349-f93d-4c33-a41a-5b73302741b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:29.444894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f1349-f93d-4c33-a41a-5b73302741b8 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:29.445177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f1349-f93d-4c33-a41a-5b73302741b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:29.445532 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f1349-f93d-4c33-a41a-5b73302741b8 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:29.446779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f1349-f93d-4c33-a41a-5b73302741b8 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:29.449089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f1349-f93d-4c33-a41a-5b73302741b8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:29.450895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 101/202] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:29 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:29.451739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f1349-f93d-4c33-a41a-5b73302741b8 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:29.495827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f46c1c-cc18-4fd7-b8f3-71a116cc2e63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:29.499269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f46c1c-cc18-4fd7-b8f3-71a116cc2e63 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:29.549284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:29.647366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f1349-f93d-4c33-a41a-5b73302741b8 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:29.672344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 102/203] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:29.673636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f46c1c-cc18-4fd7-b8f3-71a116cc2e63 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:29.730853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620445e-4cac-4a77-b39a-29e0caed1558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:29.732621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620445e-4cac-4a77-b39a-29e0caed1558 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:29.733403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620445e-4cac-4a77-b39a-29e0caed1558 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:29.734183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620445e-4cac-4a77-b39a-29e0caed1558 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:29.736833 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620445e-4cac-4a77-b39a-29e0caed1558 None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:29.740251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620445e-4cac-4a77-b39a-29e0caed1558 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:29.743972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 102/204] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:29 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:29.748022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620445e-4cac-4a77-b39a-29e0caed1558 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:29.821679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f46c1c-cc18-4fd7-b8f3-71a116cc2e63 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:29.852453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:29.862521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:29.879789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e8328-348b-4712-84a0-aaa41a868fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:29.880534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e8328-348b-4712-84a0-aaa41a868fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:29.880845 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e8328-348b-4712-84a0-aaa41a868fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:29.881099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e8328-348b-4712-84a0-aaa41a868fb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:29.881884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e8328-348b-4712-84a0-aaa41a868fb4 None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=f1f639a220c6483b9d682cc431b14298, user.id=7d8ee9878fc7449f83aa009f2c136102) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:29.882191 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e8328-348b-4712-84a0-aaa41a868fb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:29.884911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e8328-348b-4712-84a0-aaa41a868fb4 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:29.892814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 103/205] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:29 2022] GET /identity/v3/role_assignments?user.id=7d8ee9878fc7449f83aa009f2c136102&scope.project.id=f1f639a220c6483b9d682cc431b14298&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:29.893203 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e8328-348b-4712-84a0-aaa41a868fb4 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:30.000199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620445e-4cac-4a77-b39a-29e0caed1558 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:30.077219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08206a-608e-48fd-bab8-17b5e847d395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:30.077933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08206a-608e-48fd-bab8-17b5e847d395 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:30.078222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08206a-608e-48fd-bab8-17b5e847d395 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:30.078501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08206a-608e-48fd-bab8-17b5e847d395 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:30.082023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08206a-608e-48fd-bab8-17b5e847d395 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:30.083616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08206a-608e-48fd-bab8-17b5e847d395 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:30.085580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 103/206] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:29 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:30.095058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08206a-608e-48fd-bab8-17b5e847d395 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:30.213768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e8328-348b-4712-84a0-aaa41a868fb4 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:30.333739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08206a-608e-48fd-bab8-17b5e847d395 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:30.356121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c6bee-e5bb-4fa1-88a4-c25c41065ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:30.356757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c6bee-e5bb-4fa1-88a4-c25c41065ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:30.357041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c6bee-e5bb-4fa1-88a4-c25c41065ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:30.357318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c6bee-e5bb-4fa1-88a4-c25c41065ef1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:30.358108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c6bee-e5bb-4fa1-88a4-c25c41065ef1 None admin] RBAC: Adding query filter params (role.id=e3703da52f214166b433fe3405753808, scope.project.id=82a264f4d0584bc8bcd438643dbbb167, user.id=7d52041f9db44b73a4c78593eb8ebf6c) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:30.358422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c6bee-e5bb-4fa1-88a4-c25c41065ef1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:30.359956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c6bee-e5bb-4fa1-88a4-c25c41065ef1 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:30.373982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:30.374450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 104/207] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:29 2022] GET /identity/v3/role_assignments?user.id=7d52041f9db44b73a4c78593eb8ebf6c&scope.project.id=82a264f4d0584bc8bcd438643dbbb167&role.id=e3703da52f214166b433fe3405753808 => generated 608 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:30.412432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cf4dd-39c4-4b37-9353-8586bd7ceda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:30.413076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cf4dd-39c4-4b37-9353-8586bd7ceda3 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:30.413360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cf4dd-39c4-4b37-9353-8586bd7ceda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:30.413661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cf4dd-39c4-4b37-9353-8586bd7ceda3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:30.414505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cf4dd-39c4-4b37-9353-8586bd7ceda3 None admin] RBAC: Adding query filter params (role.id=5183ce055fde4522816e3cdce43ed4e9, scope.project.id=f1f639a220c6483b9d682cc431b14298, user.id=7d8ee9878fc7449f83aa009f2c136102) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:30.414820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cf4dd-39c4-4b37-9353-8586bd7ceda3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:30.417330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629cf4dd-39c4-4b37-9353-8586bd7ceda3 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:30.429882 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 104/208] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:30 2022] GET /identity/v3/role_assignments?user.id=7d8ee9878fc7449f83aa009f2c136102&scope.project.id=f1f639a220c6483b9d682cc431b14298&role.id=5183ce055fde4522816e3cdce43ed4e9 => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:31.082573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8c2dd-4442-414b-a00a-c5c12d6cf477 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:31.083075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8c2dd-4442-414b-a00a-c5c12d6cf477 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:31.083075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8c2dd-4442-414b-a00a-c5c12d6cf477 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:31.084712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 105/209] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:31.091779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8e1f1-caef-4c80-909b-d5aef50f1951 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:31.092548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8e1f1-caef-4c80-909b-d5aef50f1951 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:31.092548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8e1f1-caef-4c80-909b-d5aef50f1951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:31.115390 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ffb8e1f1-caef-4c80-909b-d5aef50f1951 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:31.116634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ffb8e1f1-caef-4c80-909b-d5aef50f1951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:31.223477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 105/210] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:31.285704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e4f2c-00e6-4958-9c22-4a385e4203a5 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:31.286064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e4f2c-00e6-4958-9c22-4a385e4203a5 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:31.286272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e4f2c-00e6-4958-9c22-4a385e4203a5 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:31.287897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 106/211] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:31.295054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f5a7-8881-42b1-a4dc-9a5ab41d501c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:31.295386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f5a7-8881-42b1-a4dc-9a5ab41d501c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:31.295626 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f5a7-8881-42b1-a4dc-9a5ab41d501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:31.324692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-9de3f5a7-8881-42b1-a4dc-9a5ab41d501c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:31.327113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9de3f5a7-8881-42b1-a4dc-9a5ab41d501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:31.473413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 106/212] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:31.533266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e4f2c-00e6-4958-9c22-4a385e4203a5 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:31.603988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:31.675037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e4f2c-00e6-4958-9c22-4a385e4203a5 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:31.717937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b068186-ba6e-41fd-b62a-caa4fcda75fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:31.718589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b068186-ba6e-41fd-b62a-caa4fcda75fe None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:31.718872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b068186-ba6e-41fd-b62a-caa4fcda75fe None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:31.719148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b068186-ba6e-41fd-b62a-caa4fcda75fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:31.733227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b068186-ba6e-41fd-b62a-caa4fcda75fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-9b068186-ba6e-41fd-b62a-caa4fcda75fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:31.738896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:31.739911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:31.740740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 107/213] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:31.748767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3f5a7-8881-42b1-a4dc-9a5ab41d501c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:31.794098 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:31.796891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b068186-ba6e-41fd-b62a-caa4fcda75fe None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:31.927536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b068186-ba6e-41fd-b62a-caa4fcda75fe None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:31.935285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3f5a7-8881-42b1-a4dc-9a5ab41d501c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:31.941621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:31.972511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be0f3b-dc91-43d5-9c27-02f838417f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:31.973182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be0f3b-dc91-43d5-9c27-02f838417f0a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:31.973566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be0f3b-dc91-43d5-9c27-02f838417f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:31.973799 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be0f3b-dc91-43d5-9c27-02f838417f0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:31.975185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be0f3b-dc91-43d5-9c27-02f838417f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:31.976705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be0f3b-dc91-43d5-9c27-02f838417f0a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:31.979278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 108/214] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:17:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:31.985972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be0f3b-dc91-43d5-9c27-02f838417f0a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:32.013261 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b6c8b-1ea1-4cdf-b8c2-2ed5c988bf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:32.014538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b6c8b-1ea1-4cdf-b8c2-2ed5c988bf2c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:32.014961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b6c8b-1ea1-4cdf-b8c2-2ed5c988bf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:32.015396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b6c8b-1ea1-4cdf-b8c2-2ed5c988bf2c None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:32.016679 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b6c8b-1ea1-4cdf-b8c2-2ed5c988bf2c None admin] RBAC: Adding query filter params (name=member) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:32.017424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b6c8b-1ea1-4cdf-b8c2-2ed5c988bf2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:32.019998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b6c8b-1ea1-4cdf-b8c2-2ed5c988bf2c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:32.037918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 107/215] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:32.047813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b6c8b-1ea1-4cdf-b8c2-2ed5c988bf2c None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:32.184423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be0f3b-dc91-43d5-9c27-02f838417f0a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:32.249097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:32.266136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacad4ab-fb97-477f-8c7a-be2472f291d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:32.267593 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad4ab-fb97-477f-8c7a-be2472f291d2 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:32.267874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b6c8b-1ea1-4cdf-b8c2-2ed5c988bf2c None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:32.268749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad4ab-fb97-477f-8c7a-be2472f291d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:32.269475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacad4ab-fb97-477f-8c7a-be2472f291d2 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:32.270485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacad4ab-fb97-477f-8c7a-be2472f291d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:32.272269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacad4ab-fb97-477f-8c7a-be2472f291d2 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:32.345978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281713-a553-4aea-aca7-8c3d28ca8365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:32.348418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281713-a553-4aea-aca7-8c3d28ca8365 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:32.348418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281713-a553-4aea-aca7-8c3d28ca8365 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:32.348418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e281713-a553-4aea-aca7-8c3d28ca8365 None admin] PATH_INFO: `/v3/users/93a0eb10f3934a7fa1b2688d1882506f` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:32.382039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e281713-a553-4aea-aca7-8c3d28ca8365 None admin] RBAC: Authorizing `identity:get_user(user_id=93a0eb10f3934a7fa1b2688d1882506f)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:32.385774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e281713-a553-4aea-aca7-8c3d28ca8365 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:32.389353 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 108/216] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:32 2022] GET /identity/v3/users/93a0eb10f3934a7fa1b2688d1882506f => generated 297 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:32.395140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281713-a553-4aea-aca7-8c3d28ca8365 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:32.415417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 109/217] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:17:31 2022] POST /identity/v3/users => generated 297 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:17:32.618522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e281713-a553-4aea-aca7-8c3d28ca8365 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:32.708929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a577aa-de9b-45e1-b4fc-30948d772cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:32.710685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a577aa-de9b-45e1-b4fc-30948d772cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:32.711775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a577aa-de9b-45e1-b4fc-30948d772cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:32.712491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a577aa-de9b-45e1-b4fc-30948d772cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:32.763637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:32.857216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a577aa-de9b-45e1-b4fc-30948d772cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:32.860164 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a577aa-de9b-45e1-b4fc-30948d772cb2 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:32.897126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e7029-a26d-4aed-8f5f-7797c9bea8b8 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:32.897844 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e7029-a26d-4aed-8f5f-7797c9bea8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:32.898335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e7029-a26d-4aed-8f5f-7797c9bea8b8 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:32.899851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 110/218] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:32.909220 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651f867-5ba1-4e76-ad8c-b431f791bf9c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:32.909802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651f867-5ba1-4e76-ad8c-b431f791bf9c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:32.910093 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651f867-5ba1-4e76-ad8c-b431f791bf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:32.940775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-7651f867-5ba1-4e76-ad8c-b431f791bf9c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:32.943155 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7651f867-5ba1-4e76-ad8c-b431f791bf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:33.013931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:33.054621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 109/219] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:33.067308 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a577aa-de9b-45e1-b4fc-30948d772cb2 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:33.131711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 111/220] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:33.206916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:33.300231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a577aa-de9b-45e1-b4fc-30948d772cb2 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:33.371663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e342-6501-4258-ae3f-5d3b81e12306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:33.372742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e342-6501-4258-ae3f-5d3b81e12306 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:33.373226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e342-6501-4258-ae3f-5d3b81e12306 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:33.373747 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069e342-6501-4258-ae3f-5d3b81e12306 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:33.375869 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069e342-6501-4258-ae3f-5d3b81e12306 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:33.378727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069e342-6501-4258-ae3f-5d3b81e12306 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:33.382386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 110/221] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:33 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:33.395323 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651f867-5ba1-4e76-ad8c-b431f791bf9c None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:33.562367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e342-6501-4258-ae3f-5d3b81e12306 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:33.604909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651f867-5ba1-4e76-ad8c-b431f791bf9c None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:33.647853 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc85835-b9e3-41e8-9b8e-c9547a794c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:33.648638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc85835-b9e3-41e8-9b8e-c9547a794c2a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:33.648994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc85835-b9e3-41e8-9b8e-c9547a794c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:33.649319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc85835-b9e3-41e8-9b8e-c9547a794c2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:33.650727 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc85835-b9e3-41e8-9b8e-c9547a794c2a None admin] RBAC: Adding query filter params (role.id=d27b7d5ab3274b85a416d9f8f7f75648, scope.project.id=f1f639a220c6483b9d682cc431b14298, user.id=93a0eb10f3934a7fa1b2688d1882506f) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:33.651055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc85835-b9e3-41e8-9b8e-c9547a794c2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:33.652695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc85835-b9e3-41e8-9b8e-c9547a794c2a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:33.659704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 112/222] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:33 2022] GET /identity/v3/role_assignments?user.id=93a0eb10f3934a7fa1b2688d1882506f&scope.project.id=f1f639a220c6483b9d682cc431b14298&role.id=d27b7d5ab3274b85a416d9f8f7f75648 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:33.666095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc958f-9216-4712-b7e6-670df2735f60 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:33.666420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc958f-9216-4712-b7e6-670df2735f60 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:33.666790 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc958f-9216-4712-b7e6-670df2735f60 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:33.669546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 113/223] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:33.678135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05179d29-59e7-40c4-908d-49c2d39b75fb None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:33.678465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05179d29-59e7-40c4-908d-49c2d39b75fb None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:33.678678 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05179d29-59e7-40c4-908d-49c2d39b75fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:33.705255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069e342-6501-4258-ae3f-5d3b81e12306 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:33.713301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-05179d29-59e7-40c4-908d-49c2d39b75fb None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:33.722298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-05179d29-59e7-40c4-908d-49c2d39b75fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:33.739906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:33.770125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:33.775925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962fe3f-282c-4255-958a-8c773ba90576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:33.778466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962fe3f-282c-4255-958a-8c773ba90576 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:33.778466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962fe3f-282c-4255-958a-8c773ba90576 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:33.778466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962fe3f-282c-4255-958a-8c773ba90576 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:33.814738 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962fe3f-282c-4255-958a-8c773ba90576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-3962fe3f-282c-4255-958a-8c773ba90576 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:33.820721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:33.822720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:33.823737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:33.823737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:33.823737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:33.823737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:33.823737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:33.823737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:33.823737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:33.823737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:33.823737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:33.823737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:33.823737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:17:33.823737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:33.830272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 111/224] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:17:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:33.835610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 114/225] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:33.841497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962fe3f-282c-4255-958a-8c773ba90576 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:34.049803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962fe3f-282c-4255-958a-8c773ba90576 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:34.121545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dbb71-5c8e-43e1-a418-8cc6ee7fbc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:34.122204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dbb71-5c8e-43e1-a418-8cc6ee7fbc4f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:34.122534 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dbb71-5c8e-43e1-a418-8cc6ee7fbc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:34.122851 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dbb71-5c8e-43e1-a418-8cc6ee7fbc4f None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:34.123786 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dbb71-5c8e-43e1-a418-8cc6ee7fbc4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:34.124106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dbb71-5c8e-43e1-a418-8cc6ee7fbc4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:34.128505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dbb71-5c8e-43e1-a418-8cc6ee7fbc4f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:34.148466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 112/226] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:34.157437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05179d29-59e7-40c4-908d-49c2d39b75fb None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:34.357677 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05179d29-59e7-40c4-908d-49c2d39b75fb None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:34.374604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dbb71-5c8e-43e1-a418-8cc6ee7fbc4f None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:34.414402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28515c2-5b41-4b2a-be41-5a3f9df4a301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:34.415447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28515c2-5b41-4b2a-be41-5a3f9df4a301 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:34.415949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28515c2-5b41-4b2a-be41-5a3f9df4a301 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:34.416342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28515c2-5b41-4b2a-be41-5a3f9df4a301 None admin] PATH_INFO: `/v3/users/7d8ee9878fc7449f83aa009f2c136102` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:34.417994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28515c2-5b41-4b2a-be41-5a3f9df4a301 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8ee9878fc7449f83aa009f2c136102)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:34.419605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28515c2-5b41-4b2a-be41-5a3f9df4a301 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:34.421559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 115/227] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:34 2022] GET /identity/v3/users/7d8ee9878fc7449f83aa009f2c136102 => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:34.427872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28515c2-5b41-4b2a-be41-5a3f9df4a301 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:34.491378 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:34.505964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:34.619499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28515c2-5b41-4b2a-be41-5a3f9df4a301 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:34.649335 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dbb71-5c8e-43e1-a418-8cc6ee7fbc4f None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:34.664406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65b57a-f9cf-49f5-b329-7bd4228e6828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:34.665055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65b57a-f9cf-49f5-b329-7bd4228e6828 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:34.665330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65b57a-f9cf-49f5-b329-7bd4228e6828 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:34.665619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65b57a-f9cf-49f5-b329-7bd4228e6828 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:34.667490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65b57a-f9cf-49f5-b329-7bd4228e6828 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:34.668971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65b57a-f9cf-49f5-b329-7bd4228e6828 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:34.670946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 116/228] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:34 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:34.678531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65b57a-f9cf-49f5-b329-7bd4228e6828 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:34.744693 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c54af-d846-4089-a90a-83f2a85909b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:34.747584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c54af-d846-4089-a90a-83f2a85909b7 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:34.748074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c54af-d846-4089-a90a-83f2a85909b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:34.748532 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c54af-d846-4089-a90a-83f2a85909b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:34.802996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c54af-d846-4089-a90a-83f2a85909b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-566c54af-d846-4089-a90a-83f2a85909b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:34.821670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:34.824484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:34.826720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 113/229] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:17:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:34.833548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c54af-d846-4089-a90a-83f2a85909b7 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:34.951487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:34.967072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65b57a-f9cf-49f5-b329-7bd4228e6828 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:35.037927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c54af-d846-4089-a90a-83f2a85909b7 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:35.046947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1506f-86d5-4b6a-9e53-938021d4a833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:35.048606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1506f-86d5-4b6a-9e53-938021d4a833 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:35.049816 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1506f-86d5-4b6a-9e53-938021d4a833 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:35.052257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1506f-86d5-4b6a-9e53-938021d4a833 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298/users/7d8ee9878fc7449f83aa009f2c136102/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:35.053088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:35.068088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1506f-86d5-4b6a-9e53-938021d4a833 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1f639a220c6483b9d682cc431b14298, user_id=7d8ee9878fc7449f83aa009f2c136102, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:35.071370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1506f-86d5-4b6a-9e53-938021d4a833 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:35.136560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d60d9-79f0-444e-9c3c-1858b4c06bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:35.138223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d60d9-79f0-444e-9c3c-1858b4c06bfe None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:35.139045 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d60d9-79f0-444e-9c3c-1858b4c06bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:35.139765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d60d9-79f0-444e-9c3c-1858b4c06bfe None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:35.141223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d60d9-79f0-444e-9c3c-1858b4c06bfe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:35.142191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d60d9-79f0-444e-9c3c-1858b4c06bfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:35.145310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d60d9-79f0-444e-9c3c-1858b4c06bfe None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:35.161038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 114/230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:17:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:35.166984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d60d9-79f0-444e-9c3c-1858b4c06bfe None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:35.225985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 117/231] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:17:34 2022] PUT /identity/v3/projects/f1f639a220c6483b9d682cc431b14298/users/7d8ee9878fc7449f83aa009f2c136102/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:17:35.408564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d60d9-79f0-444e-9c3c-1858b4c06bfe None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:35.497896 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d1de2-ddb0-46dc-b79f-3f11c0c3e005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:35.498533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d1de2-ddb0-46dc-b79f-3f11c0c3e005 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:35.498815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d1de2-ddb0-46dc-b79f-3f11c0c3e005 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:35.499180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532d1de2-ddb0-46dc-b79f-3f11c0c3e005 None admin] PATH_INFO: `/v3/users/7d8ee9878fc7449f83aa009f2c136102` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:35.500591 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d1de2-ddb0-46dc-b79f-3f11c0c3e005 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8ee9878fc7449f83aa009f2c136102)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:35.502159 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532d1de2-ddb0-46dc-b79f-3f11c0c3e005 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:35.504377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 115/232] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:35 2022] GET /identity/v3/users/7d8ee9878fc7449f83aa009f2c136102 => generated 283 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:35.512142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1506f-86d5-4b6a-9e53-938021d4a833 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:35.663004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1506f-86d5-4b6a-9e53-938021d4a833 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:35.727851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1b338-61c9-4901-8226-da3ed8c880ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:35.728551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1b338-61c9-4901-8226-da3ed8c880ea None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:35.728827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1b338-61c9-4901-8226-da3ed8c880ea None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:35.729093 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1b338-61c9-4901-8226-da3ed8c880ea None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:35.730450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1b338-61c9-4901-8226-da3ed8c880ea None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:35.731961 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1b338-61c9-4901-8226-da3ed8c880ea None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:35.733862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 118/233] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:35 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:35.740255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d1de2-ddb0-46dc-b79f-3f11c0c3e005 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:35.810423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf4fc9-2760-48c6-a404-8362a56a6816 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:35.810660 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf4fc9-2760-48c6-a404-8362a56a6816 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:35.811078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf4fc9-2760-48c6-a404-8362a56a6816 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:35.814304 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 119/234] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:17:35.820144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a7651-43f8-4b4e-a1ae-bce7f6018268 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:35.820417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a7651-43f8-4b4e-a1ae-bce7f6018268 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:35.820713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a7651-43f8-4b4e-a1ae-bce7f6018268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:35.846525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:35.864083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-641a7651-43f8-4b4e-a1ae-bce7f6018268 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:35.866249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-641a7651-43f8-4b4e-a1ae-bce7f6018268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:35.914943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:36.002113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532d1de2-ddb0-46dc-b79f-3f11c0c3e005 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:36.018684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 120/235] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:36.021167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa5eaf-ad58-46e7-b08d-9757f8b18af8 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:36.021714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa5eaf-ad58-46e7-b08d-9757f8b18af8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:36.022215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa5eaf-ad58-46e7-b08d-9757f8b18af8 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:36.025715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 121/236] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:36.037418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64468887-5812-498b-91f7-5423518a956e None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:36.037418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64468887-5812-498b-91f7-5423518a956e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:36.037418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64468887-5812-498b-91f7-5423518a956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:36.106947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-64468887-5812-498b-91f7-5423518a956e None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:36.111079 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-64468887-5812-498b-91f7-5423518a956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:36.137714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79901d2-7f22-4488-9f6a-515f58cbcbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:36.138854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79901d2-7f22-4488-9f6a-515f58cbcbbf None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:36.145104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79901d2-7f22-4488-9f6a-515f58cbcbbf None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:36.145754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79901d2-7f22-4488-9f6a-515f58cbcbbf None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298/users/7d8ee9878fc7449f83aa009f2c136102/roles/5183ce055fde4522816e3cdce43ed4e9` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:36.152419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79901d2-7f22-4488-9f6a-515f58cbcbbf None admin] RBAC: Authorizing `identity:create_grant(project_id=f1f639a220c6483b9d682cc431b14298, user_id=7d8ee9878fc7449f83aa009f2c136102, role_id=5183ce055fde4522816e3cdce43ed4e9)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:36.155560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79901d2-7f22-4488-9f6a-515f58cbcbbf None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:36.288140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 122/237] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:36.317515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 116/238] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:17:35 2022] PUT /identity/v3/projects/f1f639a220c6483b9d682cc431b14298/users/7d8ee9878fc7449f83aa009f2c136102/roles/5183ce055fde4522816e3cdce43ed4e9 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:36.647838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64468887-5812-498b-91f7-5423518a956e None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:36.691749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79901d2-7f22-4488-9f6a-515f58cbcbbf None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:36.824913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:36.858492 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64468887-5812-498b-91f7-5423518a956e None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:36.926945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:36.934676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79901d2-7f22-4488-9f6a-515f58cbcbbf None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:36.936469 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe2780-b2ce-4765-8d85-5f5a1338c085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:36.946073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2780-b2ce-4765-8d85-5f5a1338c085 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:36.946073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2780-b2ce-4765-8d85-5f5a1338c085 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:36.946073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2780-b2ce-4765-8d85-5f5a1338c085 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:36.946073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe2780-b2ce-4765-8d85-5f5a1338c085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:36.946073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe2780-b2ce-4765-8d85-5f5a1338c085 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:36.948943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 123/239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:17:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:36.951911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33fe32-4b74-48c5-a948-16d57f59dbad None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:36.952793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33fe32-4b74-48c5-a948-16d57f59dbad None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:36.953625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33fe32-4b74-48c5-a948-16d57f59dbad None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:36.956641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 124/240] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:36.958586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33fe32-4b74-48c5-a948-16d57f59dbad None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:36.995475 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc16f8e-18f1-40bd-aa07-25cab5cbab95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:37.023650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16f8e-18f1-40bd-aa07-25cab5cbab95 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:37.023650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16f8e-18f1-40bd-aa07-25cab5cbab95 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:37.023650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16f8e-18f1-40bd-aa07-25cab5cbab95 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:37.023650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc16f8e-18f1-40bd-aa07-25cab5cbab95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-7dc16f8e-18f1-40bd-aa07-25cab5cbab95 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:37.032524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:37.034539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:37.036184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:37.036184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:37.036184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:37.036184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:37.036184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:37.036184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:37.036184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:37.036184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:37.036184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:37.036184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:37.036184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:37.036184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:37.040367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 117/241] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:37.043224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eaded-31db-46b7-a684-42cb43250c1c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:37.044033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eaded-31db-46b7-a684-42cb43250c1c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:37.044812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eaded-31db-46b7-a684-42cb43250c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:37.080021 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-9c1eaded-31db-46b7-a684-42cb43250c1c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:37.081593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9c1eaded-31db-46b7-a684-42cb43250c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:37.166408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33fe32-4b74-48c5-a948-16d57f59dbad None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:37.192046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 118/242] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:37.194564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eaded-31db-46b7-a684-42cb43250c1c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:37.257972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c7ada-45a0-41c8-94eb-4b9df036178b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:37.258861 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c7ada-45a0-41c8-94eb-4b9df036178b None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:37.259416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c7ada-45a0-41c8-94eb-4b9df036178b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:37.260293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c7ada-45a0-41c8-94eb-4b9df036178b None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:37.261010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c7ada-45a0-41c8-94eb-4b9df036178b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:37.263019 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c7ada-45a0-41c8-94eb-4b9df036178b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:37.360880 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:37.384639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eaded-31db-46b7-a684-42cb43250c1c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:37.402934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 125/243] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:17:36 2022] POST /identity/v3/users => generated 293 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:37.445625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6fda-d247-4e5e-aa08-d1f56160dac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:37.446295 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6fda-d247-4e5e-aa08-d1f56160dac4 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:37.446585 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6fda-d247-4e5e-aa08-d1f56160dac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:37.447081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd6fda-d247-4e5e-aa08-d1f56160dac4 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:37.447784 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd6fda-d247-4e5e-aa08-d1f56160dac4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:37.448092 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd6fda-d247-4e5e-aa08-d1f56160dac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:37.449605 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd6fda-d247-4e5e-aa08-d1f56160dac4 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:37.468023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 119/244] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:37.473782 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c7ada-45a0-41c8-94eb-4b9df036178b None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:37.494582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:37.638369 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6fda-d247-4e5e-aa08-d1f56160dac4 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:37.640693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c7ada-45a0-41c8-94eb-4b9df036178b None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:37.684843 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff06d02-bbd3-4c4b-ad94-7e6899cff1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:37.685939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff06d02-bbd3-4c4b-ad94-7e6899cff1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:37.685939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff06d02-bbd3-4c4b-ad94-7e6899cff1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:37.686193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff06d02-bbd3-4c4b-ad94-7e6899cff1f0 None admin] PATH_INFO: `/v3/users/45b791392851439cbebaa441714fae92` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:37.707864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff06d02-bbd3-4c4b-ad94-7e6899cff1f0 None admin] RBAC: Authorizing `identity:get_user(user_id=45b791392851439cbebaa441714fae92)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:37.709314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff06d02-bbd3-4c4b-ad94-7e6899cff1f0 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:37.711763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 126/245] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:37 2022] GET /identity/v3/users/45b791392851439cbebaa441714fae92 => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:37.718154 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff06d02-bbd3-4c4b-ad94-7e6899cff1f0 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:37.812150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd6fda-d247-4e5e-aa08-d1f56160dac4 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:37.829213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:37.875244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c964f8-d3e3-43fc-b59b-c827d9a9fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:37.876457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c964f8-d3e3-43fc-b59b-c827d9a9fb16 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:37.876942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c964f8-d3e3-43fc-b59b-c827d9a9fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:37.878771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c964f8-d3e3-43fc-b59b-c827d9a9fb16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:37.899198 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff06d02-bbd3-4c4b-ad94-7e6899cff1f0 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:37.900036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c964f8-d3e3-43fc-b59b-c827d9a9fb16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-97c964f8-d3e3-43fc-b59b-c827d9a9fb16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:37.907890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:37.908921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:37.909730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:37.909730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:37.909730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:37.909730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:37.909730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:37.909730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:37.909730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:37.909730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:37.909730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:37.909730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:37.909730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:37.909730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:37.915330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 120/246] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:37.924201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c964f8-d3e3-43fc-b59b-c827d9a9fb16 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:37.956997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:37.972495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1a076-f6e6-4b3d-9974-aea039c4c300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:37.973463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1a076-f6e6-4b3d-9974-aea039c4c300 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:37.973894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1a076-f6e6-4b3d-9974-aea039c4c300 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:37.974311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1a076-f6e6-4b3d-9974-aea039c4c300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:38.075691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1a076-f6e6-4b3d-9974-aea039c4c300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:38.077888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1a076-f6e6-4b3d-9974-aea039c4c300 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:38.131894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c964f8-d3e3-43fc-b59b-c827d9a9fb16 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:38.167905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:38.210232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ece79-42f5-4177-aa4a-4bd822e0f144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:38.210890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ece79-42f5-4177-aa4a-4bd822e0f144 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:38.211426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ece79-42f5-4177-aa4a-4bd822e0f144 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:38.211701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ece79-42f5-4177-aa4a-4bd822e0f144 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:38.212956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ece79-42f5-4177-aa4a-4bd822e0f144 None admin] RBAC: Adding query filter params (name=member) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:38.213269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ece79-42f5-4177-aa4a-4bd822e0f144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:38.215722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ece79-42f5-4177-aa4a-4bd822e0f144 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:38.220102 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 127/247] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 05:17:38.226180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1a076-f6e6-4b3d-9974-aea039c4c300 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:38.226707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 121/248] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:38.232693 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ece79-42f5-4177-aa4a-4bd822e0f144 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:38.358601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:38.381729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1a076-f6e6-4b3d-9974-aea039c4c300 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:38.429506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ece79-42f5-4177-aa4a-4bd822e0f144 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:38.433723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1921a-8a7f-47e0-ad01-6363c26c5358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:38.434388 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1921a-8a7f-47e0-ad01-6363c26c5358 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:38.434672 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1921a-8a7f-47e0-ad01-6363c26c5358 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:38.434999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1921a-8a7f-47e0-ad01-6363c26c5358 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:38.436290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1921a-8a7f-47e0-ad01-6363c26c5358 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:38.438989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1921a-8a7f-47e0-ad01-6363c26c5358 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:38.439755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 128/249] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:38 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:38.445979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1921a-8a7f-47e0-ad01-6363c26c5358 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:38.497605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:38.523959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7668d-7a07-4cde-9a02-53ef9949bfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:38.525720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7668d-7a07-4cde-9a02-53ef9949bfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:38.526234 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7668d-7a07-4cde-9a02-53ef9949bfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:38.526727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7668d-7a07-4cde-9a02-53ef9949bfe5 None admin] PATH_INFO: `/v3/users/93a0eb10f3934a7fa1b2688d1882506f` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:38.528993 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7668d-7a07-4cde-9a02-53ef9949bfe5 None admin] RBAC: Authorizing `identity:get_user(user_id=93a0eb10f3934a7fa1b2688d1882506f)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:38.533489 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7668d-7a07-4cde-9a02-53ef9949bfe5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:38.538837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 122/250] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:38 2022] GET /identity/v3/users/93a0eb10f3934a7fa1b2688d1882506f => generated 297 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:38.547462 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7668d-7a07-4cde-9a02-53ef9949bfe5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:38.645901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1921a-8a7f-47e0-ad01-6363c26c5358 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:38.725875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09404f1b-6088-4489-a313-7d85a25aa570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:38.727491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09404f1b-6088-4489-a313-7d85a25aa570 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:38.729008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09404f1b-6088-4489-a313-7d85a25aa570 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:38.729640 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09404f1b-6088-4489-a313-7d85a25aa570 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:38.732575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09404f1b-6088-4489-a313-7d85a25aa570 None admin] RBAC: Adding query filter params (role.id=e3703da52f214166b433fe3405753808, scope.project.id=f1f639a220c6483b9d682cc431b14298, user.id=45b791392851439cbebaa441714fae92) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:38.733257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09404f1b-6088-4489-a313-7d85a25aa570 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:38.735179 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09404f1b-6088-4489-a313-7d85a25aa570 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:38.750503 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 129/251] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:38 2022] GET /identity/v3/role_assignments?user.id=45b791392851439cbebaa441714fae92&scope.project.id=f1f639a220c6483b9d682cc431b14298&role.id=e3703da52f214166b433fe3405753808 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:38.766090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7668d-7a07-4cde-9a02-53ef9949bfe5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:38.834556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b4ebcb-05da-4774-8340-9492b92cb9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:38.836284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4ebcb-05da-4774-8340-9492b92cb9ef None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:38.836771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4ebcb-05da-4774-8340-9492b92cb9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:38.837272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b4ebcb-05da-4774-8340-9492b92cb9ef None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:38.842346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4ebcb-05da-4774-8340-9492b92cb9ef None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:38.844196 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b4ebcb-05da-4774-8340-9492b92cb9ef None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:38.846367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 123/252] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:38 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:38.853169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09404f1b-6088-4489-a313-7d85a25aa570 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:39.003877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:39.011288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09404f1b-6088-4489-a313-7d85a25aa570 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:39.066407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176867a-50ed-4cee-a14e-f20ffd130ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:39.067521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176867a-50ed-4cee-a14e-f20ffd130ef2 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:39.068047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176867a-50ed-4cee-a14e-f20ffd130ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:39.068628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176867a-50ed-4cee-a14e-f20ffd130ef2 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298/users/93a0eb10f3934a7fa1b2688d1882506f/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:39.071221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176867a-50ed-4cee-a14e-f20ffd130ef2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1f639a220c6483b9d682cc431b14298, user_id=93a0eb10f3934a7fa1b2688d1882506f, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:39.073725 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176867a-50ed-4cee-a14e-f20ffd130ef2 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:39.133049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd143f0-6c58-408a-a7ce-16f195f06150 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:39.133744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd143f0-6c58-408a-a7ce-16f195f06150 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:39.134809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd143f0-6c58-408a-a7ce-16f195f06150 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:39.136998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 124/253] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:39.144691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f9b06-8ab5-4fda-92fe-c0c94f47df46 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:39.145256 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f9b06-8ab5-4fda-92fe-c0c94f47df46 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:39.145726 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f9b06-8ab5-4fda-92fe-c0c94f47df46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:39.154758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:39.170045 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-380f9b06-8ab5-4fda-92fe-c0c94f47df46 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:39.171566 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-380f9b06-8ab5-4fda-92fe-c0c94f47df46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:39.207975 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 130/254] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:17:38 2022] PUT /identity/v3/projects/f1f639a220c6483b9d682cc431b14298/users/93a0eb10f3934a7fa1b2688d1882506f/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:39.278987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 125/255] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:39.735583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58986d21-b239-4b08-9858-ff50c7fd3150 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:39.736633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58986d21-b239-4b08-9858-ff50c7fd3150 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:39.737126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58986d21-b239-4b08-9858-ff50c7fd3150 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:39.738777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 131/256] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:39.754997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157554a-116f-4c99-9a72-24b907a964af None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:39.755631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157554a-116f-4c99-9a72-24b907a964af None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:39.756134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157554a-116f-4c99-9a72-24b907a964af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:39.782541 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a157554a-116f-4c99-9a72-24b907a964af None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:39.784206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a157554a-116f-4c99-9a72-24b907a964af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:39.797949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58986d21-b239-4b08-9858-ff50c7fd3150 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:39.906828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 126/257] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:40.069761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58986d21-b239-4b08-9858-ff50c7fd3150 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:40.127246 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdb9cb-79a9-45c2-9a4b-8d751a1c1cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:40.127978 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdb9cb-79a9-45c2-9a4b-8d751a1c1cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:40.128261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdb9cb-79a9-45c2-9a4b-8d751a1c1cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:40.128538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdb9cb-79a9-45c2-9a4b-8d751a1c1cd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:40.152721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cdb9cb-79a9-45c2-9a4b-8d751a1c1cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-f7cdb9cb-79a9-45c2-9a4b-8d751a1c1cd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:40.159533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:40.160497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:40.161282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:40.161282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:40.161282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:40.161282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:40.161282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:40.161282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:40.161282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:40.161282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:40.161282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:40.161282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:40.161282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:17:40.161282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:40.165915 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 132/258] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:17:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:17:40.169794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157554a-116f-4c99-9a72-24b907a964af None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:40.265584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:40.330919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157554a-116f-4c99-9a72-24b907a964af None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:40.388493 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37976e53-d7bf-40a8-a4cf-44fe7e57ca06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:40.389143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37976e53-d7bf-40a8-a4cf-44fe7e57ca06 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:40.389470 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37976e53-d7bf-40a8-a4cf-44fe7e57ca06 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:40.389743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37976e53-d7bf-40a8-a4cf-44fe7e57ca06 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:40.390412 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37976e53-d7bf-40a8-a4cf-44fe7e57ca06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:40.390720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37976e53-d7bf-40a8-a4cf-44fe7e57ca06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:40.392305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37976e53-d7bf-40a8-a4cf-44fe7e57ca06 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:40.407014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 127/259] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:40.414046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdb9cb-79a9-45c2-9a4b-8d751a1c1cd0 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:40.464601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:40.687364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdb9cb-79a9-45c2-9a4b-8d751a1c1cd0 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:40.777942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44422e96-76fb-4559-9a43-8bd8250d26ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:40.780290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44422e96-76fb-4559-9a43-8bd8250d26ee None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:40.781109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44422e96-76fb-4559-9a43-8bd8250d26ee None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:40.781897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44422e96-76fb-4559-9a43-8bd8250d26ee None admin] PATH_INFO: `/v3/users/7d8ee9878fc7449f83aa009f2c136102` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:40.789461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44422e96-76fb-4559-9a43-8bd8250d26ee None admin] RBAC: Authorizing `identity:get_user(user_id=7d8ee9878fc7449f83aa009f2c136102)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:40.793331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44422e96-76fb-4559-9a43-8bd8250d26ee None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:40.796862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 133/260] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:40 2022] GET /identity/v3/users/7d8ee9878fc7449f83aa009f2c136102 => generated 283 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:40.803034 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37976e53-d7bf-40a8-a4cf-44fe7e57ca06 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:40.829664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44422e96-76fb-4559-9a43-8bd8250d26ee None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:41.169325 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:41.202403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37976e53-d7bf-40a8-a4cf-44fe7e57ca06 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:41.229814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44422e96-76fb-4559-9a43-8bd8250d26ee None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:41.309950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:41.347140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb24a3c5-0464-4126-a930-ce35992fb45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:41.347860 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24a3c5-0464-4126-a930-ce35992fb45d None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:41.348171 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24a3c5-0464-4126-a930-ce35992fb45d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:41.348509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb24a3c5-0464-4126-a930-ce35992fb45d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:41.362279 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5531-0b7d-4c26-b6ab-5b808846b091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:41.363496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5531-0b7d-4c26-b6ab-5b808846b091 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:41.363979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5531-0b7d-4c26-b6ab-5b808846b091 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:41.364427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5531-0b7d-4c26-b6ab-5b808846b091 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:41.406606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad5531-0b7d-4c26-b6ab-5b808846b091 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-a3ad5531-0b7d-4c26-b6ab-5b808846b091 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:41.433105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:41.434121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 134/261] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:17:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 592 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:17:41.435116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5531-0b7d-4c26-b6ab-5b808846b091 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:41.563382 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24a3c5-0464-4126-a930-ce35992fb45d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:41.565173 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb24a3c5-0464-4126-a930-ce35992fb45d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:41.767371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 128/262] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 965 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:41.769242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a529c20-bca7-4537-af73-89da0edd116b None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:41.769988 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a529c20-bca7-4537-af73-89da0edd116b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:41.770498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a529c20-bca7-4537-af73-89da0edd116b None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:41.776742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5531-0b7d-4c26-b6ab-5b808846b091 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:41.777771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 129/263] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:41.778973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a529c20-bca7-4537-af73-89da0edd116b None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:41.823031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:41.886737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f26467-1ec9-4351-b923-e157bb246df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:41.887610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f26467-1ec9-4351-b923-e157bb246df0 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:41.887610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f26467-1ec9-4351-b923-e157bb246df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:41.887885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f26467-1ec9-4351-b923-e157bb246df0 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:41.888556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f26467-1ec9-4351-b923-e157bb246df0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:41.888860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f26467-1ec9-4351-b923-e157bb246df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:41.890345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f26467-1ec9-4351-b923-e157bb246df0 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:41.905702 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 135/264] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:17:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:41.907560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ebb87-c054-4426-998d-22ed29ef5b4c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:41.908146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ebb87-c054-4426-998d-22ed29ef5b4c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:41.908706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ebb87-c054-4426-998d-22ed29ef5b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:41.925827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:41.933221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-108ebb87-c054-4426-998d-22ed29ef5b4c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:41.934987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-108ebb87-c054-4426-998d-22ed29ef5b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:41.936308 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a529c20-bca7-4537-af73-89da0edd116b None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:41.990280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26f52c-d08c-4484-8df8-d5035216a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:41.990935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26f52c-d08c-4484-8df8-d5035216a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:41.991214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26f52c-d08c-4484-8df8-d5035216a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:41.991485 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26f52c-d08c-4484-8df8-d5035216a7b6 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:41.994296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26f52c-d08c-4484-8df8-d5035216a7b6 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:41.995513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26f52c-d08c-4484-8df8-d5035216a7b6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:41.998219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 130/265] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:41 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:41.999740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671405f-4e4e-4969-8a6a-16bf6526ab7e None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:42.000219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671405f-4e4e-4969-8a6a-16bf6526ab7e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:42.000651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671405f-4e4e-4969-8a6a-16bf6526ab7e None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:42.002183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 131/266] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:42.003202 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671405f-4e4e-4969-8a6a-16bf6526ab7e None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:42.038404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 136/267] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:42.039162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ebb87-c054-4426-998d-22ed29ef5b4c None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:42.183142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:42.202277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671405f-4e4e-4969-8a6a-16bf6526ab7e None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:42.234673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ebb87-c054-4426-998d-22ed29ef5b4c None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:42.255623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487285ff-4630-4879-b840-62f61d14ec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:42.256441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487285ff-4630-4879-b840-62f61d14ec38 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:42.256573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487285ff-4630-4879-b840-62f61d14ec38 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:42.256930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487285ff-4630-4879-b840-62f61d14ec38 None admin] PATH_INFO: `/v3/users/7d8ee9878fc7449f83aa009f2c136102` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:42.258057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487285ff-4630-4879-b840-62f61d14ec38 None admin] RBAC: Authorizing `identity:get_user(user_id=7d8ee9878fc7449f83aa009f2c136102)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:42.260275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487285ff-4630-4879-b840-62f61d14ec38 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:42.262320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 132/268] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:42 2022] GET /identity/v3/users/7d8ee9878fc7449f83aa009f2c136102 => generated 283 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:42.263691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deabe4d-6d70-4980-893b-514ecb00fe09 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:42.263994 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deabe4d-6d70-4980-893b-514ecb00fe09 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:42.264258 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deabe4d-6d70-4980-893b-514ecb00fe09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:42.286642 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-9deabe4d-6d70-4980-893b-514ecb00fe09 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:42.287948 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9deabe4d-6d70-4980-893b-514ecb00fe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:42.323288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90450f16-fd0c-4372-b2da-c0895c3a5ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:42.323288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90450f16-fd0c-4372-b2da-c0895c3a5ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:42.323682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90450f16-fd0c-4372-b2da-c0895c3a5ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:42.323963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90450f16-fd0c-4372-b2da-c0895c3a5ef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:42.324720 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90450f16-fd0c-4372-b2da-c0895c3a5ef8 None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=f1f639a220c6483b9d682cc431b14298, user.id=7d8ee9878fc7449f83aa009f2c136102) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:42.325028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90450f16-fd0c-4372-b2da-c0895c3a5ef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:42.326938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90450f16-fd0c-4372-b2da-c0895c3a5ef8 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:42.331691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:42.335783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 137/269] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:42 2022] GET /identity/v3/role_assignments?user.id=7d8ee9878fc7449f83aa009f2c136102&scope.project.id=f1f639a220c6483b9d682cc431b14298&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:42.345286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d871e-d4a9-481a-9afb-ae5349960789 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:42.346068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d871e-d4a9-481a-9afb-ae5349960789 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:42.346628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d871e-d4a9-481a-9afb-ae5349960789 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:42.350132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 138/270] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:42.352040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d871e-d4a9-481a-9afb-ae5349960789 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:42.447346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 133/271] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:42.448838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deabe4d-6d70-4980-893b-514ecb00fe09 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:42.648627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d871e-d4a9-481a-9afb-ae5349960789 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:42.670110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:42.686645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deabe4d-6d70-4980-893b-514ecb00fe09 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:42.727070 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8670f0-8e8e-4448-bc4a-47becc6097d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:42.728972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8670f0-8e8e-4448-bc4a-47becc6097d3 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:42.730250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8670f0-8e8e-4448-bc4a-47becc6097d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:42.730820 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8670f0-8e8e-4448-bc4a-47becc6097d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:42.768019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb969af-acc6-40f3-80cb-1a153001fde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:42.769163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb969af-acc6-40f3-80cb-1a153001fde4 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:42.770757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb969af-acc6-40f3-80cb-1a153001fde4 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:42.771602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb969af-acc6-40f3-80cb-1a153001fde4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:42.793505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb969af-acc6-40f3-80cb-1a153001fde4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-6bb969af-acc6-40f3-80cb-1a153001fde4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:42.799172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:42.800314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:42.801318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:42.801318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:42.801318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:42.801318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:42.801318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:42.801318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:42.801318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:42.801318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:42.801318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:42.801318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:42.801318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:42.801318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:42.804928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 134/272] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:42.808248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a85e35-affc-42df-8809-3c967a3986fc None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:42.808248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a85e35-affc-42df-8809-3c967a3986fc None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:42.808248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a85e35-affc-42df-8809-3c967a3986fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:42.835002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-81a85e35-affc-42df-8809-3c967a3986fc None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:42.837059 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-81a85e35-affc-42df-8809-3c967a3986fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:42.878379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:42.880529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8670f0-8e8e-4448-bc4a-47becc6097d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:42.882343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8670f0-8e8e-4448-bc4a-47becc6097d3 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:42.941150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 135/273] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:42.941150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0042b-8356-4c49-87ef-d6b965471a1f None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:42.941150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0042b-8356-4c49-87ef-d6b965471a1f None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:42.941150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0042b-8356-4c49-87ef-d6b965471a1f None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:42.941150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 136/274] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:42.941150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0042b-8356-4c49-87ef-d6b965471a1f None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:43.041848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 139/275] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:43.047559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8670f0-8e8e-4448-bc4a-47becc6097d3 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:43.138024 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:43.182001 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0042b-8356-4c49-87ef-d6b965471a1f None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:43.239112 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:43.245038 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8670f0-8e8e-4448-bc4a-47becc6097d3 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:43.254846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3a27d-0721-43f9-9e17-eebad1c50885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:43.256052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3a27d-0721-43f9-9e17-eebad1c50885 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:43.257308 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3a27d-0721-43f9-9e17-eebad1c50885 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:43.257792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3a27d-0721-43f9-9e17-eebad1c50885 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:43.260023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3a27d-0721-43f9-9e17-eebad1c50885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:43.261966 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3a27d-0721-43f9-9e17-eebad1c50885 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:43.264290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 137/276] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:17:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:43.265991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dd253-2dcd-47f2-92e9-8293542218bf None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:43.266370 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dd253-2dcd-47f2-92e9-8293542218bf None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:43.266693 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dd253-2dcd-47f2-92e9-8293542218bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:43.293146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-8d4dd253-2dcd-47f2-92e9-8293542218bf None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:43.294951 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8d4dd253-2dcd-47f2-92e9-8293542218bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:43.319084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df62444-821c-4bb4-8b37-f84fd1ee5411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:43.320128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df62444-821c-4bb4-8b37-f84fd1ee5411 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:43.377772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df62444-821c-4bb4-8b37-f84fd1ee5411 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:43.377772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df62444-821c-4bb4-8b37-f84fd1ee5411 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:43.377772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df62444-821c-4bb4-8b37-f84fd1ee5411 None admin] RBAC: Adding query filter params (name=member) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:43.377772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df62444-821c-4bb4-8b37-f84fd1ee5411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:43.377772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df62444-821c-4bb4-8b37-f84fd1ee5411 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:43.377772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 140/277] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:43.378338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df62444-821c-4bb4-8b37-f84fd1ee5411 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:43.399026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 138/278] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:43.400388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dd253-2dcd-47f2-92e9-8293542218bf None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:43.517661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df62444-821c-4bb4-8b37-f84fd1ee5411 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:43.549585 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:43.572783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dd253-2dcd-47f2-92e9-8293542218bf None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:43.583447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570cd7f-5f6c-4000-92c8-b026f14e1525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:43.584490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570cd7f-5f6c-4000-92c8-b026f14e1525 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:43.584974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570cd7f-5f6c-4000-92c8-b026f14e1525 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:43.585662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570cd7f-5f6c-4000-92c8-b026f14e1525 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:43.588770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570cd7f-5f6c-4000-92c8-b026f14e1525 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:43.591592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570cd7f-5f6c-4000-92c8-b026f14e1525 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:43.599863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 141/279] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:43 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:43.599863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570cd7f-5f6c-4000-92c8-b026f14e1525 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:43.624441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09350446-f1ae-4d06-a40a-17fd2d3d8ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:43.625560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09350446-f1ae-4d06-a40a-17fd2d3d8ec3 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:43.626016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09350446-f1ae-4d06-a40a-17fd2d3d8ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:43.626597 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09350446-f1ae-4d06-a40a-17fd2d3d8ec3 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:43.627717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09350446-f1ae-4d06-a40a-17fd2d3d8ec3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:43.629526 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09350446-f1ae-4d06-a40a-17fd2d3d8ec3 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:43.671488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:43.769422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570cd7f-5f6c-4000-92c8-b026f14e1525 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:43.770291 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 139/280] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:17:43 2022] POST /identity/v3/users => generated 293 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:43.778884 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09350446-f1ae-4d06-a40a-17fd2d3d8ec3 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:43.837692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa273d3c-d093-4b1d-8c3c-6bff626579ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:43.838700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273d3c-d093-4b1d-8c3c-6bff626579ed None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:43.839138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273d3c-d093-4b1d-8c3c-6bff626579ed None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:43.839634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273d3c-d093-4b1d-8c3c-6bff626579ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:43.855324 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa273d3c-d093-4b1d-8c3c-6bff626579ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-aa273d3c-d093-4b1d-8c3c-6bff626579ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:43.861300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:43.863560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:43.865793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 142/281] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:43.869240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa273d3c-d093-4b1d-8c3c-6bff626579ed None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:43.976101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09350446-f1ae-4d06-a40a-17fd2d3d8ec3 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:44.029265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e020f-6e5b-4a1c-bc6c-ccadd630d9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:44.029900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e020f-6e5b-4a1c-bc6c-ccadd630d9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:44.030189 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e020f-6e5b-4a1c-bc6c-ccadd630d9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:44.030467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e020f-6e5b-4a1c-bc6c-ccadd630d9d3 None admin] PATH_INFO: `/v3/users/cb6c9202edaa42138f86c7274a9fc9de` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:44.035265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:44.053757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e020f-6e5b-4a1c-bc6c-ccadd630d9d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cb6c9202edaa42138f86c7274a9fc9de)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:44.055478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e020f-6e5b-4a1c-bc6c-ccadd630d9d3 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:44.059478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 140/282] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:43 2022] GET /identity/v3/users/cb6c9202edaa42138f86c7274a9fc9de => generated 293 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:44.059720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e020f-6e5b-4a1c-bc6c-ccadd630d9d3 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:44.070969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:44.091067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa273d3c-d093-4b1d-8c3c-6bff626579ed None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:44.157767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf764c-24af-4489-aac5-89fa2b2b4a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:44.158589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf764c-24af-4489-aac5-89fa2b2b4a8d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:44.159053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf764c-24af-4489-aac5-89fa2b2b4a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:44.159398 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf764c-24af-4489-aac5-89fa2b2b4a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:44.160358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf764c-24af-4489-aac5-89fa2b2b4a8d None admin] RBAC: Adding query filter params (role.id=5183ce055fde4522816e3cdce43ed4e9, scope.project.id=f1f639a220c6483b9d682cc431b14298, user.id=7d8ee9878fc7449f83aa009f2c136102) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:44.161812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf764c-24af-4489-aac5-89fa2b2b4a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:44.162661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf764c-24af-4489-aac5-89fa2b2b4a8d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:44.174134 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 143/283] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:43 2022] GET /identity/v3/role_assignments?user.id=7d8ee9878fc7449f83aa009f2c136102&scope.project.id=f1f639a220c6483b9d682cc431b14298&role.id=5183ce055fde4522816e3cdce43ed4e9 => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:44.175231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf764c-24af-4489-aac5-89fa2b2b4a8d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:44.261822 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e020f-6e5b-4a1c-bc6c-ccadd630d9d3 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:44.313120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca3e8f-7976-4f4b-9f27-6a92089e8be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:44.314063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3e8f-7976-4f4b-9f27-6a92089e8be7 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:44.314530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3e8f-7976-4f4b-9f27-6a92089e8be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:44.314990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3e8f-7976-4f4b-9f27-6a92089e8be7 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:44.316151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca3e8f-7976-4f4b-9f27-6a92089e8be7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:44.316659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca3e8f-7976-4f4b-9f27-6a92089e8be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:44.319297 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca3e8f-7976-4f4b-9f27-6a92089e8be7 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:44.332505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf764c-24af-4489-aac5-89fa2b2b4a8d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:44.333678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 141/284] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:44.334600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca3e8f-7976-4f4b-9f27-6a92089e8be7 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:44.408834 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50381e-1fb5-45f0-9f89-2e31a79676dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:44.409983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50381e-1fb5-45f0-9f89-2e31a79676dc None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:44.410626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50381e-1fb5-45f0-9f89-2e31a79676dc None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:44.411297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50381e-1fb5-45f0-9f89-2e31a79676dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:44.421563 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:44.437460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50381e-1fb5-45f0-9f89-2e31a79676dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-4e50381e-1fb5-45f0-9f89-2e31a79676dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:44.444101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:44.447068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 144/285] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:44.448763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50381e-1fb5-45f0-9f89-2e31a79676dc None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:44.472146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:44.551985 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca3e8f-7976-4f4b-9f27-6a92089e8be7 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:44.610316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e635b-e6e7-4c1f-8b67-01f5de23ec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:44.611713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e635b-e6e7-4c1f-8b67-01f5de23ec14 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:44.612386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e635b-e6e7-4c1f-8b67-01f5de23ec14 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:44.612996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e635b-e6e7-4c1f-8b67-01f5de23ec14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:44.614209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e635b-e6e7-4c1f-8b67-01f5de23ec14 None admin] RBAC: Adding query filter params (role.id=d27b7d5ab3274b85a416d9f8f7f75648, user.id=cb6c9202edaa42138f86c7274a9fc9de, scope.system=all) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:44.614835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e635b-e6e7-4c1f-8b67-01f5de23ec14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:44.616649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e635b-e6e7-4c1f-8b67-01f5de23ec14 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:44.626171 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 142/286] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Sep 1 05:17:44 2022] GET /identity/v3/role_assignments?user.id=cb6c9202edaa42138f86c7274a9fc9de&scope.system=all&role.id=d27b7d5ab3274b85a416d9f8f7f75648 => generated 226 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:44.633798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e635b-e6e7-4c1f-8b67-01f5de23ec14 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:44.657470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50381e-1fb5-45f0-9f89-2e31a79676dc None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:44.751411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c9806-f414-4d4c-85d6-80b971d4ae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:44.752059 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9806-f414-4d4c-85d6-80b971d4ae96 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:44.752336 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9806-f414-4d4c-85d6-80b971d4ae96 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:44.752626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c9806-f414-4d4c-85d6-80b971d4ae96 None admin] PATH_INFO: `/v3/users/45b791392851439cbebaa441714fae92` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:44.758100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c9806-f414-4d4c-85d6-80b971d4ae96 None admin] RBAC: Authorizing `identity:get_user(user_id=45b791392851439cbebaa441714fae92)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:44.758100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c9806-f414-4d4c-85d6-80b971d4ae96 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:44.759888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 145/287] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:44 2022] GET /identity/v3/users/45b791392851439cbebaa441714fae92 => generated 297 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:44.770529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c9806-f414-4d4c-85d6-80b971d4ae96 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:44.959184 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:44.978329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e635b-e6e7-4c1f-8b67-01f5de23ec14 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:44.983250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c9806-f414-4d4c-85d6-80b971d4ae96 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:45.027455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15f709-3290-465a-ab9f-a1df413787ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:45.028128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15f709-3290-465a-ab9f-a1df413787ce None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:45.028413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15f709-3290-465a-ab9f-a1df413787ce None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:45.028694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15f709-3290-465a-ab9f-a1df413787ce None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:45.030144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15f709-3290-465a-ab9f-a1df413787ce None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:45.031647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15f709-3290-465a-ab9f-a1df413787ce None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:45.033452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 146/288] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:44 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:45.045649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15f709-3290-465a-ab9f-a1df413787ce None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:45.050104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:45.080239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7166efb-aee4-46a0-9374-0b3b389e0f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:45.082764 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7166efb-aee4-46a0-9374-0b3b389e0f0b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:45.083690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7166efb-aee4-46a0-9374-0b3b389e0f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:45.084521 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7166efb-aee4-46a0-9374-0b3b389e0f0b None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:45.086342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7166efb-aee4-46a0-9374-0b3b389e0f0b None admin] RBAC: Adding query filter params (name=member) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:45.087365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7166efb-aee4-46a0-9374-0b3b389e0f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:45.090750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7166efb-aee4-46a0-9374-0b3b389e0f0b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:45.109787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 143/289] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:45.123443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7166efb-aee4-46a0-9374-0b3b389e0f0b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:45.257856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15f709-3290-465a-ab9f-a1df413787ce None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:45.338329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c1507-b4de-4ba4-9cab-ab0293b987c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:45.339925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c1507-b4de-4ba4-9cab-ab0293b987c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:45.340693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c1507-b4de-4ba4-9cab-ab0293b987c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:45.341408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c1507-b4de-4ba4-9cab-ab0293b987c3 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298/users/45b791392851439cbebaa441714fae92/roles/e3703da52f214166b433fe3405753808` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:45.345494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c1507-b4de-4ba4-9cab-ab0293b987c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1f639a220c6483b9d682cc431b14298, user_id=45b791392851439cbebaa441714fae92, role_id=e3703da52f214166b433fe3405753808)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:45.348703 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c1507-b4de-4ba4-9cab-ab0293b987c3 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:45.381012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7166efb-aee4-46a0-9374-0b3b389e0f0b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:45.427238 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a9fe8-7d1f-422d-9c91-f2eb4e30ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:45.427980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a9fe8-7d1f-422d-9c91-f2eb4e30ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:45.428270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a9fe8-7d1f-422d-9c91-f2eb4e30ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:45.428572 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a9fe8-7d1f-422d-9c91-f2eb4e30ffe5 None admin] PATH_INFO: `/v3/users/93a0eb10f3934a7fa1b2688d1882506f` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:45.433106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a9fe8-7d1f-422d-9c91-f2eb4e30ffe5 None admin] RBAC: Authorizing `identity:get_user(user_id=93a0eb10f3934a7fa1b2688d1882506f)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:45.435063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a9fe8-7d1f-422d-9c91-f2eb4e30ffe5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:45.440016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 147/290] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:17:45 2022] PUT /identity/v3/projects/f1f639a220c6483b9d682cc431b14298/users/45b791392851439cbebaa441714fae92/roles/e3703da52f214166b433fe3405753808 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:45.440433 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 144/291] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:45 2022] GET /identity/v3/users/93a0eb10f3934a7fa1b2688d1882506f => generated 297 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:45.449433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c1507-b4de-4ba4-9cab-ab0293b987c3 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:45.493015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:45.694021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c1507-b4de-4ba4-9cab-ab0293b987c3 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:45.761807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be8b6d-b59f-4d61-9f71-5ea7c5c4e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:45.763292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be8b6d-b59f-4d61-9f71-5ea7c5c4e83b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:45.764096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be8b6d-b59f-4d61-9f71-5ea7c5c4e83b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:45.764773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be8b6d-b59f-4d61-9f71-5ea7c5c4e83b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:45.913628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be8b6d-b59f-4d61-9f71-5ea7c5c4e83b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:45.917079 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be8b6d-b59f-4d61-9f71-5ea7c5c4e83b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:45.941288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:46.138015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 148/292] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:46.147024 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a9fe8-7d1f-422d-9c91-f2eb4e30ffe5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:46.302208 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:46.443444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a9fe8-7d1f-422d-9c91-f2eb4e30ffe5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:46.515720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a4e76-2d22-4aec-84c2-e0fe9d8dd5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:46.516401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a4e76-2d22-4aec-84c2-e0fe9d8dd5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:46.516685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a4e76-2d22-4aec-84c2-e0fe9d8dd5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:46.516957 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a4e76-2d22-4aec-84c2-e0fe9d8dd5b5 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:46.519875 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a4e76-2d22-4aec-84c2-e0fe9d8dd5b5 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:46.525765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3a4e76-2d22-4aec-84c2-e0fe9d8dd5b5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:46.525765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 145/293] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:46 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:46.534153 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be8b6d-b59f-4d61-9f71-5ea7c5c4e83b None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:46.691114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be8b6d-b59f-4d61-9f71-5ea7c5c4e83b None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:46.706511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:46.739006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3032a5-5dcd-42e1-866a-157ef1de1bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:46.739627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3032a5-5dcd-42e1-866a-157ef1de1bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:46.739887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3032a5-5dcd-42e1-866a-157ef1de1bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:46.740222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3032a5-5dcd-42e1-866a-157ef1de1bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:46.740982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3032a5-5dcd-42e1-866a-157ef1de1bc9 None admin] RBAC: Adding query filter params (role.id=d27b7d5ab3274b85a416d9f8f7f75648, scope.project.id=f1f639a220c6483b9d682cc431b14298, user.id=93a0eb10f3934a7fa1b2688d1882506f) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:46.741272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3032a5-5dcd-42e1-866a-157ef1de1bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:46.744870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3032a5-5dcd-42e1-866a-157ef1de1bc9 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:46.752586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 149/294] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:46 2022] GET /identity/v3/role_assignments?user.id=93a0eb10f3934a7fa1b2688d1882506f&scope.project.id=f1f639a220c6483b9d682cc431b14298&role.id=d27b7d5ab3274b85a416d9f8f7f75648 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:47.273420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57ceb3-3909-4b7f-aca6-c6706208620d None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:47.273695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57ceb3-3909-4b7f-aca6-c6706208620d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:47.274081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57ceb3-3909-4b7f-aca6-c6706208620d None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:47.276687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 146/295] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:47.283009 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a97e72-9792-4296-aed5-96f1bb1edb98 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:47.283299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a97e72-9792-4296-aed5-96f1bb1edb98 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:47.283611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a97e72-9792-4296-aed5-96f1bb1edb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:47.307942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-04a97e72-9792-4296-aed5-96f1bb1edb98 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:47.309328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-04a97e72-9792-4296-aed5-96f1bb1edb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:47.399744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 150/296] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:47.508432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303cc4e-743b-4f64-b053-17cb6c966036 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:47.509760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303cc4e-743b-4f64-b053-17cb6c966036 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:47.510504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303cc4e-743b-4f64-b053-17cb6c966036 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:47.512642 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 147/297] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:47.521799 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11a42b-e278-4d91-9a6e-82bfc93b9b86 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:47.522452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11a42b-e278-4d91-9a6e-82bfc93b9b86 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:47.522931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11a42b-e278-4d91-9a6e-82bfc93b9b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:47.555867 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-1d11a42b-e278-4d91-9a6e-82bfc93b9b86 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:47.558424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1d11a42b-e278-4d91-9a6e-82bfc93b9b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:47.650728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 151/298] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:47.760911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303cc4e-743b-4f64-b053-17cb6c966036 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:47.895475 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303cc4e-743b-4f64-b053-17cb6c966036 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:47.940806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a739eb-9dbd-4ca2-a6bc-1322908284c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:47.941507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a739eb-9dbd-4ca2-a6bc-1322908284c1 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:47.941989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:47.942507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a739eb-9dbd-4ca2-a6bc-1322908284c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:47.943037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a739eb-9dbd-4ca2-a6bc-1322908284c1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:47.956967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a739eb-9dbd-4ca2-a6bc-1322908284c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-b9a739eb-9dbd-4ca2-a6bc-1322908284c1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:47.963511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:47.964472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:47.965260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:47.965260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:47.965260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:47.965260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:47.965260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:47.965260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:47.965260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:47.965260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:47.965260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:47.965260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:47.965260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:47.965260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:47.967377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 148/299] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:47.975263 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11a42b-e278-4d91-9a6e-82bfc93b9b86 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:48.020184 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:48.051672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc806-76c4-44a4-85dc-052fbc1f257d None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:48.052333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc806-76c4-44a4-85dc-052fbc1f257d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:48.052816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdc806-76c4-44a4-85dc-052fbc1f257d None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:48.056131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 149/300] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:17:48.061288 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89899361-b5c2-4397-a6c1-109d6dc0a67c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:48.061974 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89899361-b5c2-4397-a6c1-109d6dc0a67c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:48.062456 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89899361-b5c2-4397-a6c1-109d6dc0a67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:48.083422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-89899361-b5c2-4397-a6c1-109d6dc0a67c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:48.085049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-89899361-b5c2-4397-a6c1-109d6dc0a67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:48.110709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11a42b-e278-4d91-9a6e-82bfc93b9b86 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:48.159919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1427ac-8f59-443e-89b0-822960fa0093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:48.160560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1427ac-8f59-443e-89b0-822960fa0093 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:48.160846 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1427ac-8f59-443e-89b0-822960fa0093 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:48.161125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1427ac-8f59-443e-89b0-822960fa0093 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:48.161919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1427ac-8f59-443e-89b0-822960fa0093 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:48.162259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1427ac-8f59-443e-89b0-822960fa0093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:48.163774 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1427ac-8f59-443e-89b0-822960fa0093 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:48.175535 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 152/301] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:48.181491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1427ac-8f59-443e-89b0-822960fa0093 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:48.182093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 150/302] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:48.186972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89899361-b5c2-4397-a6c1-109d6dc0a67c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:48.311371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:48.319165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1427ac-8f59-443e-89b0-822960fa0093 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:48.371425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fe943-e0ef-4e12-9667-e9f4f2e5db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:48.372336 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fe943-e0ef-4e12-9667-e9f4f2e5db7a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:48.372768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fe943-e0ef-4e12-9667-e9f4f2e5db7a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:48.373190 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fe943-e0ef-4e12-9667-e9f4f2e5db7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:48.374765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fe943-e0ef-4e12-9667-e9f4f2e5db7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:48.376718 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fe943-e0ef-4e12-9667-e9f4f2e5db7a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:48.379023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 153/303] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:17:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:48.387679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fe943-e0ef-4e12-9667-e9f4f2e5db7a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:48.413942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89899361-b5c2-4397-a6c1-109d6dc0a67c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:48.434357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:48.483373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a50191-2937-4452-870f-5fe5051717e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:48.484367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a50191-2937-4452-870f-5fe5051717e3 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:48.484744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a50191-2937-4452-870f-5fe5051717e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:48.485194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a50191-2937-4452-870f-5fe5051717e3 None admin] PATH_INFO: `/v3/users/74dd5f00516d4984afe73cf426d07fe9` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:48.504160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a50191-2937-4452-870f-5fe5051717e3 None admin] RBAC: Authorizing `identity:get_user(user_id=74dd5f00516d4984afe73cf426d07fe9)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:48.505973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a50191-2937-4452-870f-5fe5051717e3 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:48.507881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 151/304] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:48 2022] GET /identity/v3/users/74dd5f00516d4984afe73cf426d07fe9 => generated 293 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:48.507881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe0ce8-d99a-4714-9671-582a57bc1192 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:48.507881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe0ce8-d99a-4714-9671-582a57bc1192 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:48.507881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe0ce8-d99a-4714-9671-582a57bc1192 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:48.507881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 152/305] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:48.516943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe0ce8-d99a-4714-9671-582a57bc1192 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:48.551460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fe943-e0ef-4e12-9667-e9f4f2e5db7a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:48.605952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4812ab7-aa37-4986-ac16-232925d62e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:48.606654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4812ab7-aa37-4986-ac16-232925d62e4f None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:48.607010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4812ab7-aa37-4986-ac16-232925d62e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:48.607380 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4812ab7-aa37-4986-ac16-232925d62e4f None admin] PATH_INFO: `/v3/groups` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:48.608205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4812ab7-aa37-4986-ac16-232925d62e4f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:48.609846 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4812ab7-aa37-4986-ac16-232925d62e4f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:48.663389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe0ce8-d99a-4714-9671-582a57bc1192 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:48.714355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b7aac-fd99-4c3f-9783-f0b2ec3d9666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:48.715017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7aac-fd99-4c3f-9783-f0b2ec3d9666 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:48.715297 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7aac-fd99-4c3f-9783-f0b2ec3d9666 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:48.715571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b7aac-fd99-4c3f-9783-f0b2ec3d9666 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:48.718046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 154/306] 10.222.0.48 () {60 vars in 1134 bytes} [Thu Sep 1 05:17:48 2022] POST /identity/v3/groups => generated 229 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:48.722999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4812ab7-aa37-4986-ac16-232925d62e4f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:48.733730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b7aac-fd99-4c3f-9783-f0b2ec3d9666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-044b7aac-fd99-4c3f-9783-f0b2ec3d9666 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:48.738998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:48.740699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 153/307] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:48.750614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b5ff5-d71c-4eae-86a4-0e9f84a29516 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:48.751897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b5ff5-d71c-4eae-86a4-0e9f84a29516 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:48.751897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b5ff5-d71c-4eae-86a4-0e9f84a29516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:48.768180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:48.778320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-c27b5ff5-d71c-4eae-86a4-0e9f84a29516 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:48.780621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c27b5ff5-d71c-4eae-86a4-0e9f84a29516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:48.825719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:48.908658 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4812ab7-aa37-4986-ac16-232925d62e4f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:48.925683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 154/308] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:48.926801 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b5ff5-d71c-4eae-86a4-0e9f84a29516 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:48.980367 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072437c7-50fa-40ba-a4b0-020167d91df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:48.981366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072437c7-50fa-40ba-a4b0-020167d91df0 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:48.981699 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072437c7-50fa-40ba-a4b0-020167d91df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:48.981951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072437c7-50fa-40ba-a4b0-020167d91df0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:48.983061 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072437c7-50fa-40ba-a4b0-020167d91df0 None admin] RBAC: Adding query filter params (role.id=e3703da52f214166b433fe3405753808, user.id=74dd5f00516d4984afe73cf426d07fe9, scope.system=all) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:48.983373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072437c7-50fa-40ba-a4b0-020167d91df0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:48.985352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072437c7-50fa-40ba-a4b0-020167d91df0 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:49.001488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 155/309] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Sep 1 05:17:48 2022] GET /identity/v3/role_assignments?user.id=74dd5f00516d4984afe73cf426d07fe9&scope.system=all&role.id=e3703da52f214166b433fe3405753808 => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:49.148765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b5ff5-d71c-4eae-86a4-0e9f84a29516 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:49.216108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072437c7-50fa-40ba-a4b0-020167d91df0 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:49.226872 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9fd13-cc48-4699-9327-9d74386bf836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:49.229137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9fd13-cc48-4699-9327-9d74386bf836 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:49.229757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9fd13-cc48-4699-9327-9d74386bf836 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:49.230259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9fd13-cc48-4699-9327-9d74386bf836 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:49.231594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9fd13-cc48-4699-9327-9d74386bf836 None admin] RBAC: Adding query filter params (name=member) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:49.232146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9fd13-cc48-4699-9327-9d74386bf836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:49.235044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9fd13-cc48-4699-9327-9d74386bf836 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:49.253858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 155/310] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:49.263807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9fd13-cc48-4699-9327-9d74386bf836 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:49.312310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:49.426698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:49.451095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072437c7-50fa-40ba-a4b0-020167d91df0 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:49.500810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9fd13-cc48-4699-9327-9d74386bf836 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:49.524075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457e557-c3b3-4a3d-a245-db64fe753c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:49.525725 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457e557-c3b3-4a3d-a245-db64fe753c66 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:49.526678 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457e557-c3b3-4a3d-a245-db64fe753c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:49.527521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457e557-c3b3-4a3d-a245-db64fe753c66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:49.550582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f457e557-c3b3-4a3d-a245-db64fe753c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-f457e557-c3b3-4a3d-a245-db64fe753c66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:49.562161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:49.563753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:49.565208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:49.565208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:49.565208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:49.565208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:49.565208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:49.565208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:49.565208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:49.565208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:49.565208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:49.565208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:49.565208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:49.565208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:49.569634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 156/311] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:49.578417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457e557-c3b3-4a3d-a245-db64fe753c66 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:49.580806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5e10b-e584-4077-b718-6e0951226ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:49.581954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5e10b-e584-4077-b718-6e0951226ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:49.582433 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5e10b-e584-4077-b718-6e0951226ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:49.582929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b5e10b-e584-4077-b718-6e0951226ce7 None admin] PATH_INFO: `/v3/users/cb6c9202edaa42138f86c7274a9fc9de` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:49.585079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5e10b-e584-4077-b718-6e0951226ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=cb6c9202edaa42138f86c7274a9fc9de)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:49.589893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b5e10b-e584-4077-b718-6e0951226ce7 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:49.598374 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 156/312] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:49 2022] GET /identity/v3/users/cb6c9202edaa42138f86c7274a9fc9de => generated 293 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:49.604326 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5e10b-e584-4077-b718-6e0951226ce7 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:49.808649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:49.814141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457e557-c3b3-4a3d-a245-db64fe753c66 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:49.815992 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b5e10b-e584-4077-b718-6e0951226ce7 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:49.885524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415f517-6a72-42e5-af29-8c8370ac19bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:49.886388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415f517-6a72-42e5-af29-8c8370ac19bd None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:49.886778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415f517-6a72-42e5-af29-8c8370ac19bd None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:49.887338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415f517-6a72-42e5-af29-8c8370ac19bd None admin] PATH_INFO: `/v3/system/users/cb6c9202edaa42138f86c7274a9fc9de/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:49.888430 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde03450-88dd-4803-958f-ebc315819826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:49.889091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415f517-6a72-42e5-af29-8c8370ac19bd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cb6c9202edaa42138f86c7274a9fc9de, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:49.889984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde03450-88dd-4803-958f-ebc315819826 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:49.890719 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde03450-88dd-4803-958f-ebc315819826 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:49.890925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415f517-6a72-42e5-af29-8c8370ac19bd None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:49.891620 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde03450-88dd-4803-958f-ebc315819826 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:49.893635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde03450-88dd-4803-958f-ebc315819826 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:49.894355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde03450-88dd-4803-958f-ebc315819826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:49.898487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde03450-88dd-4803-958f-ebc315819826 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:49.917450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 157/313] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:49.921575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde03450-88dd-4803-958f-ebc315819826 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:49.946838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:50.042541 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 157/314] 10.222.0.48 () {58 vars in 1334 bytes} [Thu Sep 1 05:17:49 2022] PUT /identity/v3/system/users/cb6c9202edaa42138f86c7274a9fc9de/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:17:50.074832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde03450-88dd-4803-958f-ebc315819826 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:50.121806 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead57f14-5d74-4c03-9860-1881c84b3a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:50.122631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead57f14-5d74-4c03-9860-1881c84b3a7f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:50.122920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead57f14-5d74-4c03-9860-1881c84b3a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:50.123196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead57f14-5d74-4c03-9860-1881c84b3a7f None admin] PATH_INFO: `/v3/users/45b791392851439cbebaa441714fae92` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:50.124727 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead57f14-5d74-4c03-9860-1881c84b3a7f None admin] RBAC: Authorizing `identity:get_user(user_id=45b791392851439cbebaa441714fae92)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:50.126691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead57f14-5d74-4c03-9860-1881c84b3a7f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:50.128940 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 158/315] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:49 2022] GET /identity/v3/users/45b791392851439cbebaa441714fae92 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:50.137437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415f517-6a72-42e5-af29-8c8370ac19bd None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:50.288574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415f517-6a72-42e5-af29-8c8370ac19bd None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:50.335087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441b242-030d-4e6d-8241-d714cc7a7f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:50.336419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441b242-030d-4e6d-8241-d714cc7a7f17 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:50.336967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441b242-030d-4e6d-8241-d714cc7a7f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:50.338313 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441b242-030d-4e6d-8241-d714cc7a7f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:50.363299 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:50.428628 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441b242-030d-4e6d-8241-d714cc7a7f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:50.430251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441b242-030d-4e6d-8241-d714cc7a7f17 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:50.583216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 158/316] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:50.594220 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead57f14-5d74-4c03-9860-1881c84b3a7f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:50.765822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:50.800713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead57f14-5d74-4c03-9860-1881c84b3a7f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:50.869910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efbdda-a259-4d48-8e9b-d1f2a9236c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:50.869910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efbdda-a259-4d48-8e9b-d1f2a9236c62 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:50.869910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efbdda-a259-4d48-8e9b-d1f2a9236c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:50.869910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efbdda-a259-4d48-8e9b-d1f2a9236c62 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:50.871160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efbdda-a259-4d48-8e9b-d1f2a9236c62 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:50.871160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efbdda-a259-4d48-8e9b-d1f2a9236c62 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:50.873320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 159/317] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:50 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:50.882520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441b242-030d-4e6d-8241-d714cc7a7f17 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:51.063234 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:51.193493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af0ca6-5d7b-4cd4-9eda-e41cff31ec23 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:51.194319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af0ca6-5d7b-4cd4-9eda-e41cff31ec23 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:51.194815 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af0ca6-5d7b-4cd4-9eda-e41cff31ec23 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:51.197086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 160/318] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:51.203127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16359a6c-23fd-47eb-aacf-06bb74ebc158 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:51.203884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16359a6c-23fd-47eb-aacf-06bb74ebc158 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:51.204447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16359a6c-23fd-47eb-aacf-06bb74ebc158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:51.225626 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441b242-030d-4e6d-8241-d714cc7a7f17 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:51.226998 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-16359a6c-23fd-47eb-aacf-06bb74ebc158 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:51.229211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-16359a6c-23fd-47eb-aacf-06bb74ebc158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:51.322208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 161/319] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:51.324041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6b65a-6169-4c35-a5f2-2d564503b8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:51.324795 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6b65a-6169-4c35-a5f2-2d564503b8fa None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:51.325088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6b65a-6169-4c35-a5f2-2d564503b8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:51.325468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6b65a-6169-4c35-a5f2-2d564503b8fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:51.326323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6b65a-6169-4c35-a5f2-2d564503b8fa None admin] RBAC: Adding query filter params (role.id=e3703da52f214166b433fe3405753808, scope.project.id=f1f639a220c6483b9d682cc431b14298, user.id=45b791392851439cbebaa441714fae92) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:51.326708 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6b65a-6169-4c35-a5f2-2d564503b8fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:51.328325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6b65a-6169-4c35-a5f2-2d564503b8fa None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:51.359818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 159/320] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:17:50 2022] GET /identity/v3/role_assignments?user.id=45b791392851439cbebaa441714fae92&scope.project.id=f1f639a220c6483b9d682cc431b14298&role.id=e3703da52f214166b433fe3405753808 => generated 608 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:51.611078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16359a6c-23fd-47eb-aacf-06bb74ebc158 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:51.717273 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:51.757190 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16359a6c-23fd-47eb-aacf-06bb74ebc158 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:51.807550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aaba6c-b476-4bda-9df6-5a45a379b16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:51.808266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaba6c-b476-4bda-9df6-5a45a379b16c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:51.808574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaba6c-b476-4bda-9df6-5a45a379b16c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:51.808877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaba6c-b476-4bda-9df6-5a45a379b16c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:51.810106 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aaba6c-b476-4bda-9df6-5a45a379b16c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:51.811585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aaba6c-b476-4bda-9df6-5a45a379b16c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:51.818216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 162/321] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:17:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:51.819676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6b65a-6169-4c35-a5f2-2d564503b8fa None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:51.977121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6b65a-6169-4c35-a5f2-2d564503b8fa None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:51.996755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:52.023870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a7ad5-63ad-4aa2-ab84-3403c48fdaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:52.024563 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a7ad5-63ad-4aa2-ab84-3403c48fdaae None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:52.024845 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a7ad5-63ad-4aa2-ab84-3403c48fdaae None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:52.025121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a7ad5-63ad-4aa2-ab84-3403c48fdaae None admin] PATH_INFO: `/v3/groups` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:52.025826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a7ad5-63ad-4aa2-ab84-3403c48fdaae None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:52.027607 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a7ad5-63ad-4aa2-ab84-3403c48fdaae None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:52.137515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4332a1-9fae-4f85-8d45-4b8704f26c90 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:52.138341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4332a1-9fae-4f85-8d45-4b8704f26c90 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:52.138492 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4332a1-9fae-4f85-8d45-4b8704f26c90 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:52.140116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 163/322] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:17:52.147090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48256d-c060-44f3-9dea-4a534eb294b1 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:52.147538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48256d-c060-44f3-9dea-4a534eb294b1 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:52.147996 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f48256d-c060-44f3-9dea-4a534eb294b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:52.156356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 160/323] 10.222.0.48 () {60 vars in 1134 bytes} [Thu Sep 1 05:17:51 2022] POST /identity/v3/groups => generated 226 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:17:52.175411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5f48256d-c060-44f3-9dea-4a534eb294b1 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:52.176836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5f48256d-c060-44f3-9dea-4a534eb294b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:52.286215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 164/324] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:52.574249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a7ad5-63ad-4aa2-ab84-3403c48fdaae None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:52.599427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2ecb-968d-4b34-a5ed-1731f3504df5 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:52.599821 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2ecb-968d-4b34-a5ed-1731f3504df5 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:52.600012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2ecb-968d-4b34-a5ed-1731f3504df5 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:52.602004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 165/325] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:17:52.608254 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc12eb-ecda-4db8-98ff-d19f9738f16a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:52.608649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc12eb-ecda-4db8-98ff-d19f9738f16a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:52.608793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc12eb-ecda-4db8-98ff-d19f9738f16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:52.629662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-d6bc12eb-ecda-4db8-98ff-d19f9738f16a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:52.631106 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d6bc12eb-ecda-4db8-98ff-d19f9738f16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:52.725047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 166/326] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:17:52.790396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a7ad5-63ad-4aa2-ab84-3403c48fdaae None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:52.861120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc286454-bcca-4b4d-a64e-de583832ed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:52.862310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc286454-bcca-4b4d-a64e-de583832ed1e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:52.862766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc286454-bcca-4b4d-a64e-de583832ed1e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:52.863248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc286454-bcca-4b4d-a64e-de583832ed1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:52.885580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc286454-bcca-4b4d-a64e-de583832ed1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-fc286454-bcca-4b4d-a64e-de583832ed1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:52.901413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:52.903180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:52.904749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 161/327] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:52.906915 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc12eb-ecda-4db8-98ff-d19f9738f16a None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:52.915562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:53.058992 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc286454-bcca-4b4d-a64e-de583832ed1e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:53.108245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:53.123777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc12eb-ecda-4db8-98ff-d19f9738f16a None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:53.171372 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51ac42-a92e-4a32-ba6c-f6b08f289e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:53.172014 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51ac42-a92e-4a32-ba6c-f6b08f289e73 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:53.172278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51ac42-a92e-4a32-ba6c-f6b08f289e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:53.172556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51ac42-a92e-4a32-ba6c-f6b08f289e73 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:53.173263 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51ac42-a92e-4a32-ba6c-f6b08f289e73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:53.174519 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51ac42-a92e-4a32-ba6c-f6b08f289e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:53.176065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51ac42-a92e-4a32-ba6c-f6b08f289e73 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:53.189016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 167/328] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:53.194954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51ac42-a92e-4a32-ba6c-f6b08f289e73 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:53.213453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc286454-bcca-4b4d-a64e-de583832ed1e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:53.275789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb181f7d-174c-4945-bafd-3eb7d6f12218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:53.276816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb181f7d-174c-4945-bafd-3eb7d6f12218 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:53.277351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb181f7d-174c-4945-bafd-3eb7d6f12218 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:53.278545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb181f7d-174c-4945-bafd-3eb7d6f12218 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:53.297956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb181f7d-174c-4945-bafd-3eb7d6f12218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-eb181f7d-174c-4945-bafd-3eb7d6f12218 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:53.306060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:53.307023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:53.307862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:53.307862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:53.307862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:53.307862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:53.307862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:53.307862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:53.307862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:53.307862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:53.307862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:53.307862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:53.307862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:53.307862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:53.309069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:53.312052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 162/329] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:53.318731 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb181f7d-174c-4945-bafd-3eb7d6f12218 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:53.356813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51ac42-a92e-4a32-ba6c-f6b08f289e73 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:53.407479 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b2aaa-202a-45c2-b10e-4dc9c6cd80da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:53.408329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b2aaa-202a-45c2-b10e-4dc9c6cd80da None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:53.408837 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b2aaa-202a-45c2-b10e-4dc9c6cd80da None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:53.409311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b2aaa-202a-45c2-b10e-4dc9c6cd80da None admin] PATH_INFO: `/v3/users/74dd5f00516d4984afe73cf426d07fe9` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:53.411091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b2aaa-202a-45c2-b10e-4dc9c6cd80da None admin] RBAC: Authorizing `identity:get_user(user_id=74dd5f00516d4984afe73cf426d07fe9)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:53.412836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b2aaa-202a-45c2-b10e-4dc9c6cd80da None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:53.416204 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 168/330] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:53 2022] GET /identity/v3/users/74dd5f00516d4984afe73cf426d07fe9 => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:53.423375 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b2aaa-202a-45c2-b10e-4dc9c6cd80da None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:53.458891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:53.469234 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb181f7d-174c-4945-bafd-3eb7d6f12218 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:53.519338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc96de5-1661-484b-8472-203997845296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:53.520319 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc96de5-1661-484b-8472-203997845296 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:53.520751 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc96de5-1661-484b-8472-203997845296 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:53.521188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc96de5-1661-484b-8472-203997845296 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:53.526237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc96de5-1661-484b-8472-203997845296 None admin] RBAC: Adding query filter params (name=member) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:53.526799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc96de5-1661-484b-8472-203997845296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:53.528574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc96de5-1661-484b-8472-203997845296 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:53.546659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 163/331] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:53.552982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc96de5-1661-484b-8472-203997845296 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:53.667016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b2aaa-202a-45c2-b10e-4dc9c6cd80da None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:53.757210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc96de5-1661-484b-8472-203997845296 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:53.758161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016ed01-4f1c-416b-ba1f-cd3667c9c24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:53.759288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016ed01-4f1c-416b-ba1f-cd3667c9c24b None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:53.759582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016ed01-4f1c-416b-ba1f-cd3667c9c24b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:53.760122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016ed01-4f1c-416b-ba1f-cd3667c9c24b None admin] PATH_INFO: `/v3/system/users/74dd5f00516d4984afe73cf426d07fe9/roles/e3703da52f214166b433fe3405753808` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:53.761835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016ed01-4f1c-416b-ba1f-cd3667c9c24b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=74dd5f00516d4984afe73cf426d07fe9, role_id=e3703da52f214166b433fe3405753808)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:53.763288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016ed01-4f1c-416b-ba1f-cd3667c9c24b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:53.765171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:53.834414 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34617f-8642-4d3a-ab11-d824e266e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:53.835111 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34617f-8642-4d3a-ab11-d824e266e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:53.835400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34617f-8642-4d3a-ab11-d824e266e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:53.835679 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f34617f-8642-4d3a-ab11-d824e266e3e0 None admin] PATH_INFO: `/v3/users/cb6c9202edaa42138f86c7274a9fc9de` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:53.837944 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34617f-8642-4d3a-ab11-d824e266e3e0 None admin] RBAC: Authorizing `identity:get_user(user_id=cb6c9202edaa42138f86c7274a9fc9de)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:53.840373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f34617f-8642-4d3a-ab11-d824e266e3e0 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:53.843691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 164/332] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:17:53 2022] GET /identity/v3/users/cb6c9202edaa42138f86c7274a9fc9de => generated 293 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:53.850884 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34617f-8642-4d3a-ab11-d824e266e3e0 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:53.866462 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 169/333] 10.222.0.48 () {58 vars in 1334 bytes} [Thu Sep 1 05:17:53 2022] PUT /identity/v3/system/users/74dd5f00516d4984afe73cf426d07fe9/roles/e3703da52f214166b433fe3405753808 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:53.893239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:54.040787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f34617f-8642-4d3a-ab11-d824e266e3e0 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:54.114189 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994d825-b623-4f81-9fd7-d983abd645a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:54.114871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994d825-b623-4f81-9fd7-d983abd645a7 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:54.115163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994d825-b623-4f81-9fd7-d983abd645a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:54.115441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994d825-b623-4f81-9fd7-d983abd645a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:54.116223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994d825-b623-4f81-9fd7-d983abd645a7 None admin] RBAC: Adding query filter params (role.id=d27b7d5ab3274b85a416d9f8f7f75648, user.id=cb6c9202edaa42138f86c7274a9fc9de, scope.system=all) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:54.116535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994d825-b623-4f81-9fd7-d983abd645a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:54.118733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994d825-b623-4f81-9fd7-d983abd645a7 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:54.143155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 165/334] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Sep 1 05:17:53 2022] GET /identity/v3/role_assignments?user.id=cb6c9202edaa42138f86c7274a9fc9de&scope.system=all&role.id=d27b7d5ab3274b85a416d9f8f7f75648 => generated 510 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:56.159046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d9ee-8ded-4959-af9e-bf0c3ccdbf1e None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:56.160122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d9ee-8ded-4959-af9e-bf0c3ccdbf1e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:56.160122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64d9ee-8ded-4959-af9e-bf0c3ccdbf1e None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:56.161420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 170/335] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:56.175084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ebf09-186f-4e9f-9615-938cfb655459 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:56.176009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ebf09-186f-4e9f-9615-938cfb655459 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:56.176009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ebf09-186f-4e9f-9615-938cfb655459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:56.202729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-534ebf09-186f-4e9f-9615-938cfb655459 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:56.204105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-534ebf09-186f-4e9f-9615-938cfb655459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:56.311171 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 166/336] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:56.454577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028d476-d7d1-43ce-8ede-f9d53ec81432 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:56.454994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028d476-d7d1-43ce-8ede-f9d53ec81432 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:56.454994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028d476-d7d1-43ce-8ede-f9d53ec81432 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:56.457105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 171/337] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:17:56.468195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953dea7-dfcc-4922-8783-9d5b7bc5a1d1 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:56.468610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953dea7-dfcc-4922-8783-9d5b7bc5a1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:56.468830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953dea7-dfcc-4922-8783-9d5b7bc5a1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:56.496410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-5953dea7-dfcc-4922-8783-9d5b7bc5a1d1 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:56.497739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5953dea7-dfcc-4922-8783-9d5b7bc5a1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:56.522970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:56.597727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 167/338] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:56.787567 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028d476-d7d1-43ce-8ede-f9d53ec81432 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:56.921617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028d476-d7d1-43ce-8ede-f9d53ec81432 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:56.968658 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db536c89-4ed3-49d2-8104-51c03a99a438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:56.969751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db536c89-4ed3-49d2-8104-51c03a99a438 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:56.970287 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db536c89-4ed3-49d2-8104-51c03a99a438 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:56.970760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db536c89-4ed3-49d2-8104-51c03a99a438 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:56.983625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db536c89-4ed3-49d2-8104-51c03a99a438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-db536c89-4ed3-49d2-8104-51c03a99a438 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:56.989869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:56.990863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:56.991655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:56.991655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:56.991655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:56.991655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:56.991655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:56.991655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:56.991655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:56.991655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:56.991655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:56.991655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:56.991655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:56.991655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:56.995138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 172/339] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:57.001459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953dea7-dfcc-4922-8783-9d5b7bc5a1d1 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:57.182168 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953dea7-dfcc-4922-8783-9d5b7bc5a1d1 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:57.230347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e49f7-767a-4060-8835-a68564abee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:57.231001 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e49f7-767a-4060-8835-a68564abee85 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:57.231286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e49f7-767a-4060-8835-a68564abee85 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:57.231564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e49f7-767a-4060-8835-a68564abee85 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:57.232259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e49f7-767a-4060-8835-a68564abee85 None admin] RBAC: Adding query filter params (name=member) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:57.232564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e49f7-767a-4060-8835-a68564abee85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:57.234085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e49f7-767a-4060-8835-a68564abee85 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:57.245883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 168/340] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:57.252004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db536c89-4ed3-49d2-8104-51c03a99a438 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:57.266154 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e49f7-767a-4060-8835-a68564abee85 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:57.270716 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:57.351678 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:57.431304 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db536c89-4ed3-49d2-8104-51c03a99a438 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:57.446232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e49f7-767a-4060-8835-a68564abee85 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:57.491948 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fb763-caa5-4845-8a06-40270c8953d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:57.493322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fb763-caa5-4845-8a06-40270c8953d3 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:57.503495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fb763-caa5-4845-8a06-40270c8953d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:57.503495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fb763-caa5-4845-8a06-40270c8953d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:57.503723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f037e8-6c6b-4362-bc7b-757bccf23327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:57.503723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f037e8-6c6b-4362-bc7b-757bccf23327 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:57.503723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f037e8-6c6b-4362-bc7b-757bccf23327 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:57.503723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f037e8-6c6b-4362-bc7b-757bccf23327 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:57.509720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fb763-caa5-4845-8a06-40270c8953d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-bc8fb763-caa5-4845-8a06-40270c8953d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:57.515847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:57.516945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:57.517842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:57.517842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:57.517842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:57.517842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:57.517842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:57.517842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:57.517842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:57.517842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:57.517842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:57.517842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:57.517842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:57.517842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:57.519811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 169/341] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:17:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:17:57.521284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ce442-e8a9-46a3-a71b-cabb8f4195b5 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:57.521753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ce442-e8a9-46a3-a71b-cabb8f4195b5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:57.522175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ce442-e8a9-46a3-a71b-cabb8f4195b5 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:57.523690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 170/342] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:57.531426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ce442-e8a9-46a3-a71b-cabb8f4195b5 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:57.689571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f037e8-6c6b-4362-bc7b-757bccf23327 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:57.691111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f037e8-6c6b-4362-bc7b-757bccf23327 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:57.740887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:57.771156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:57.812056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ce442-e8a9-46a3-a71b-cabb8f4195b5 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:57.869906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad01306-b01d-4509-8cc3-b9f73ead40de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:57.870848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad01306-b01d-4509-8cc3-b9f73ead40de None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:57.871224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad01306-b01d-4509-8cc3-b9f73ead40de None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:57.871571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad01306-b01d-4509-8cc3-b9f73ead40de None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:57.872358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad01306-b01d-4509-8cc3-b9f73ead40de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:57.872739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad01306-b01d-4509-8cc3-b9f73ead40de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:57.876386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad01306-b01d-4509-8cc3-b9f73ead40de None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:57.885861 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 173/343] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:57.889446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704fec6-f42e-445e-b33c-7adbdbd82078 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:57.890308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704fec6-f42e-445e-b33c-7adbdbd82078 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:57.891006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704fec6-f42e-445e-b33c-7adbdbd82078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:57.904148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 171/344] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:17:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:17:57.905596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88b0b6-4df6-4233-ad8c-cd0b878b162d None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:57.905919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88b0b6-4df6-4233-ad8c-cd0b878b162d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:57.906276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88b0b6-4df6-4233-ad8c-cd0b878b162d None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:57.907857 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 172/345] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:57.908767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88b0b6-4df6-4233-ad8c-cd0b878b162d None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:57.937701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-9704fec6-f42e-445e-b33c-7adbdbd82078 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:57.940363 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9704fec6-f42e-445e-b33c-7adbdbd82078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:58.097765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 174/346] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:58.100692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577300ff-8684-446c-91ab-103eee5067e6 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:58.101603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577300ff-8684-446c-91ab-103eee5067e6 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:58.102908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577300ff-8684-446c-91ab-103eee5067e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:58.139896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-577300ff-8684-446c-91ab-103eee5067e6 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:58.142662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-577300ff-8684-446c-91ab-103eee5067e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:58.143406 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88b0b6-4df6-4233-ad8c-cd0b878b162d None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:58.216528 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:58.219498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee4ba2-afd2-461a-af78-815ab398304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:58.221029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee4ba2-afd2-461a-af78-815ab398304e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:58.221709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee4ba2-afd2-461a-af78-815ab398304e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:58.222321 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee4ba2-afd2-461a-af78-815ab398304e None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:58.225498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee4ba2-afd2-461a-af78-815ab398304e None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:58.236360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee4ba2-afd2-461a-af78-815ab398304e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:58.236360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 173/347] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:57 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:58.236360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee4ba2-afd2-461a-af78-815ab398304e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:58.297951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 175/348] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:58.301473 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324998d-f1e7-41cf-a400-fb9007949075 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:58.302261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324998d-f1e7-41cf-a400-fb9007949075 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:58.303038 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324998d-f1e7-41cf-a400-fb9007949075 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:58.306471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 176/349] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:58.308378 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324998d-f1e7-41cf-a400-fb9007949075 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:58.337621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:58.442837 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324998d-f1e7-41cf-a400-fb9007949075 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:58.466676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee4ba2-afd2-461a-af78-815ab398304e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:58.488773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4710ab6-f4ab-4b67-a804-8c5b86438cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:58.489748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4710ab6-f4ab-4b67-a804-8c5b86438cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:58.490174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4710ab6-f4ab-4b67-a804-8c5b86438cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:58.490917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4710ab6-f4ab-4b67-a804-8c5b86438cf0 None admin] PATH_INFO: `/v3/groups/2868dca5fdc847f2a33b07611f47775b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:58.501764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4710ab6-f4ab-4b67-a804-8c5b86438cf0 None admin] RBAC: Authorizing `identity:get_group(group_id=2868dca5fdc847f2a33b07611f47775b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:58.504505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4710ab6-f4ab-4b67-a804-8c5b86438cf0 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:58.508469 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 177/350] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:17:58 2022] GET /identity/v3/groups/2868dca5fdc847f2a33b07611f47775b => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:58.510347 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4d207-0998-43f1-a54e-04c48b2d8e29 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:58.510813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4d207-0998-43f1-a54e-04c48b2d8e29 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:58.511283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4d207-0998-43f1-a54e-04c48b2d8e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:58.528750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa8b32-1e8c-40f4-b086-cd88baf79303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:58.529421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa8b32-1e8c-40f4-b086-cd88baf79303 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:58.530613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa8b32-1e8c-40f4-b086-cd88baf79303 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:58.530613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa8b32-1e8c-40f4-b086-cd88baf79303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:58.546618 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-0cc4d207-0998-43f1-a54e-04c48b2d8e29 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:58.548710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0cc4d207-0998-43f1-a54e-04c48b2d8e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:58.638034 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:58.646728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa8b32-1e8c-40f4-b086-cd88baf79303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:58.648541 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fa8b32-1e8c-40f4-b086-cd88baf79303 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:58.656679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 178/351] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:58.658927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960d59c-3294-4218-9e18-0b5c9d6f2526 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:58.659502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960d59c-3294-4218-9e18-0b5c9d6f2526 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:58.659989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960d59c-3294-4218-9e18-0b5c9d6f2526 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:58.662829 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 179/352] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:17:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:17:58.664864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960d59c-3294-4218-9e18-0b5c9d6f2526 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:58.690745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:58.771826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 174/353] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:17:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:17:58.772648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa8b32-1e8c-40f4-b086-cd88baf79303 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:58.828154 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960d59c-3294-4218-9e18-0b5c9d6f2526 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:58.874073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f5de9-b709-4663-abc7-788c6b8b4bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:58.875198 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f5de9-b709-4663-abc7-788c6b8b4bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:58.875700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f5de9-b709-4663-abc7-788c6b8b4bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:58.876229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f5de9-b709-4663-abc7-788c6b8b4bf4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:58.891174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f5de9-b709-4663-abc7-788c6b8b4bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-ce8f5de9-b709-4663-abc7-788c6b8b4bf4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:58.896833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:58.897895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:58.898897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:58.898897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:58.898897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:58.898897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:58.898897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:58.898897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:58.898897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:58.898897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:58.898897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:58.898897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:58.898897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:17:58.898897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:17:58.902433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 180/354] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:17:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:58.904088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daba5ae-6e3e-404a-9c35-3cf903257cc0 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:58.904664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daba5ae-6e3e-404a-9c35-3cf903257cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:58.905157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daba5ae-6e3e-404a-9c35-3cf903257cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:58.927400 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-3daba5ae-6e3e-404a-9c35-3cf903257cc0 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:58.929134 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3daba5ae-6e3e-404a-9c35-3cf903257cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:58.958109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:58.974833 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa8b32-1e8c-40f4-b086-cd88baf79303 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:59.037919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 181/355] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:17:59.038158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daba5ae-6e3e-404a-9c35-3cf903257cc0 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:59.041665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:59.046049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004157f5-5552-422b-a36d-afe1ba92f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:59.047250 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004157f5-5552-422b-a36d-afe1ba92f5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:59.047854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004157f5-5552-422b-a36d-afe1ba92f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:59.048423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004157f5-5552-422b-a36d-afe1ba92f5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:59.049998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004157f5-5552-422b-a36d-afe1ba92f5e4 None admin] RBAC: Adding query filter params (group.id=2868dca5fdc847f2a33b07611f47775b, role.id=d27b7d5ab3274b85a416d9f8f7f75648, scope.project.id=82a264f4d0584bc8bcd438643dbbb167) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:59.054408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004157f5-5552-422b-a36d-afe1ba92f5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:59.054408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004157f5-5552-422b-a36d-afe1ba92f5e4 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:59.069679 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 175/356] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Sep 1 05:17:58 2022] GET /identity/v3/role_assignments?group.id=2868dca5fdc847f2a33b07611f47775b&scope.project.id=82a264f4d0584bc8bcd438643dbbb167&role.id=d27b7d5ab3274b85a416d9f8f7f75648 => generated 260 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:59.071391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004157f5-5552-422b-a36d-afe1ba92f5e4 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:59.301121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daba5ae-6e3e-404a-9c35-3cf903257cc0 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:59.349465 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004157f5-5552-422b-a36d-afe1ba92f5e4 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:59.366475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01e347-72e0-4cbd-90e5-2712a7feb7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:59.367123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e347-72e0-4cbd-90e5-2712a7feb7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:59.367420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e347-72e0-4cbd-90e5-2712a7feb7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:59.367732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01e347-72e0-4cbd-90e5-2712a7feb7f5 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:59.369627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01e347-72e0-4cbd-90e5-2712a7feb7f5 None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:59.371128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01e347-72e0-4cbd-90e5-2712a7feb7f5 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:59.373150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 182/357] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:17:59 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:59.375761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01e347-72e0-4cbd-90e5-2712a7feb7f5 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:59.434627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a3528-58ef-4c59-b9f8-f29ee518c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:59.436323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a3528-58ef-4c59-b9f8-f29ee518c4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:59.437111 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a3528-58ef-4c59-b9f8-f29ee518c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:59.437899 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a3528-58ef-4c59-b9f8-f29ee518c4d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:59.462340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a3528-58ef-4c59-b9f8-f29ee518c4d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-ca2a3528-58ef-4c59-b9f8-f29ee518c4d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:59.472868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:59.474673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:59.476237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:59.476237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:59.476237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:59.476237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:59.476237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:59.476237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:59.476237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:59.476237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:59.476237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:59.476237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:59.476237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:17:59.476237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:59.481985 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 176/358] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:59.483826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a3528-58ef-4c59-b9f8-f29ee518c4d0 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:59.530685 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:59.537826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:59.589286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01e347-72e0-4cbd-90e5-2712a7feb7f5 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:59.654491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff706caa-2174-4fcd-b109-cd11a2de68e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:59.655310 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff706caa-2174-4fcd-b109-cd11a2de68e0 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:59.655722 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff706caa-2174-4fcd-b109-cd11a2de68e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:59.656129 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff706caa-2174-4fcd-b109-cd11a2de68e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:59.657225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff706caa-2174-4fcd-b109-cd11a2de68e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:59.657761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff706caa-2174-4fcd-b109-cd11a2de68e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:59.660167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff706caa-2174-4fcd-b109-cd11a2de68e0 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:59.676046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 183/359] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:17:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:59.681874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff706caa-2174-4fcd-b109-cd11a2de68e0 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:59.695676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a3528-58ef-4c59-b9f8-f29ee518c4d0 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:59.765323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff7eb-2ffd-4969-9ead-67ea29d1649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:59.766108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff7eb-2ffd-4969-9ead-67ea29d1649d None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:59.766403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff7eb-2ffd-4969-9ead-67ea29d1649d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:59.766678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffff7eb-2ffd-4969-9ead-67ea29d1649d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:59.782043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffff7eb-2ffd-4969-9ead-67ea29d1649d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-fffff7eb-2ffd-4969-9ead-67ea29d1649d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:17:59.787785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:17:59.788773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:17:59.789677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 177/360] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:17:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:17:59.791551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff7eb-2ffd-4969-9ead-67ea29d1649d None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:59.891039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff706caa-2174-4fcd-b109-cd11a2de68e0 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:59.944788 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:59.949497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:59.952333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66542ea7-572c-4794-a506-d138bba655b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:59.964862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66542ea7-572c-4794-a506-d138bba655b5 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:59.964862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66542ea7-572c-4794-a506-d138bba655b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:59.964862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66542ea7-572c-4794-a506-d138bba655b5 None admin] PATH_INFO: `/v3/groups/2868dca5fdc847f2a33b07611f47775b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:59.964862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66542ea7-572c-4794-a506-d138bba655b5 None admin] RBAC: Authorizing `identity:get_group(group_id=2868dca5fdc847f2a33b07611f47775b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:59.964862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66542ea7-572c-4794-a506-d138bba655b5 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:59.964862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 184/361] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:17:59 2022] GET /identity/v3/groups/2868dca5fdc847f2a33b07611f47775b => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:59.965307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66542ea7-572c-4794-a506-d138bba655b5 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:59.987669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffff7eb-2ffd-4969-9ead-67ea29d1649d None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:00.046285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bbcb5-06fb-47a2-8e70-6c6dde959066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:00.047377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bbcb5-06fb-47a2-8e70-6c6dde959066 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:00.048126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bbcb5-06fb-47a2-8e70-6c6dde959066 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:00.048623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bbcb5-06fb-47a2-8e70-6c6dde959066 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:00.050159 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bbcb5-06fb-47a2-8e70-6c6dde959066 None admin] RBAC: Adding query filter params (name=member) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:00.050713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bbcb5-06fb-47a2-8e70-6c6dde959066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:00.052397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bbcb5-06fb-47a2-8e70-6c6dde959066 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:00.067859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 178/362] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:17:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:00.068600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bbcb5-06fb-47a2-8e70-6c6dde959066 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:00.114028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66542ea7-572c-4794-a506-d138bba655b5 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:00.166638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e65dd-88a2-42fe-9122-30641814263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:00.167701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e65dd-88a2-42fe-9122-30641814263a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:00.168222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e65dd-88a2-42fe-9122-30641814263a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:00.168780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e65dd-88a2-42fe-9122-30641814263a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:00.186645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e65dd-88a2-42fe-9122-30641814263a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-ea5e65dd-88a2-42fe-9122-30641814263a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:00.198135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:00.199200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:00.200037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:00.200037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:00.200037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:00.200037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:00.200037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:00.200037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:00.200037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:00.200037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:00.200037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:00.200037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:00.200037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:18:00.200037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:00.200668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 185/363] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:17:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:00.203566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e65dd-88a2-42fe-9122-30641814263a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:00.301549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:00.308041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bbcb5-06fb-47a2-8e70-6c6dde959066 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:00.379830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e45e42-b096-40e3-9b7c-76dc9544feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:00.380905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e45e42-b096-40e3-9b7c-76dc9544feea None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:00.381666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e45e42-b096-40e3-9b7c-76dc9544feea None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:00.382183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e45e42-b096-40e3-9b7c-76dc9544feea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:00.395666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e65dd-88a2-42fe-9122-30641814263a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:00.403423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:00.479936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b1c40-3404-42de-9ed2-31fcdb3dde6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:00.481159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b1c40-3404-42de-9ed2-31fcdb3dde6a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:00.481678 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b1c40-3404-42de-9ed2-31fcdb3dde6a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:00.482177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b1c40-3404-42de-9ed2-31fcdb3dde6a None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:00.483448 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b1c40-3404-42de-9ed2-31fcdb3dde6a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:00.483999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b1c40-3404-42de-9ed2-31fcdb3dde6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:00.490425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b1c40-3404-42de-9ed2-31fcdb3dde6a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:00.507711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 186/364] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:18:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:00.509497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b1c40-3404-42de-9ed2-31fcdb3dde6a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:00.515051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e45e42-b096-40e3-9b7c-76dc9544feea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:00.516662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e45e42-b096-40e3-9b7c-76dc9544feea None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:00.684531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b1c40-3404-42de-9ed2-31fcdb3dde6a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:00.713890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 179/365] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:00.715275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e45e42-b096-40e3-9b7c-76dc9544feea None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:00.722740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:00.741910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abfaf7-fcc4-49e3-9a78-2f18a6bf3ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:00.742239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abfaf7-fcc4-49e3-9a78-2f18a6bf3ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:00.742953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abfaf7-fcc4-49e3-9a78-2f18a6bf3ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:00.743264 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abfaf7-fcc4-49e3-9a78-2f18a6bf3ce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:00.744338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abfaf7-fcc4-49e3-9a78-2f18a6bf3ce1 None admin] RBAC: Adding query filter params (group.id=2868dca5fdc847f2a33b07611f47775b, role.id=5183ce055fde4522816e3cdce43ed4e9, scope.project.id=82a264f4d0584bc8bcd438643dbbb167) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:00.744662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abfaf7-fcc4-49e3-9a78-2f18a6bf3ce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:00.746350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abfaf7-fcc4-49e3-9a78-2f18a6bf3ce1 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:00.757510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 187/366] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Sep 1 05:18:00 2022] GET /identity/v3/role_assignments?group.id=2868dca5fdc847f2a33b07611f47775b&scope.project.id=82a264f4d0584bc8bcd438643dbbb167&role.id=5183ce055fde4522816e3cdce43ed4e9 => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:00.759591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abfaf7-fcc4-49e3-9a78-2f18a6bf3ce1 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:00.839894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:00.996911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e45e42-b096-40e3-9b7c-76dc9544feea None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:00.997195 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abfaf7-fcc4-49e3-9a78-2f18a6bf3ce1 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:01.074155 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37798c0-cba6-4884-9b77-c0971bd96a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:01.075099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37798c0-cba6-4884-9b77-c0971bd96a21 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:01.075480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37798c0-cba6-4884-9b77-c0971bd96a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:01.075887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37798c0-cba6-4884-9b77-c0971bd96a21 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:01.076690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37798c0-cba6-4884-9b77-c0971bd96a21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:01.077103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37798c0-cba6-4884-9b77-c0971bd96a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:01.078916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37798c0-cba6-4884-9b77-c0971bd96a21 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:01.079818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d7beb-1580-46f8-ac28-88328d4e0a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:01.081130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d7beb-1580-46f8-ac28-88328d4e0a18 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:01.081696 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d7beb-1580-46f8-ac28-88328d4e0a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:01.082358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d7beb-1580-46f8-ac28-88328d4e0a18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:01.091251 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 188/367] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:01.092302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37798c0-cba6-4884-9b77-c0971bd96a21 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:01.171460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:01.249424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d7beb-1580-46f8-ac28-88328d4e0a18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:01.251551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d7beb-1580-46f8-ac28-88328d4e0a18 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:01.260465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37798c0-cba6-4884-9b77-c0971bd96a21 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:01.308814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:01.354684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d469c4e-3efc-4bb2-b878-10b32b57a39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:01.355714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d469c4e-3efc-4bb2-b878-10b32b57a39f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:01.356227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d469c4e-3efc-4bb2-b878-10b32b57a39f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:01.356946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d469c4e-3efc-4bb2-b878-10b32b57a39f None admin] PATH_INFO: `/v3/users/74dd5f00516d4984afe73cf426d07fe9` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:01.359104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d469c4e-3efc-4bb2-b878-10b32b57a39f None admin] RBAC: Authorizing `identity:get_user(user_id=74dd5f00516d4984afe73cf426d07fe9)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:01.361932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d469c4e-3efc-4bb2-b878-10b32b57a39f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:01.371676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 189/368] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:18:01 2022] GET /identity/v3/users/74dd5f00516d4984afe73cf426d07fe9 => generated 293 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:01.371676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d469c4e-3efc-4bb2-b878-10b32b57a39f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:01.394740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 180/369] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:01.396535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d7beb-1580-46f8-ac28-88328d4e0a18 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:01.530148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d7beb-1580-46f8-ac28-88328d4e0a18 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:01.574689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f9d48-4cce-442a-901b-cc6b155c64bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:01.576667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f9d48-4cce-442a-901b-cc6b155c64bb None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:01.577239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f9d48-4cce-442a-901b-cc6b155c64bb None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:01.577849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f9d48-4cce-442a-901b-cc6b155c64bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:01.592179 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:01.605711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d469c4e-3efc-4bb2-b878-10b32b57a39f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:01.641436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:01.663586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc470e-77d9-4f23-81c0-453d2b4bd218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:01.664792 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc470e-77d9-4f23-81c0-453d2b4bd218 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:01.665887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc470e-77d9-4f23-81c0-453d2b4bd218 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:01.666153 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc470e-77d9-4f23-81c0-453d2b4bd218 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:01.667409 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc470e-77d9-4f23-81c0-453d2b4bd218 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:01.668905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fc470e-77d9-4f23-81c0-453d2b4bd218 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:01.670853 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 190/370] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:01 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:01.672242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc470e-77d9-4f23-81c0-453d2b4bd218 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:01.673805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f9d48-4cce-442a-901b-cc6b155c64bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:01.676556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f9d48-4cce-442a-901b-cc6b155c64bb None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:01.796755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc470e-77d9-4f23-81c0-453d2b4bd218 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:01.798381 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 181/371] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:01.799756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f9d48-4cce-442a-901b-cc6b155c64bb None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:01.844316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d90aa2-aed1-4bb9-bb31-3d9c6268f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:01.845012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d90aa2-aed1-4bb9-bb31-3d9c6268f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:01.845303 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d90aa2-aed1-4bb9-bb31-3d9c6268f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:01.845630 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d90aa2-aed1-4bb9-bb31-3d9c6268f9b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:01.846447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d90aa2-aed1-4bb9-bb31-3d9c6268f9b7 None admin] RBAC: Adding query filter params (role.id=e3703da52f214166b433fe3405753808, user.id=74dd5f00516d4984afe73cf426d07fe9, scope.system=all) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:01.846764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d90aa2-aed1-4bb9-bb31-3d9c6268f9b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:01.848256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d90aa2-aed1-4bb9-bb31-3d9c6268f9b7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:01.861910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:01.871894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 191/372] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Sep 1 05:18:01 2022] GET /identity/v3/role_assignments?user.id=74dd5f00516d4984afe73cf426d07fe9&scope.system=all&role.id=e3703da52f214166b433fe3405753808 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:01.871894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb77b7-d68b-45a5-97c5-5d470aaa5e5e None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:01.871894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb77b7-d68b-45a5-97c5-5d470aaa5e5e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:01.871894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb77b7-d68b-45a5-97c5-5d470aaa5e5e None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:01.871894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 192/373] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:01.871894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb77b7-d68b-45a5-97c5-5d470aaa5e5e None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:01.935464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:01.980906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f9d48-4cce-442a-901b-cc6b155c64bb None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:02.021856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb77b7-d68b-45a5-97c5-5d470aaa5e5e None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:02.029050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84731c-2e55-4a35-9fc2-27f7e0aff6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:02.029735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84731c-2e55-4a35-9fc2-27f7e0aff6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:02.030015 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84731c-2e55-4a35-9fc2-27f7e0aff6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:02.030370 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84731c-2e55-4a35-9fc2-27f7e0aff6a9 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:02.031697 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84731c-2e55-4a35-9fc2-27f7e0aff6a9 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:02.034109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84731c-2e55-4a35-9fc2-27f7e0aff6a9 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:02.037019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 182/374] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:01 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:02.042399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84731c-2e55-4a35-9fc2-27f7e0aff6a9 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:02.076870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b69bc-9e93-4aff-870b-4c12f1e587e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:02.078694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b69bc-9e93-4aff-870b-4c12f1e587e5 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:02.078694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b69bc-9e93-4aff-870b-4c12f1e587e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:02.078694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b69bc-9e93-4aff-870b-4c12f1e587e5 None admin] PATH_INFO: `/v3/groups/2868dca5fdc847f2a33b07611f47775b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:02.080565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b69bc-9e93-4aff-870b-4c12f1e587e5 None admin] RBAC: Authorizing `identity:get_group(group_id=2868dca5fdc847f2a33b07611f47775b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:02.083203 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b69bc-9e93-4aff-870b-4c12f1e587e5 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:02.085509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 193/375] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:01 2022] GET /identity/v3/groups/2868dca5fdc847f2a33b07611f47775b => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:02.088931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fd32b-a2e7-4018-8f74-d0ea62dd9a37 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:02.089221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fd32b-a2e7-4018-8f74-d0ea62dd9a37 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:02.089545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fd32b-a2e7-4018-8f74-d0ea62dd9a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:02.123402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-6e7fd32b-a2e7-4018-8f74-d0ea62dd9a37 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:02.124724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6e7fd32b-a2e7-4018-8f74-d0ea62dd9a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:02.224805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84731c-2e55-4a35-9fc2-27f7e0aff6a9 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:02.241540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:02.243727 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 194/376] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:02.245154 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fd32b-a2e7-4018-8f74-d0ea62dd9a37 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:02.285109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477c921-19d3-4d2c-ad45-08008e01dd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:02.285876 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477c921-19d3-4d2c-ad45-08008e01dd78 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:02.286187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477c921-19d3-4d2c-ad45-08008e01dd78 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:02.286468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477c921-19d3-4d2c-ad45-08008e01dd78 None admin] PATH_INFO: `/v3/projects/08e8d7d100674ce3a5c0d91110f5524d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:02.287920 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477c921-19d3-4d2c-ad45-08008e01dd78 None admin] RBAC: Authorizing `identity:get_project(project_id=08e8d7d100674ce3a5c0d91110f5524d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:02.290074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477c921-19d3-4d2c-ad45-08008e01dd78 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:02.297421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 183/377] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:02 2022] GET /identity/v3/projects/08e8d7d100674ce3a5c0d91110f5524d => generated 344 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:02.297421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477c921-19d3-4d2c-ad45-08008e01dd78 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:02.324441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:02.482873 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fd32b-a2e7-4018-8f74-d0ea62dd9a37 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:02.509772 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477c921-19d3-4d2c-ad45-08008e01dd78 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:02.568184 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaff13-e41d-4d59-92dd-562c08eebb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:02.569251 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaff13-e41d-4d59-92dd-562c08eebb04 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:02.569787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaff13-e41d-4d59-92dd-562c08eebb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:02.570270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaff13-e41d-4d59-92dd-562c08eebb04 None admin] PATH_INFO: `/v3/groups/2868dca5fdc847f2a33b07611f47775b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:02.574340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaaff13-e41d-4d59-92dd-562c08eebb04 None admin] RBAC: Authorizing `identity:get_group(group_id=2868dca5fdc847f2a33b07611f47775b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:02.577210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaaff13-e41d-4d59-92dd-562c08eebb04 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:02.581663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 195/378] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:02 2022] GET /identity/v3/groups/2868dca5fdc847f2a33b07611f47775b => generated 226 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:02.582613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaff13-e41d-4d59-92dd-562c08eebb04 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:02.583990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6cd92-623a-4848-b4d3-6ab7e04fac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:02.585151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6cd92-623a-4848-b4d3-6ab7e04fac20 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:02.586596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6cd92-623a-4848-b4d3-6ab7e04fac20 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:02.588948 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6cd92-623a-4848-b4d3-6ab7e04fac20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:02.591020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6cd92-623a-4848-b4d3-6ab7e04fac20 None admin] RBAC: Adding query filter params (group.id=2868dca5fdc847f2a33b07611f47775b, role.id=5183ce055fde4522816e3cdce43ed4e9, scope.project.id=f1f639a220c6483b9d682cc431b14298) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:02.605730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6cd92-623a-4848-b4d3-6ab7e04fac20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:02.605730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6cd92-623a-4848-b4d3-6ab7e04fac20 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:02.611151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 184/379] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Sep 1 05:18:02 2022] GET /identity/v3/role_assignments?group.id=2868dca5fdc847f2a33b07611f47775b&scope.project.id=f1f639a220c6483b9d682cc431b14298&role.id=5183ce055fde4522816e3cdce43ed4e9 => generated 260 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:02.612852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6cd92-623a-4848-b4d3-6ab7e04fac20 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:02.682486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:02.781651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaaff13-e41d-4d59-92dd-562c08eebb04 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:02.802359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6cd92-623a-4848-b4d3-6ab7e04fac20 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:02.806470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:02.874592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce934ea9-ef4a-4347-a9a5-f7cf45a71063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:02.875705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce934ea9-ef4a-4347-a9a5-f7cf45a71063 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:02.876211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce934ea9-ef4a-4347-a9a5-f7cf45a71063 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:02.877000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce934ea9-ef4a-4347-a9a5-f7cf45a71063 None admin] PATH_INFO: `/v3/groups/261b8cf45da2404abbf2b9ed3055e5fb` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:02.891098 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce934ea9-ef4a-4347-a9a5-f7cf45a71063 None admin] RBAC: Authorizing `identity:get_group(group_id=261b8cf45da2404abbf2b9ed3055e5fb)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:02.891286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6803a2-f30f-4539-a8d1-b1125526ab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:02.893263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6803a2-f30f-4539-a8d1-b1125526ab38 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:02.893263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6803a2-f30f-4539-a8d1-b1125526ab38 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:02.893263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6803a2-f30f-4539-a8d1-b1125526ab38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:02.897317 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce934ea9-ef4a-4347-a9a5-f7cf45a71063 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:02.905517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 196/380] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:02 2022] GET /identity/v3/groups/261b8cf45da2404abbf2b9ed3055e5fb => generated 229 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:02.907250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce934ea9-ef4a-4347-a9a5-f7cf45a71063 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:02.926901 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6803a2-f30f-4539-a8d1-b1125526ab38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-6b6803a2-f30f-4539-a8d1-b1125526ab38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:02.940332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:02.941439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:02.942423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:02.942423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:02.942423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:02.942423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:02.942423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:02.942423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:02.942423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:02.942423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:02.942423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:02.942423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:02.942423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:18:02.942423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:02.943925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 185/381] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:02.947732 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6803a2-f30f-4539-a8d1-b1125526ab38 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:03.161455 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:03.168720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6803a2-f30f-4539-a8d1-b1125526ab38 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:03.175240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce934ea9-ef4a-4347-a9a5-f7cf45a71063 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:03.238820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bccf7a-c0e3-448f-9390-3c727683ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:03.240320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bccf7a-c0e3-448f-9390-3c727683ce64 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:03.241021 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bccf7a-c0e3-448f-9390-3c727683ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:03.241755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bccf7a-c0e3-448f-9390-3c727683ce64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:03.243311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bccf7a-c0e3-448f-9390-3c727683ce64 None admin] RBAC: Adding query filter params (group.id=261b8cf45da2404abbf2b9ed3055e5fb, role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=08e8d7d100674ce3a5c0d91110f5524d) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:03.244110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bccf7a-c0e3-448f-9390-3c727683ce64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:03.247040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bccf7a-c0e3-448f-9390-3c727683ce64 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:03.258556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 186/382] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Sep 1 05:18:02 2022] GET /identity/v3/role_assignments?group.id=261b8cf45da2404abbf2b9ed3055e5fb&scope.project.id=08e8d7d100674ce3a5c0d91110f5524d&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 260 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:03.260520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bccf7a-c0e3-448f-9390-3c727683ce64 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:03.267625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3428049-77c9-4cae-8374-af4c7d61dc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:03.272664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3428049-77c9-4cae-8374-af4c7d61dc3c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:03.273644 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3428049-77c9-4cae-8374-af4c7d61dc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:03.274355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3428049-77c9-4cae-8374-af4c7d61dc3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:03.276557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3428049-77c9-4cae-8374-af4c7d61dc3c None admin] RBAC: Adding query filter params (group.id=2868dca5fdc847f2a33b07611f47775b, role.id=d27b7d5ab3274b85a416d9f8f7f75648, scope.project.id=f1f639a220c6483b9d682cc431b14298) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:03.279442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3428049-77c9-4cae-8374-af4c7d61dc3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:03.282735 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3428049-77c9-4cae-8374-af4c7d61dc3c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:03.309148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 197/383] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Sep 1 05:18:02 2022] GET /identity/v3/role_assignments?group.id=2868dca5fdc847f2a33b07611f47775b&scope.project.id=f1f639a220c6483b9d682cc431b14298&role.id=d27b7d5ab3274b85a416d9f8f7f75648 => generated 260 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:03.530730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bccf7a-c0e3-448f-9390-3c727683ce64 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:03.570160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13158a36-6d3c-4740-836c-2f48b7654758 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:03.571688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13158a36-6d3c-4740-836c-2f48b7654758 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:03.572172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13158a36-6d3c-4740-836c-2f48b7654758 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:03.578016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 198/384] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:03.588053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38dc97-7914-4b63-be70-8395adade6e6 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:03.588410 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38dc97-7914-4b63-be70-8395adade6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:03.589049 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38dc97-7914-4b63-be70-8395adade6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:03.621664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeb63e-dac1-4725-be59-d01e487916db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:03.622332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeb63e-dac1-4725-be59-d01e487916db None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:03.622698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeb63e-dac1-4725-be59-d01e487916db None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:03.623317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaeb63e-dac1-4725-be59-d01e487916db None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:03.623943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeb63e-dac1-4725-be59-d01e487916db None admin] RBAC: Adding query filter params (name=member) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:03.624256 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeb63e-dac1-4725-be59-d01e487916db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:03.625838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaeb63e-dac1-4725-be59-d01e487916db None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:03.640196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-2a38dc97-7914-4b63-be70-8395adade6e6 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:03.641513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2a38dc97-7914-4b63-be70-8395adade6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:03.645866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 187/385] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:18:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:03.651986 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeb63e-dac1-4725-be59-d01e487916db None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:03.711752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:03.722847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:03.788885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 199/386] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:03.878702 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaeb63e-dac1-4725-be59-d01e487916db None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:03.937039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0150988-061e-43af-9365-4e37ed59ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:03.938025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0150988-061e-43af-9365-4e37ed59ebab None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:03.938449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0150988-061e-43af-9365-4e37ed59ebab None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:03.938865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0150988-061e-43af-9365-4e37ed59ebab None admin] PATH_INFO: `/v3/groups/2868dca5fdc847f2a33b07611f47775b` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:03.940252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0150988-061e-43af-9365-4e37ed59ebab None admin] RBAC: Authorizing `identity:get_group(group_id=2868dca5fdc847f2a33b07611f47775b)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:03.941958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0150988-061e-43af-9365-4e37ed59ebab None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:03.944265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 188/387] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:03 2022] GET /identity/v3/groups/2868dca5fdc847f2a33b07611f47775b => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:03.951443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38dc97-7914-4b63-be70-8395adade6e6 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:04.098348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38dc97-7914-4b63-be70-8395adade6e6 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:04.141855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84468f7-4f83-473b-ba06-9d8e79a54064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:04.142986 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84468f7-4f83-473b-ba06-9d8e79a54064 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:04.143460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84468f7-4f83-473b-ba06-9d8e79a54064 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:04.143926 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84468f7-4f83-473b-ba06-9d8e79a54064 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:04.145503 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84468f7-4f83-473b-ba06-9d8e79a54064 None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:04.147443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84468f7-4f83-473b-ba06-9d8e79a54064 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:04.150133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 200/388] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:03 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:04.156486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0150988-061e-43af-9365-4e37ed59ebab None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:04.296602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:04.305991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0150988-061e-43af-9365-4e37ed59ebab None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:04.364214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c9753-9fe4-4437-a60d-147e168d8a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:04.364823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c9753-9fe4-4437-a60d-147e168d8a96 None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:04.365106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c9753-9fe4-4437-a60d-147e168d8a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:04.365400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c9753-9fe4-4437-a60d-147e168d8a96 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167/groups/2868dca5fdc847f2a33b07611f47775b/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:04.367659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c9753-9fe4-4437-a60d-147e168d8a96 None admin] RBAC: Authorizing `identity:create_grant(project_id=82a264f4d0584bc8bcd438643dbbb167, group_id=2868dca5fdc847f2a33b07611f47775b, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:04.370336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c9753-9fe4-4437-a60d-147e168d8a96 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:04.395568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84468f7-4f83-473b-ba06-9d8e79a54064 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:04.437966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:04.496719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 189/389] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Sep 1 05:18:04 2022] PUT /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167/groups/2868dca5fdc847f2a33b07611f47775b/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:04.553075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84468f7-4f83-473b-ba06-9d8e79a54064 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:04.642648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1786d58-dfe8-4dad-a4da-34648e6355e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:04.643491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786d58-dfe8-4dad-a4da-34648e6355e2 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:04.643991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786d58-dfe8-4dad-a4da-34648e6355e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:04.644477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786d58-dfe8-4dad-a4da-34648e6355e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:04.676276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1786d58-dfe8-4dad-a4da-34648e6355e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-d1786d58-dfe8-4dad-a4da-34648e6355e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:04.686248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:04.687242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:04.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:04.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:04.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:04.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:04.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:04.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:04.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:04.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:04.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:04.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:04.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:18:04.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:04.688665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 201/390] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:18:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:04.698177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c9753-9fe4-4437-a60d-147e168d8a96 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:04.904714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c9753-9fe4-4437-a60d-147e168d8a96 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:04.967045 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f73d3-8451-4058-9db1-7437799d984d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:04.967698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f73d3-8451-4058-9db1-7437799d984d None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:04.967981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f73d3-8451-4058-9db1-7437799d984d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:04.968256 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f73d3-8451-4058-9db1-7437799d984d None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:04.968963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f73d3-8451-4058-9db1-7437799d984d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:04.969268 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f73d3-8451-4058-9db1-7437799d984d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:04.970749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f73d3-8451-4058-9db1-7437799d984d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:04.986131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 190/391] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:04.995855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1786d58-dfe8-4dad-a4da-34648e6355e2 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:05.186007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:05.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1786d58-dfe8-4dad-a4da-34648e6355e2 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:05.239345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711c498-a0e2-4e7b-990c-130b4d61a6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:05.240051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711c498-a0e2-4e7b-990c-130b4d61a6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:05.240340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711c498-a0e2-4e7b-990c-130b4d61a6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:05.240619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711c498-a0e2-4e7b-990c-130b4d61a6b1 None admin] PATH_INFO: `/v3/groups/2868dca5fdc847f2a33b07611f47775b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:05.242008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711c498-a0e2-4e7b-990c-130b4d61a6b1 None admin] RBAC: Authorizing `identity:get_group(group_id=2868dca5fdc847f2a33b07611f47775b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:05.244587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711c498-a0e2-4e7b-990c-130b4d61a6b1 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:05.246752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 202/392] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:04 2022] GET /identity/v3/groups/2868dca5fdc847f2a33b07611f47775b => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:05.256129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f73d3-8451-4058-9db1-7437799d984d None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:05.324456 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:05.474365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f73d3-8451-4058-9db1-7437799d984d None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:05.544365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3d972-fc1f-4ae1-96dd-7d260d7ec25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:05.545435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3d972-fc1f-4ae1-96dd-7d260d7ec25b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:05.545921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3d972-fc1f-4ae1-96dd-7d260d7ec25b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:05.546400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3d972-fc1f-4ae1-96dd-7d260d7ec25b None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:05.548509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3d972-fc1f-4ae1-96dd-7d260d7ec25b None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:05.551293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3d972-fc1f-4ae1-96dd-7d260d7ec25b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:05.554653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 191/393] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:05 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:05.561932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711c498-a0e2-4e7b-990c-130b4d61a6b1 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:05.712200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711c498-a0e2-4e7b-990c-130b4d61a6b1 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:05.755552 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3aa47a-f6e0-49ca-9d79-456d9dfa87b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:05.756502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa47a-f6e0-49ca-9d79-456d9dfa87b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:05.756967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa47a-f6e0-49ca-9d79-456d9dfa87b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:05.757513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3aa47a-f6e0-49ca-9d79-456d9dfa87b2 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167/groups/2868dca5fdc847f2a33b07611f47775b/roles/5183ce055fde4522816e3cdce43ed4e9` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:05.761553 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aa47a-f6e0-49ca-9d79-456d9dfa87b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=82a264f4d0584bc8bcd438643dbbb167, group_id=2868dca5fdc847f2a33b07611f47775b, role_id=5183ce055fde4522816e3cdce43ed4e9)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:05.764223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3aa47a-f6e0-49ca-9d79-456d9dfa87b2 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:05.861353 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a53a7-471c-4b1e-b797-95f434720d2c None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:05.862995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a53a7-471c-4b1e-b797-95f434720d2c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:05.863780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a53a7-471c-4b1e-b797-95f434720d2c None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:05.867346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 192/394] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:05.877821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226a84e-f51d-4001-986e-e88142f9eb69 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:05.878472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226a84e-f51d-4001-986e-e88142f9eb69 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:05.878962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226a84e-f51d-4001-986e-e88142f9eb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:05.893651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 203/395] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Sep 1 05:18:05 2022] PUT /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167/groups/2868dca5fdc847f2a33b07611f47775b/roles/5183ce055fde4522816e3cdce43ed4e9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:18:05.935307 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a226a84e-f51d-4001-986e-e88142f9eb69 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:05.937553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a226a84e-f51d-4001-986e-e88142f9eb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:06.123047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 193/396] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:06.297955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75b29-15cb-4da9-b0f4-d7a364a24efa None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:06.298400 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75b29-15cb-4da9-b0f4-d7a364a24efa None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:06.298530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c75b29-15cb-4da9-b0f4-d7a364a24efa None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:06.300242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 204/397] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:06.308554 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aec88-99ab-4ade-b303-c405f873d12c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:06.309575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aec88-99ab-4ade-b303-c405f873d12c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:06.310306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aec88-99ab-4ade-b303-c405f873d12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:06.344198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-878aec88-99ab-4ade-b303-c405f873d12c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:06.346648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-878aec88-99ab-4ade-b303-c405f873d12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:06.367782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:06.504557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 194/398] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:06.568736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75b29-15cb-4da9-b0f4-d7a364a24efa None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:06.625666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:06.721524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c75b29-15cb-4da9-b0f4-d7a364a24efa None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:06.765064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef5454-bbe7-40d8-bcef-db22da4faaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:06.765662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef5454-bbe7-40d8-bcef-db22da4faaee None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:06.765952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef5454-bbe7-40d8-bcef-db22da4faaee None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:06.766227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef5454-bbe7-40d8-bcef-db22da4faaee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:06.771719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b5198-09ef-4342-8dc6-fb874cd589fb None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:06.772704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b5198-09ef-4342-8dc6-fb874cd589fb None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:06.774047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b5198-09ef-4342-8dc6-fb874cd589fb None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:06.777412 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 195/399] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:06.784047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef5454-bbe7-40d8-bcef-db22da4faaee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-14ef5454-bbe7-40d8-bcef-db22da4faaee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:06.785481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:06.787072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:06.788037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 205/400] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:18:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:18:06.791846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f57f04-66ae-424f-8095-50ea4bb550f7 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:06.793020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f57f04-66ae-424f-8095-50ea4bb550f7 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:06.793845 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f57f04-66ae-424f-8095-50ea4bb550f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:06.809461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef5454-bbe7-40d8-bcef-db22da4faaee None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:06.895445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-54f57f04-66ae-424f-8095-50ea4bb550f7 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:06.896694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-54f57f04-66ae-424f-8095-50ea4bb550f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:06.997821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 196/401] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:06.998864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f57f04-66ae-424f-8095-50ea4bb550f7 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:06.999843 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:07.032746 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef5454-bbe7-40d8-bcef-db22da4faaee None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:07.168967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0d57e-8802-4ea6-90b5-ecb654b6e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:07.170089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0d57e-8802-4ea6-90b5-ecb654b6e4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:07.170550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0d57e-8802-4ea6-90b5-ecb654b6e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:07.171003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0d57e-8802-4ea6-90b5-ecb654b6e4b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:07.172139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0d57e-8802-4ea6-90b5-ecb654b6e4b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:07.172645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0d57e-8802-4ea6-90b5-ecb654b6e4b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:07.175271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0d57e-8802-4ea6-90b5-ecb654b6e4b6 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:07.215170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 206/402] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:07.221401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0d57e-8802-4ea6-90b5-ecb654b6e4b6 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:07.263171 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:07.323492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f57f04-66ae-424f-8095-50ea4bb550f7 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:07.403450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352933d-6fbf-4e2e-b3d5-a787a1de913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:07.404172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352933d-6fbf-4e2e-b3d5-a787a1de913f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:07.404465 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352933d-6fbf-4e2e-b3d5-a787a1de913f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:07.404737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352933d-6fbf-4e2e-b3d5-a787a1de913f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:07.418700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352933d-6fbf-4e2e-b3d5-a787a1de913f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-8352933d-6fbf-4e2e-b3d5-a787a1de913f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:07.424039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:07.425866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 197/403] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:07.427505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352933d-6fbf-4e2e-b3d5-a787a1de913f None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:07.463090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0d57e-8802-4ea6-90b5-ecb654b6e4b6 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:07.535357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f61c69-81fc-4eb5-beed-1f1691ce2847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:07.536350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f61c69-81fc-4eb5-beed-1f1691ce2847 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:07.536770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f61c69-81fc-4eb5-beed-1f1691ce2847 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:07.537186 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f61c69-81fc-4eb5-beed-1f1691ce2847 None admin] PATH_INFO: `/v3/groups/2868dca5fdc847f2a33b07611f47775b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:07.539249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f61c69-81fc-4eb5-beed-1f1691ce2847 None admin] RBAC: Authorizing `identity:get_group(group_id=2868dca5fdc847f2a33b07611f47775b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:07.541811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f61c69-81fc-4eb5-beed-1f1691ce2847 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:07.544960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 207/404] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:07 2022] GET /identity/v3/groups/2868dca5fdc847f2a33b07611f47775b => generated 226 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:07.546457 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f61c69-81fc-4eb5-beed-1f1691ce2847 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:07.567740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352933d-6fbf-4e2e-b3d5-a787a1de913f None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:07.574284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:07.612534 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb857e6e-cd70-4fa6-81b5-27e5e2005157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:07.613200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb857e6e-cd70-4fa6-81b5-27e5e2005157 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:07.613521 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb857e6e-cd70-4fa6-81b5-27e5e2005157 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:07.613797 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb857e6e-cd70-4fa6-81b5-27e5e2005157 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:07.616014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:07.628941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb857e6e-cd70-4fa6-81b5-27e5e2005157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-cb857e6e-cd70-4fa6-81b5-27e5e2005157 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:07.635333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:07.643753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 198/405] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:18:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:07.644659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb857e6e-cd70-4fa6-81b5-27e5e2005157 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:07.759124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f61c69-81fc-4eb5-beed-1f1691ce2847 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:07.772389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb857e6e-cd70-4fa6-81b5-27e5e2005157 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:07.821132 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23915c-49e5-48aa-837a-6b2d6a682877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:07.822362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23915c-49e5-48aa-837a-6b2d6a682877 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:07.822801 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23915c-49e5-48aa-837a-6b2d6a682877 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:07.823221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23915c-49e5-48aa-837a-6b2d6a682877 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:07.824733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23915c-49e5-48aa-837a-6b2d6a682877 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:07.826660 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23915c-49e5-48aa-837a-6b2d6a682877 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:07.828734 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 199/406] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:07 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:07.829758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23915c-49e5-48aa-837a-6b2d6a682877 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:07.843838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbafa42-fab2-4739-849c-7a1efa198630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:07.844686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbafa42-fab2-4739-849c-7a1efa198630 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:07.845187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbafa42-fab2-4739-849c-7a1efa198630 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:07.845733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbafa42-fab2-4739-849c-7a1efa198630 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:07.846942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbafa42-fab2-4739-849c-7a1efa198630 None admin] RBAC: Adding query filter params (name=member) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:07.847473 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbafa42-fab2-4739-849c-7a1efa198630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:07.850283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbafa42-fab2-4739-849c-7a1efa198630 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:07.873136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 208/407] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:18:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:07.873136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbafa42-fab2-4739-849c-7a1efa198630 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:07.921272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:07.971489 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23915c-49e5-48aa-837a-6b2d6a682877 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:08.015937 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e4ae5-7048-456a-92ef-c1eea378e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:08.016819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e4ae5-7048-456a-92ef-c1eea378e393 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:08.017283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e4ae5-7048-456a-92ef-c1eea378e393 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:08.017736 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e4ae5-7048-456a-92ef-c1eea378e393 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:08.018592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e4ae5-7048-456a-92ef-c1eea378e393 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:08.019075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e4ae5-7048-456a-92ef-c1eea378e393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:08.020672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e4ae5-7048-456a-92ef-c1eea378e393 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:08.032416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 200/408] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:08.033567 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e4ae5-7048-456a-92ef-c1eea378e393 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:08.089692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbafa42-fab2-4739-849c-7a1efa198630 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:08.094096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:08.162977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9d58f-794c-4d53-90aa-d3632a86db49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:08.164236 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9d58f-794c-4d53-90aa-d3632a86db49 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:08.164833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9d58f-794c-4d53-90aa-d3632a86db49 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:08.165757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9d58f-794c-4d53-90aa-d3632a86db49 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298/groups/2868dca5fdc847f2a33b07611f47775b/roles/5183ce055fde4522816e3cdce43ed4e9` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:08.168902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e4ae5-7048-456a-92ef-c1eea378e393 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:08.169537 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9d58f-794c-4d53-90aa-d3632a86db49 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1f639a220c6483b9d682cc431b14298, group_id=2868dca5fdc847f2a33b07611f47775b, role_id=5183ce055fde4522816e3cdce43ed4e9)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:08.172967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9d58f-794c-4d53-90aa-d3632a86db49 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:08.201051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:08.222849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328bbd4-f786-450d-86c7-778f7622b6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:08.223944 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328bbd4-f786-450d-86c7-778f7622b6ab None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:08.224437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328bbd4-f786-450d-86c7-778f7622b6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:08.224929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328bbd4-f786-450d-86c7-778f7622b6ab None admin] PATH_INFO: `/v3/groups/2868dca5fdc847f2a33b07611f47775b` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:08.227167 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328bbd4-f786-450d-86c7-778f7622b6ab None admin] RBAC: Authorizing `identity:get_group(group_id=2868dca5fdc847f2a33b07611f47775b)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:08.230415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a328bbd4-f786-450d-86c7-778f7622b6ab None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:08.237104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 201/409] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:08 2022] GET /identity/v3/groups/2868dca5fdc847f2a33b07611f47775b => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:08.237104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328bbd4-f786-450d-86c7-778f7622b6ab None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:08.296830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 209/410] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Sep 1 05:18:07 2022] PUT /identity/v3/projects/f1f639a220c6483b9d682cc431b14298/groups/2868dca5fdc847f2a33b07611f47775b/roles/5183ce055fde4522816e3cdce43ed4e9 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:08.296830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9d58f-794c-4d53-90aa-d3632a86db49 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:08.475962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328bbd4-f786-450d-86c7-778f7622b6ab None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:08.490517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9d58f-794c-4d53-90aa-d3632a86db49 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:08.536745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b90c3-2567-4315-9499-48b9e4b6ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:08.537870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b90c3-2567-4315-9499-48b9e4b6ecfd None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:08.538390 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b90c3-2567-4315-9499-48b9e4b6ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:08.539507 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b90c3-2567-4315-9499-48b9e4b6ecfd None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:08.541954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b90c3-2567-4315-9499-48b9e4b6ecfd None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:08.543754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b90c3-2567-4315-9499-48b9e4b6ecfd None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:08.546309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 210/411] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:08 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:08.548068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6f264-361b-41c3-b537-db5fe1da5935 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:08.548695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6f264-361b-41c3-b537-db5fe1da5935 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:08.549311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6f264-361b-41c3-b537-db5fe1da5935 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:08.551286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696c0ec-2b20-442c-9d44-e5c7403289d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:08.551612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 211/412] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:08.555462 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696c0ec-2b20-442c-9d44-e5c7403289d4 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:08.555898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696c0ec-2b20-442c-9d44-e5c7403289d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:08.556371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696c0ec-2b20-442c-9d44-e5c7403289d4 None admin] PATH_INFO: `/v3/groups/261b8cf45da2404abbf2b9ed3055e5fb` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:08.557160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6f264-361b-41c3-b537-db5fe1da5935 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:08.558749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696c0ec-2b20-442c-9d44-e5c7403289d4 None admin] RBAC: Authorizing `identity:get_group(group_id=261b8cf45da2404abbf2b9ed3055e5fb)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:08.560739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:08.565514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696c0ec-2b20-442c-9d44-e5c7403289d4 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:08.568974 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 202/413] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:08 2022] GET /identity/v3/groups/261b8cf45da2404abbf2b9ed3055e5fb => generated 229 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:08.572486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128499d6-7b5e-4300-a83e-c0407e1348fb None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:08.572980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128499d6-7b5e-4300-a83e-c0407e1348fb None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:08.573506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128499d6-7b5e-4300-a83e-c0407e1348fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:08.607805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-128499d6-7b5e-4300-a83e-c0407e1348fb None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:08.610138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-128499d6-7b5e-4300-a83e-c0407e1348fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:08.742614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:08.745506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 203/414] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:18:08.746495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128499d6-7b5e-4300-a83e-c0407e1348fb None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:08.780012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6f264-361b-41c3-b537-db5fe1da5935 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:08.919901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e52146-727d-4586-8460-6a669605fb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:08.920584 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e52146-727d-4586-8460-6a669605fb1e None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:08.920887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e52146-727d-4586-8460-6a669605fb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:08.921132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e52146-727d-4586-8460-6a669605fb1e None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298/groups/2868dca5fdc847f2a33b07611f47775b/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:08.931512 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e52146-727d-4586-8460-6a669605fb1e None admin] RBAC: Authorizing `identity:create_grant(project_id=f1f639a220c6483b9d682cc431b14298, group_id=2868dca5fdc847f2a33b07611f47775b, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:08.935115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e52146-727d-4586-8460-6a669605fb1e None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:08.998891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128499d6-7b5e-4300-a83e-c0407e1348fb None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:09.042960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194130e9-1af0-4e58-8bba-472076682a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:09.043629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194130e9-1af0-4e58-8bba-472076682a22 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:09.043916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194130e9-1af0-4e58-8bba-472076682a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:09.044194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194130e9-1af0-4e58-8bba-472076682a22 None admin] PATH_INFO: `/v3/projects/08e8d7d100674ce3a5c0d91110f5524d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:09.045604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194130e9-1af0-4e58-8bba-472076682a22 None admin] RBAC: Authorizing `identity:get_project(project_id=08e8d7d100674ce3a5c0d91110f5524d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:09.053459 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 212/415] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Sep 1 05:18:08 2022] PUT /identity/v3/projects/f1f639a220c6483b9d682cc431b14298/groups/2868dca5fdc847f2a33b07611f47775b/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:09.054108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194130e9-1af0-4e58-8bba-472076682a22 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:09.057326 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 204/416] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:08 2022] GET /identity/v3/projects/08e8d7d100674ce3a5c0d91110f5524d => generated 344 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:09.071869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e52146-727d-4586-8460-6a669605fb1e None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:09.091419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb118f6-8d7a-4348-9317-3d8696c5e2ce None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:09.091786 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb118f6-8d7a-4348-9317-3d8696c5e2ce None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:09.093311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb118f6-8d7a-4348-9317-3d8696c5e2ce None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:09.093540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 205/417] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:18:09.104380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70364a17-3334-4dc6-b8c7-931d9a1a6d67 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:09.104703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70364a17-3334-4dc6-b8c7-931d9a1a6d67 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:09.104938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70364a17-3334-4dc6-b8c7-931d9a1a6d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:09.143717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-70364a17-3334-4dc6-b8c7-931d9a1a6d67 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:09.146117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-70364a17-3334-4dc6-b8c7-931d9a1a6d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:09.246726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:09.259975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:09.292314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 206/418] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:18:09.292314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70364a17-3334-4dc6-b8c7-931d9a1a6d67 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:09.323922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e52146-727d-4586-8460-6a669605fb1e None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:09.417404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65d80c-d508-4c9a-bd1e-428eff71d379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:09.418552 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65d80c-d508-4c9a-bd1e-428eff71d379 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:09.419049 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65d80c-d508-4c9a-bd1e-428eff71d379 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:09.419546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65d80c-d508-4c9a-bd1e-428eff71d379 None admin] PATH_INFO: `/v3/projects/08e8d7d100674ce3a5c0d91110f5524d/groups/261b8cf45da2404abbf2b9ed3055e5fb/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:09.423131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65d80c-d508-4c9a-bd1e-428eff71d379 None admin] RBAC: Authorizing `identity:create_grant(project_id=08e8d7d100674ce3a5c0d91110f5524d, group_id=261b8cf45da2404abbf2b9ed3055e5fb, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:09.425942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65d80c-d508-4c9a-bd1e-428eff71d379 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:09.539122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70364a17-3334-4dc6-b8c7-931d9a1a6d67 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:09.590281 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 213/419] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Sep 1 05:18:09 2022] PUT /identity/v3/projects/08e8d7d100674ce3a5c0d91110f5524d/groups/261b8cf45da2404abbf2b9ed3055e5fb/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:18:09.607706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4e02-6fb3-41d6-a67d-2392ad83c8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:09.608842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4e02-6fb3-41d6-a67d-2392ad83c8dc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:09.609308 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4e02-6fb3-41d6-a67d-2392ad83c8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:09.609836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f4e02-6fb3-41d6-a67d-2392ad83c8dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:09.636556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65d80c-d508-4c9a-bd1e-428eff71d379 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:09.640388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f4e02-6fb3-41d6-a67d-2392ad83c8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-2a4f4e02-6fb3-41d6-a67d-2392ad83c8dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:09.651091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:09.657680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:09.658474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 207/420] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:09.666418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4e02-6fb3-41d6-a67d-2392ad83c8dc None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:09.762960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:09.834317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f4e02-6fb3-41d6-a67d-2392ad83c8dc None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:09.879107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb96ae1-568b-45ed-a689-14d92e3ca99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:09.879756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb96ae1-568b-45ed-a689-14d92e3ca99e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:09.880038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb96ae1-568b-45ed-a689-14d92e3ca99e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:09.880385 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb96ae1-568b-45ed-a689-14d92e3ca99e None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:09.881360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb96ae1-568b-45ed-a689-14d92e3ca99e None admin] RBAC: Adding query filter params (name=member) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:09.881360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb96ae1-568b-45ed-a689-14d92e3ca99e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:09.883665 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb96ae1-568b-45ed-a689-14d92e3ca99e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:09.894296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 208/421] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:18:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:09.905587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb96ae1-568b-45ed-a689-14d92e3ca99e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:09.963566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65d80c-d508-4c9a-bd1e-428eff71d379 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:10.033285 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:10.055472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb96ae1-568b-45ed-a689-14d92e3ca99e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:10.103059 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dedd52-5149-4057-b933-a08b74c176e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:10.104094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dedd52-5149-4057-b933-a08b74c176e2 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:10.104524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dedd52-5149-4057-b933-a08b74c176e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:10.104944 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dedd52-5149-4057-b933-a08b74c176e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:10.118956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f040c-4eff-4d7d-931c-a375d5d575cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:10.131743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f040c-4eff-4d7d-931c-a375d5d575cd None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:10.131743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f040c-4eff-4d7d-931c-a375d5d575cd None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:10.131743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f040c-4eff-4d7d-931c-a375d5d575cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:10.146114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:10.170578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f040c-4eff-4d7d-931c-a375d5d575cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-ab9f040c-4eff-4d7d-931c-a375d5d575cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:10.192944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:10.194157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:10.195060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 214/422] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:18:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 552 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:10.212545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f040c-4eff-4d7d-931c-a375d5d575cd None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:10.222714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dedd52-5149-4057-b933-a08b74c176e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:10.224275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dedd52-5149-4057-b933-a08b74c176e2 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:10.358587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f040c-4eff-4d7d-931c-a375d5d575cd None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:10.404514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dd930-6ca6-4476-afd1-0bfbd6fd1713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:10.405424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dd930-6ca6-4476-afd1-0bfbd6fd1713 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:10.405863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dd930-6ca6-4476-afd1-0bfbd6fd1713 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:10.406863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927dd930-6ca6-4476-afd1-0bfbd6fd1713 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:10.407723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dd930-6ca6-4476-afd1-0bfbd6fd1713 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:10.408215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dd930-6ca6-4476-afd1-0bfbd6fd1713 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:10.409886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927dd930-6ca6-4476-afd1-0bfbd6fd1713 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:10.426798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 215/423] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:10.428513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dd930-6ca6-4476-afd1-0bfbd6fd1713 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:10.509965 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:10.568111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927dd930-6ca6-4476-afd1-0bfbd6fd1713 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:10.615013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5f7d3-ca30-48cb-b3f1-449392895b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:10.615873 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5f7d3-ca30-48cb-b3f1-449392895b13 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:10.616318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5f7d3-ca30-48cb-b3f1-449392895b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:10.617205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5f7d3-ca30-48cb-b3f1-449392895b13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:10.706918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5f7d3-ca30-48cb-b3f1-449392895b13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:10.708749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5f7d3-ca30-48cb-b3f1-449392895b13 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:10.711204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 209/424] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:10.723200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dedd52-5149-4057-b933-a08b74c176e2 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:10.782023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:10.790105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:10.849872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 216/425] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:10.853834 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5f7d3-ca30-48cb-b3f1-449392895b13 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:10.998387 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5f7d3-ca30-48cb-b3f1-449392895b13 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:11.047013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a42bc-9053-4985-aaee-d7cebfaaefcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:11.047988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a42bc-9053-4985-aaee-d7cebfaaefcc None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:11.048517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a42bc-9053-4985-aaee-d7cebfaaefcc None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:11.048954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a42bc-9053-4985-aaee-d7cebfaaefcc None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:11.050628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a42bc-9053-4985-aaee-d7cebfaaefcc None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:11.053069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a42bc-9053-4985-aaee-d7cebfaaefcc None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:11.061836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 217/426] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:10 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:11.063758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a42bc-9053-4985-aaee-d7cebfaaefcc None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:11.086447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:11.167017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dedd52-5149-4057-b933-a08b74c176e2 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:11.220784 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876e535-7239-41a6-9a09-9123e6072fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:11.221733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876e535-7239-41a6-9a09-9123e6072fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:11.222203 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876e535-7239-41a6-9a09-9123e6072fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:11.222642 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5876e535-7239-41a6-9a09-9123e6072fb8 None admin] PATH_INFO: `/v3/projects/82a264f4d0584bc8bcd438643dbbb167` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:11.224823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876e535-7239-41a6-9a09-9123e6072fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=82a264f4d0584bc8bcd438643dbbb167)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:11.227413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5876e535-7239-41a6-9a09-9123e6072fb8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:11.230303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 210/427] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:10 2022] GET /identity/v3/projects/82a264f4d0584bc8bcd438643dbbb167 => generated 298 bytes in 508 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:11.236365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876e535-7239-41a6-9a09-9123e6072fb8 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:11.290800 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a42bc-9053-4985-aaee-d7cebfaaefcc None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:11.341875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a096711-4856-479b-9c9f-d8a8a5186959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:11.343743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a096711-4856-479b-9c9f-d8a8a5186959 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:11.344189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a096711-4856-479b-9c9f-d8a8a5186959 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:11.344637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a096711-4856-479b-9c9f-d8a8a5186959 None admin] PATH_INFO: `/v3/groups/2868dca5fdc847f2a33b07611f47775b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:11.346127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a096711-4856-479b-9c9f-d8a8a5186959 None admin] RBAC: Authorizing `identity:get_group(group_id=2868dca5fdc847f2a33b07611f47775b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:11.347801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a096711-4856-479b-9c9f-d8a8a5186959 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:11.354109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 218/428] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:11 2022] GET /identity/v3/groups/2868dca5fdc847f2a33b07611f47775b => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:11.358421 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a096711-4856-479b-9c9f-d8a8a5186959 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:11.419307 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:11.460344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5876e535-7239-41a6-9a09-9123e6072fb8 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:11.504484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:11.523023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33cfa6-1316-4cd6-811e-5fb06c1e98e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:11.524660 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33cfa6-1316-4cd6-811e-5fb06c1e98e8 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:11.525683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33cfa6-1316-4cd6-811e-5fb06c1e98e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:11.526250 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33cfa6-1316-4cd6-811e-5fb06c1e98e8 None admin] PATH_INFO: `/v3/groups/2868dca5fdc847f2a33b07611f47775b` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:11.528061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33cfa6-1316-4cd6-811e-5fb06c1e98e8 None admin] RBAC: Authorizing `identity:get_group(group_id=2868dca5fdc847f2a33b07611f47775b)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:11.530174 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33cfa6-1316-4cd6-811e-5fb06c1e98e8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:11.533242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 211/429] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:11 2022] GET /identity/v3/groups/2868dca5fdc847f2a33b07611f47775b => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:11.535082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56d392-cfbb-4e90-8715-4c879b0c19e8 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:11.535559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56d392-cfbb-4e90-8715-4c879b0c19e8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:11.535993 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56d392-cfbb-4e90-8715-4c879b0c19e8 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:11.539378 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 212/430] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:11.540994 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56d392-cfbb-4e90-8715-4c879b0c19e8 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:11.542023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a096711-4856-479b-9c9f-d8a8a5186959 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:11.622444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f2191-a46d-4307-bfdc-17125647ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:11.623803 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f2191-a46d-4307-bfdc-17125647ce16 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:11.624511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f2191-a46d-4307-bfdc-17125647ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:11.625033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f2191-a46d-4307-bfdc-17125647ce16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:11.626217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f2191-a46d-4307-bfdc-17125647ce16 None admin] RBAC: Adding query filter params (group.id=2868dca5fdc847f2a33b07611f47775b, role.id=5183ce055fde4522816e3cdce43ed4e9, scope.project.id=82a264f4d0584bc8bcd438643dbbb167) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:11.626808 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f2191-a46d-4307-bfdc-17125647ce16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:11.630048 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f2191-a46d-4307-bfdc-17125647ce16 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:11.645578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 219/431] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Sep 1 05:18:11 2022] GET /identity/v3/role_assignments?group.id=2868dca5fdc847f2a33b07611f47775b&scope.project.id=82a264f4d0584bc8bcd438643dbbb167&role.id=5183ce055fde4522816e3cdce43ed4e9 => generated 611 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:11.650435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9baca2-23ed-44ae-8b39-9356faf04bbd None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:11.659880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9baca2-23ed-44ae-8b39-9356faf04bbd None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:11.659880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9baca2-23ed-44ae-8b39-9356faf04bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:11.712324 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-3e9baca2-23ed-44ae-8b39-9356faf04bbd None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:11.715131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3e9baca2-23ed-44ae-8b39-9356faf04bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:11.747884 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56d392-cfbb-4e90-8715-4c879b0c19e8 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:11.877967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 220/432] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:11.881546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1139a8-d774-43b9-928a-e8f6a0fbd2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:11.882911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1139a8-d774-43b9-928a-e8f6a0fbd2ff None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:11.883463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1139a8-d774-43b9-928a-e8f6a0fbd2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:11.884023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1139a8-d774-43b9-928a-e8f6a0fbd2ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:11.885073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1139a8-d774-43b9-928a-e8f6a0fbd2ff None admin] RBAC: Adding query filter params (group.id=2868dca5fdc847f2a33b07611f47775b, role.id=d27b7d5ab3274b85a416d9f8f7f75648, scope.project.id=82a264f4d0584bc8bcd438643dbbb167) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:11.885660 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1139a8-d774-43b9-928a-e8f6a0fbd2ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:11.887484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1139a8-d774-43b9-928a-e8f6a0fbd2ff None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:11.906383 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 213/433] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Sep 1 05:18:11 2022] GET /identity/v3/role_assignments?group.id=2868dca5fdc847f2a33b07611f47775b&scope.project.id=82a264f4d0584bc8bcd438643dbbb167&role.id=d27b7d5ab3274b85a416d9f8f7f75648 => generated 611 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:12.204888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9baca2-23ed-44ae-8b39-9356faf04bbd None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:12.300169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690af2ac-c02c-4a20-9bc4-14b03834ac97 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:12.301166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690af2ac-c02c-4a20-9bc4-14b03834ac97 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:12.301681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690af2ac-c02c-4a20-9bc4-14b03834ac97 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:12.303377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 214/434] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:18:12.313566 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0f33-760a-4695-b3c2-d6f74fb139b4 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:12.313916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0f33-760a-4695-b3c2-d6f74fb139b4 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:12.314121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f0f33-760a-4695-b3c2-d6f74fb139b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:12.320236 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:12.342180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-9d9f0f33-760a-4695-b3c2-d6f74fb139b4 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:12.343464 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9d9f0f33-760a-4695-b3c2-d6f74fb139b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:12.349127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:12.373434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9baca2-23ed-44ae-8b39-9356faf04bbd None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:12.417984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24083d-eb0f-4a9e-96c7-4112a1a22a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:12.418669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24083d-eb0f-4a9e-96c7-4112a1a22a4b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:12.418953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24083d-eb0f-4a9e-96c7-4112a1a22a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:12.419222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24083d-eb0f-4a9e-96c7-4112a1a22a4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:12.432845 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24083d-eb0f-4a9e-96c7-4112a1a22a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-9a24083d-eb0f-4a9e-96c7-4112a1a22a4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:12.438142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:12.439463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:12.440311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 221/435] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:18:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:18:12.449259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24083d-eb0f-4a9e-96c7-4112a1a22a4b None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:12.469623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 215/436] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:12.593406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24083d-eb0f-4a9e-96c7-4112a1a22a4b None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:12.651745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8732c-01f5-4b2f-8f6d-81380782dc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:12.652460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8732c-01f5-4b2f-8f6d-81380782dc8a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:12.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8732c-01f5-4b2f-8f6d-81380782dc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:12.653027 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8732c-01f5-4b2f-8f6d-81380782dc8a None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:12.653786 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8732c-01f5-4b2f-8f6d-81380782dc8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:12.654109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8732c-01f5-4b2f-8f6d-81380782dc8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:12.655550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8732c-01f5-4b2f-8f6d-81380782dc8a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:12.657244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:12.667761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 222/437] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:12.676706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f0f33-760a-4695-b3c2-d6f74fb139b4 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:12.814750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f0f33-760a-4695-b3c2-d6f74fb139b4 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:12.867610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8732c-01f5-4b2f-8f6d-81380782dc8a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:12.872019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a1f88-35d2-4211-9e2a-f03219f7743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:12.872946 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a1f88-35d2-4211-9e2a-f03219f7743f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:12.873475 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a1f88-35d2-4211-9e2a-f03219f7743f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:12.873931 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a1f88-35d2-4211-9e2a-f03219f7743f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:12.888169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:12.980073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a1f88-35d2-4211-9e2a-f03219f7743f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:12.981616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a1f88-35d2-4211-9e2a-f03219f7743f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:13.028504 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8732c-01f5-4b2f-8f6d-81380782dc8a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:13.073216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598d6e0-28e6-4a9f-9a18-bf7c6e6fe008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:13.073997 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598d6e0-28e6-4a9f-9a18-bf7c6e6fe008 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:13.074474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598d6e0-28e6-4a9f-9a18-bf7c6e6fe008 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:13.074857 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598d6e0-28e6-4a9f-9a18-bf7c6e6fe008 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:13.089791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598d6e0-28e6-4a9f-9a18-bf7c6e6fe008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-1598d6e0-28e6-4a9f-9a18-bf7c6e6fe008 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:13.095374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:13.097477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:13.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:13.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:13.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:13.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:13.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:13.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:13.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:13.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:13.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:13.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:13.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 05:18:13.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:13.105417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 223/438] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:13.105417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717dc9f-89ee-4a2e-b9de-0c2c5c0480ef None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:13.105417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717dc9f-89ee-4a2e-b9de-0c2c5c0480ef None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:13.105417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717dc9f-89ee-4a2e-b9de-0c2c5c0480ef None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:13.108044 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 224/439] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:13.109255 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717dc9f-89ee-4a2e-b9de-0c2c5c0480ef None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:13.125322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 216/440] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:13.127625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce2385-c040-4069-9d93-10b60022ddcb None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:13.128100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce2385-c040-4069-9d93-10b60022ddcb None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:13.128556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce2385-c040-4069-9d93-10b60022ddcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:13.154116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-f0ce2385-c040-4069-9d93-10b60022ddcb None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:13.155365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f0ce2385-c040-4069-9d93-10b60022ddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:13.188577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:13.201719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:13.238540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 217/441] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:13.239494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce2385-c040-4069-9d93-10b60022ddcb None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:13.247213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717dc9f-89ee-4a2e-b9de-0c2c5c0480ef None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:13.306057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c7d8e-dd96-4f47-9e8e-0d54867647e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:13.316083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c7d8e-dd96-4f47-9e8e-0d54867647e7 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:13.316083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c7d8e-dd96-4f47-9e8e-0d54867647e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:13.316083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c7d8e-dd96-4f47-9e8e-0d54867647e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:13.316083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c7d8e-dd96-4f47-9e8e-0d54867647e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:13.316083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c7d8e-dd96-4f47-9e8e-0d54867647e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:13.316083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c7d8e-dd96-4f47-9e8e-0d54867647e7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:13.327373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 225/442] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:18:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:13.329646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c7d8e-dd96-4f47-9e8e-0d54867647e7 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:13.385216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce2385-c040-4069-9d93-10b60022ddcb None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:13.434982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862e013-20b5-4b66-9199-ea5b4931d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:13.435652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862e013-20b5-4b66-9199-ea5b4931d2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:13.435921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862e013-20b5-4b66-9199-ea5b4931d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:13.436200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862e013-20b5-4b66-9199-ea5b4931d2d0 None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:13.437559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862e013-20b5-4b66-9199-ea5b4931d2d0 None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:13.439038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862e013-20b5-4b66-9199-ea5b4931d2d0 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:13.440809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 218/443] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:13 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:13.446854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862e013-20b5-4b66-9199-ea5b4931d2d0 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:13.500257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:13.527582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c7d8e-dd96-4f47-9e8e-0d54867647e7 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:13.555868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:13.586744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af418e43-3eb3-4af4-b62d-18077813a4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:13.587063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862e013-20b5-4b66-9199-ea5b4931d2d0 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:13.587863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af418e43-3eb3-4af4-b62d-18077813a4dd None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:13.588334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af418e43-3eb3-4af4-b62d-18077813a4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:13.588989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af418e43-3eb3-4af4-b62d-18077813a4dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:13.638815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808d45f-0a43-4a4e-a625-96cc3ccec05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:13.639558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d45f-0a43-4a4e-a625-96cc3ccec05a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:13.639901 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d45f-0a43-4a4e-a625-96cc3ccec05a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:13.640240 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808d45f-0a43-4a4e-a625-96cc3ccec05a None admin] PATH_INFO: `/v3/groups/2868dca5fdc847f2a33b07611f47775b` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:13.641871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808d45f-0a43-4a4e-a625-96cc3ccec05a None admin] RBAC: Authorizing `identity:get_group(group_id=2868dca5fdc847f2a33b07611f47775b)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:13.643506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808d45f-0a43-4a4e-a625-96cc3ccec05a None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:13.653498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 219/444] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:13 2022] GET /identity/v3/groups/2868dca5fdc847f2a33b07611f47775b => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:13.653498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808d45f-0a43-4a4e-a625-96cc3ccec05a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:13.681443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af418e43-3eb3-4af4-b62d-18077813a4dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:13.689107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af418e43-3eb3-4af4-b62d-18077813a4dd None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:13.770967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808d45f-0a43-4a4e-a625-96cc3ccec05a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:13.779682 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:13.816775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 226/445] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:13.816775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af418e43-3eb3-4af4-b62d-18077813a4dd None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:13.824187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666fbce-46f4-42e3-8a18-12148c1ceed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:13.824849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666fbce-46f4-42e3-8a18-12148c1ceed6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:13.825130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666fbce-46f4-42e3-8a18-12148c1ceed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:13.825438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666fbce-46f4-42e3-8a18-12148c1ceed6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:13.843349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666fbce-46f4-42e3-8a18-12148c1ceed6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:13.843639 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-b666fbce-46f4-42e3-8a18-12148c1ceed6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:13.854935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:13.855999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:13.856906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:13.856906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:13.856906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:13.856906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:13.856906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:13.856906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:13.856906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:13.856906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:13.856906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:13.856906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:13.856906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:18:13.856906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:13.857621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 220/446] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:13.858668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666fbce-46f4-42e3-8a18-12148c1ceed6 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:13.968301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af418e43-3eb3-4af4-b62d-18077813a4dd None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:14.015122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc0ac2-e4a4-4eee-94d5-e10c7a78547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:14.016047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc0ac2-e4a4-4eee-94d5-e10c7a78547d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:14.016519 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc0ac2-e4a4-4eee-94d5-e10c7a78547d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:14.016980 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc0ac2-e4a4-4eee-94d5-e10c7a78547d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:14.017116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666fbce-46f4-42e3-8a18-12148c1ceed6 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:14.018102 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc0ac2-e4a4-4eee-94d5-e10c7a78547d None admin] RBAC: Adding query filter params (group.id=2868dca5fdc847f2a33b07611f47775b, role.id=5183ce055fde4522816e3cdce43ed4e9, scope.project.id=f1f639a220c6483b9d682cc431b14298) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:14.018434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc0ac2-e4a4-4eee-94d5-e10c7a78547d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:14.020423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc0ac2-e4a4-4eee-94d5-e10c7a78547d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:14.029965 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 227/447] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Sep 1 05:18:13 2022] GET /identity/v3/role_assignments?group.id=2868dca5fdc847f2a33b07611f47775b&scope.project.id=f1f639a220c6483b9d682cc431b14298&role.id=5183ce055fde4522816e3cdce43ed4e9 => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:14.030853 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc0ac2-e4a4-4eee-94d5-e10c7a78547d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:14.078607 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ffd6f-4aa7-466e-b64d-baa9e02a3dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:14.079514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ffd6f-4aa7-466e-b64d-baa9e02a3dfb None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:14.079876 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ffd6f-4aa7-466e-b64d-baa9e02a3dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:14.080237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ffd6f-4aa7-466e-b64d-baa9e02a3dfb None admin] PATH_INFO: `/v3/projects/f1f639a220c6483b9d682cc431b14298` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:14.081981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ffd6f-4aa7-466e-b64d-baa9e02a3dfb None admin] RBAC: Authorizing `identity:get_project(project_id=f1f639a220c6483b9d682cc431b14298)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:14.083830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ffd6f-4aa7-466e-b64d-baa9e02a3dfb None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:14.091529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 221/448] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:13 2022] GET /identity/v3/projects/f1f639a220c6483b9d682cc431b14298 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:14.094027 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ffd6f-4aa7-466e-b64d-baa9e02a3dfb None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:14.136960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:14.159513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:14.183845 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc0ac2-e4a4-4eee-94d5-e10c7a78547d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:14.226482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8be2ee-e8e2-455f-b3b0-0c9b6b08e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:14.227553 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8be2ee-e8e2-455f-b3b0-0c9b6b08e5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:14.227899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8be2ee-e8e2-455f-b3b0-0c9b6b08e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:14.228155 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8be2ee-e8e2-455f-b3b0-0c9b6b08e5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:14.228992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8be2ee-e8e2-455f-b3b0-0c9b6b08e5f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:14.229299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8be2ee-e8e2-455f-b3b0-0c9b6b08e5f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:14.230849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8be2ee-e8e2-455f-b3b0-0c9b6b08e5f0 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:14.242660 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 228/449] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:14.243643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ffd6f-4aa7-466e-b64d-baa9e02a3dfb None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:14.248597 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8be2ee-e8e2-455f-b3b0-0c9b6b08e5f0 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:14.289995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46527ea6-7e00-4a0d-a27c-16ffa1ddfecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:14.291031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46527ea6-7e00-4a0d-a27c-16ffa1ddfecc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:14.291467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46527ea6-7e00-4a0d-a27c-16ffa1ddfecc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:14.291901 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46527ea6-7e00-4a0d-a27c-16ffa1ddfecc None admin] PATH_INFO: `/v3/groups/2868dca5fdc847f2a33b07611f47775b` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:14.294292 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46527ea6-7e00-4a0d-a27c-16ffa1ddfecc None admin] RBAC: Authorizing `identity:get_group(group_id=2868dca5fdc847f2a33b07611f47775b)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:14.296400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46527ea6-7e00-4a0d-a27c-16ffa1ddfecc None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:14.298735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 222/450] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:14 2022] GET /identity/v3/groups/2868dca5fdc847f2a33b07611f47775b => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:14.308495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46527ea6-7e00-4a0d-a27c-16ffa1ddfecc None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:14.391028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8be2ee-e8e2-455f-b3b0-0c9b6b08e5f0 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:14.430137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b6795-5220-4770-b645-c722a78696c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:14.430755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b6795-5220-4770-b645-c722a78696c2 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:14.431036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b6795-5220-4770-b645-c722a78696c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:14.431305 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b6795-5220-4770-b645-c722a78696c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:14.442593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46527ea6-7e00-4a0d-a27c-16ffa1ddfecc None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:14.444422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:14.449938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:14.482202 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0d315-7c29-4c29-961a-7582130d0c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:14.482815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0d315-7c29-4c29-961a-7582130d0c70 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:14.483091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0d315-7c29-4c29-961a-7582130d0c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:14.483362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0d315-7c29-4c29-961a-7582130d0c70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:14.484160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0d315-7c29-4c29-961a-7582130d0c70 None admin] RBAC: Adding query filter params (group.id=2868dca5fdc847f2a33b07611f47775b, role.id=d27b7d5ab3274b85a416d9f8f7f75648, scope.project.id=f1f639a220c6483b9d682cc431b14298) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:14.484474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0d315-7c29-4c29-961a-7582130d0c70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:14.486043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0d315-7c29-4c29-961a-7582130d0c70 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:14.493530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 223/451] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Sep 1 05:18:14 2022] GET /identity/v3/role_assignments?group.id=2868dca5fdc847f2a33b07611f47775b&scope.project.id=f1f639a220c6483b9d682cc431b14298&role.id=d27b7d5ab3274b85a416d9f8f7f75648 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:14.519620 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b6795-5220-4770-b645-c722a78696c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:14.521342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6b6795-5220-4770-b645-c722a78696c2 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:14.648756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 229/452] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 05:18:14.655916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0d315-7c29-4c29-961a-7582130d0c70 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:14.786357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0d315-7c29-4c29-961a-7582130d0c70 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:14.839284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733527a-7517-4194-b876-fc6d6e866f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:14.839952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733527a-7517-4194-b876-fc6d6e866f3a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:14.840235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733527a-7517-4194-b876-fc6d6e866f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:14.840511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733527a-7517-4194-b876-fc6d6e866f3a None admin] PATH_INFO: `/v3/projects/08e8d7d100674ce3a5c0d91110f5524d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:14.841775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733527a-7517-4194-b876-fc6d6e866f3a None admin] RBAC: Authorizing `identity:get_project(project_id=08e8d7d100674ce3a5c0d91110f5524d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:14.843253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733527a-7517-4194-b876-fc6d6e866f3a None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:14.844945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 224/453] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:18:14 2022] GET /identity/v3/projects/08e8d7d100674ce3a5c0d91110f5524d => generated 344 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:14.851252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b6795-5220-4770-b645-c722a78696c2 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:14.911927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:14.992320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6b6795-5220-4770-b645-c722a78696c2 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:15.039741 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f69f3-32c3-4ca8-90fc-cc28f976d7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:15.040788 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f69f3-32c3-4ca8-90fc-cc28f976d7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:15.041247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f69f3-32c3-4ca8-90fc-cc28f976d7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:15.041733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f69f3-32c3-4ca8-90fc-cc28f976d7b3 None admin] PATH_INFO: `/v3/groups/261b8cf45da2404abbf2b9ed3055e5fb` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:15.043120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f69f3-32c3-4ca8-90fc-cc28f976d7b3 None admin] RBAC: Authorizing `identity:get_group(group_id=261b8cf45da2404abbf2b9ed3055e5fb)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:15.045568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f69f3-32c3-4ca8-90fc-cc28f976d7b3 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:15.047754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 230/454] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Sep 1 05:18:14 2022] GET /identity/v3/groups/261b8cf45da2404abbf2b9ed3055e5fb => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:15.055485 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733527a-7517-4194-b876-fc6d6e866f3a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:15.094195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:15.165840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733527a-7517-4194-b876-fc6d6e866f3a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:15.202601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd413fa-3167-49bc-b133-7e38ee4059cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:15.203214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd413fa-3167-49bc-b133-7e38ee4059cf None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:15.203492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd413fa-3167-49bc-b133-7e38ee4059cf None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:15.203765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd413fa-3167-49bc-b133-7e38ee4059cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:15.204509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd413fa-3167-49bc-b133-7e38ee4059cf None admin] RBAC: Adding query filter params (group.id=261b8cf45da2404abbf2b9ed3055e5fb, role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=08e8d7d100674ce3a5c0d91110f5524d) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:15.204816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd413fa-3167-49bc-b133-7e38ee4059cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:15.206398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd413fa-3167-49bc-b133-7e38ee4059cf None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:15.213503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 225/455] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Sep 1 05:18:15 2022] GET /identity/v3/role_assignments?group.id=261b8cf45da2404abbf2b9ed3055e5fb&scope.project.id=08e8d7d100674ce3a5c0d91110f5524d&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:18.330243 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583238-2f1e-4346-b0df-ebe767e9b732 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:18.331423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583238-2f1e-4346-b0df-ebe767e9b732 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:18.332057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583238-2f1e-4346-b0df-ebe767e9b732 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:18.334115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 231/456] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:18.340724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb50f7-f868-4fa3-a35e-8103f910a25b None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:18.341754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb50f7-f868-4fa3-a35e-8103f910a25b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:18.342237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb50f7-f868-4fa3-a35e-8103f910a25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:18.367165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a6eb50f7-f868-4fa3-a35e-8103f910a25b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:18.368939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a6eb50f7-f868-4fa3-a35e-8103f910a25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:18.465740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 226/457] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:18.729953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239af75-c8a0-4047-857f-0002455676f8 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:18.730678 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239af75-c8a0-4047-857f-0002455676f8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:18.731301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239af75-c8a0-4047-857f-0002455676f8 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:18.733267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 232/458] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:18.739152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93d2ef-1ce2-49b3-803d-b6a7e5ffbd9b None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:18.739739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93d2ef-1ce2-49b3-803d-b6a7e5ffbd9b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:18.740218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93d2ef-1ce2-49b3-803d-b6a7e5ffbd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:18.766058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-4b93d2ef-1ce2-49b3-803d-b6a7e5ffbd9b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:18.767705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4b93d2ef-1ce2-49b3-803d-b6a7e5ffbd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:18.804954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:18.842979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099c912-63ef-402c-a57d-b7117eafe0b4 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:18.843931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099c912-63ef-402c-a57d-b7117eafe0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:18.845513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099c912-63ef-402c-a57d-b7117eafe0b4 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:18.848975 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 233/459] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:18.859179 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae58e2-5e4d-460a-8d82-19f8f1189a63 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:18.860092 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae58e2-5e4d-460a-8d82-19f8f1189a63 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:18.860874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae58e2-5e4d-460a-8d82-19f8f1189a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:18.877209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 227/460] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:18.899863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-a1ae58e2-5e4d-460a-8d82-19f8f1189a63 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:18.902481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a1ae58e2-5e4d-460a-8d82-19f8f1189a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:18.916820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93d2ef-1ce2-49b3-803d-b6a7e5ffbd9b None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:19.035872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 234/461] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:19.117687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93d2ef-1ce2-49b3-803d-b6a7e5ffbd9b None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:19.191317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72104e-70bd-410c-86e5-21e5f049852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:19.191968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72104e-70bd-410c-86e5-21e5f049852f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:19.192250 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72104e-70bd-410c-86e5-21e5f049852f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:19.192530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72104e-70bd-410c-86e5-21e5f049852f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:19.207796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72104e-70bd-410c-86e5-21e5f049852f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:19.209317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72104e-70bd-410c-86e5-21e5f049852f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-ea72104e-70bd-410c-86e5-21e5f049852f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:19.233194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:19.235007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:19.237535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:19.237535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:19.237535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:19.237535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 228/462] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:18:19.240909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae58e2-5e4d-460a-8d82-19f8f1189a63 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:19.267204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72104e-70bd-410c-86e5-21e5f049852f None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:19.284743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:19.323321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:19.452513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72104e-70bd-410c-86e5-21e5f049852f None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:19.479059 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae58e2-5e4d-460a-8d82-19f8f1189a63 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:19.529060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfb4b2-b590-4600-8d75-64ae35092034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:19.529751 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfb4b2-b590-4600-8d75-64ae35092034 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:19.530038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfb4b2-b590-4600-8d75-64ae35092034 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:19.530325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfb4b2-b590-4600-8d75-64ae35092034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:19.552741 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfb4b2-b590-4600-8d75-64ae35092034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:19.555247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfb4b2-b590-4600-8d75-64ae35092034 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:19.560205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380aa5be-6757-4f5b-b544-4d444f78875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:19.560898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380aa5be-6757-4f5b-b544-4d444f78875a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:19.561187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380aa5be-6757-4f5b-b544-4d444f78875a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:19.561557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380aa5be-6757-4f5b-b544-4d444f78875a None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:19.562239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380aa5be-6757-4f5b-b544-4d444f78875a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:19.562544 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380aa5be-6757-4f5b-b544-4d444f78875a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:19.563981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380aa5be-6757-4f5b-b544-4d444f78875a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-88dfb4b2-b590-4600-8d75-64ae35092034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:19.586606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:19.587762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:19.588807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:19.588807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:19.588807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:19.596030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 235/463] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:19.596030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380aa5be-6757-4f5b-b544-4d444f78875a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:19.596312 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 229/464] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:18:19.596889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfb4b2-b590-4600-8d75-64ae35092034 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:19.688917 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:19.740518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380aa5be-6757-4f5b-b544-4d444f78875a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:19.743856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:19.744649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfb4b2-b590-4600-8d75-64ae35092034 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:19.784520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a720970-20d7-4847-9d1b-71a6b0a1c07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:19.785150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720970-20d7-4847-9d1b-71a6b0a1c07b None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:19.785471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720970-20d7-4847-9d1b-71a6b0a1c07b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:19.785744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720970-20d7-4847-9d1b-71a6b0a1c07b None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:19.786424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a720970-20d7-4847-9d1b-71a6b0a1c07b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:19.787924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a720970-20d7-4847-9d1b-71a6b0a1c07b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:19.809555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e32cad-e2d0-48fc-b15d-7f897937c7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:19.810711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e32cad-e2d0-48fc-b15d-7f897937c7ab None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:19.811446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e32cad-e2d0-48fc-b15d-7f897937c7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:19.811956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e32cad-e2d0-48fc-b15d-7f897937c7ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:19.832269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e32cad-e2d0-48fc-b15d-7f897937c7ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:19.835121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e32cad-e2d0-48fc-b15d-7f897937c7ab None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-93e32cad-e2d0-48fc-b15d-7f897937c7ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:19.868238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:19.869274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:19.870320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:19.870320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:19.870320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:19.870320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 236/465] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:19.871737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e32cad-e2d0-48fc-b15d-7f897937c7ab None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:19.938106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 230/466] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:18:19 2022] POST /identity/v3/users => generated 248 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:18:19.940814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18b91-acdc-4096-948b-631d6811fbcc None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:19.941561 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18b91-acdc-4096-948b-631d6811fbcc None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:19.942053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb18b91-acdc-4096-948b-631d6811fbcc None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:19.945184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 231/467] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:19.958928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb18b91-acdc-4096-948b-631d6811fbcc None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:20.059120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e32cad-e2d0-48fc-b15d-7f897937c7ab None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:20.135104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb18b91-acdc-4096-948b-631d6811fbcc None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:20.137365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12573c-2e85-4112-a56b-e4da0bddee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:20.138567 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12573c-2e85-4112-a56b-e4da0bddee20 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:20.139129 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12573c-2e85-4112-a56b-e4da0bddee20 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:20.139603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12573c-2e85-4112-a56b-e4da0bddee20 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:20.141149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12573c-2e85-4112-a56b-e4da0bddee20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:20.141480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12573c-2e85-4112-a56b-e4da0bddee20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:20.144240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12573c-2e85-4112-a56b-e4da0bddee20 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:20.169788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:20.182005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 237/468] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:20.184755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5ea0d-27b3-4698-8aa0-b07d4248d959 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:20.194772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5ea0d-27b3-4698-8aa0-b07d4248d959 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:20.194772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5ea0d-27b3-4698-8aa0-b07d4248d959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:20.195173 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2235d-4693-4558-b095-df09abfc9f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:20.195173 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2235d-4693-4558-b095-df09abfc9f87 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:20.195173 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2235d-4693-4558-b095-df09abfc9f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:20.195173 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2235d-4693-4558-b095-df09abfc9f87 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:20.195723 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2235d-4693-4558-b095-df09abfc9f87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:20.195723 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2235d-4693-4558-b095-df09abfc9f87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:20.197733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2235d-4693-4558-b095-df09abfc9f87 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:20.216016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 232/469] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:20.221497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2235d-4693-4558-b095-df09abfc9f87 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:20.231420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-f2b5ea0d-27b3-4698-8aa0-b07d4248d959 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:20.234140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f2b5ea0d-27b3-4698-8aa0-b07d4248d959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:20.255646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:20.374855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 238/470] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:20.374855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5ea0d-27b3-4698-8aa0-b07d4248d959 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:20.448371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2235d-4693-4558-b095-df09abfc9f87 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:20.529231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c9557-0e9d-4fe5-a382-8701752fd16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:20.530257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c9557-0e9d-4fe5-a382-8701752fd16d None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:20.531130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c9557-0e9d-4fe5-a382-8701752fd16d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:20.531553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c9557-0e9d-4fe5-a382-8701752fd16d None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:20.533404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c9557-0e9d-4fe5-a382-8701752fd16d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:20.536342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c9557-0e9d-4fe5-a382-8701752fd16d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:20.612997 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5ea0d-27b3-4698-8aa0-b07d4248d959 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:20.657768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cbb1b-d621-4dd3-a4b7-ec549fa8046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:20.658392 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cbb1b-d621-4dd3-a4b7-ec549fa8046c None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:20.658673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cbb1b-d621-4dd3-a4b7-ec549fa8046c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:20.658943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cbb1b-d621-4dd3-a4b7-ec549fa8046c None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:20.659607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cbb1b-d621-4dd3-a4b7-ec549fa8046c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:20.661065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468cbb1b-d621-4dd3-a4b7-ec549fa8046c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:20.687787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 233/471] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:18:20 2022] POST /identity/v3/users => generated 246 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:20.690568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9b763-e462-4b71-9793-ac67210b9cd8 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:20.691502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9b763-e462-4b71-9793-ac67210b9cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:20.692203 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de9b763-e462-4b71-9793-ac67210b9cd8 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:20.695482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 234/472] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:20.701518 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2b114-65ab-411d-8211-3bd52432996f None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:20.701753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2b114-65ab-411d-8211-3bd52432996f None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:20.701888 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2b114-65ab-411d-8211-3bd52432996f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:20.735352 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-40c2b114-65ab-411d-8211-3bd52432996f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:20.737891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-40c2b114-65ab-411d-8211-3bd52432996f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:20.796547 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:20.824103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:20.832103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 239/473] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:18:20 2022] POST /identity/v3/users => generated 248 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:20.867657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cbb1b-d621-4dd3-a4b7-ec549fa8046c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:20.892786 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 235/474] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:18:21.097326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cbb1b-d621-4dd3-a4b7-ec549fa8046c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:21.168804 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcdbf7-46af-48b3-8a52-6a061d8becb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:21.169595 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcdbf7-46af-48b3-8a52-6a061d8becb4 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:21.169909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcdbf7-46af-48b3-8a52-6a061d8becb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:21.170187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcdbf7-46af-48b3-8a52-6a061d8becb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:21.184801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcdbf7-46af-48b3-8a52-6a061d8becb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:21.186392 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcdbf7-46af-48b3-8a52-6a061d8becb4 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-d0fcdbf7-46af-48b3-8a52-6a061d8becb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:21.204187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:21.205636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:21.207033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:21.207033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:21.207033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:21.207033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 240/475] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:21.215804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2b114-65ab-411d-8211-3bd52432996f None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:21.361038 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcdbf7-46af-48b3-8a52-6a061d8becb4 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:21.415718 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2b114-65ab-411d-8211-3bd52432996f None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:21.479546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:21.481181 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448638d-a295-4c1e-8d78-62927dd67733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:21.481799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448638d-a295-4c1e-8d78-62927dd67733 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:21.482283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448638d-a295-4c1e-8d78-62927dd67733 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:21.482762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448638d-a295-4c1e-8d78-62927dd67733 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:21.483988 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448638d-a295-4c1e-8d78-62927dd67733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:21.484539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448638d-a295-4c1e-8d78-62927dd67733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:21.487250 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448638d-a295-4c1e-8d78-62927dd67733 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:21.512196 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 236/476] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:21.523473 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448638d-a295-4c1e-8d78-62927dd67733 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:21.598668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcdbf7-46af-48b3-8a52-6a061d8becb4 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:21.615693 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:21.690621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6199b-7f76-4b7b-8073-c8e1524205b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:21.692773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6199b-7f76-4b7b-8073-c8e1524205b0 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:21.693577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6199b-7f76-4b7b-8073-c8e1524205b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:21.694486 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6199b-7f76-4b7b-8073-c8e1524205b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:21.696104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6199b-7f76-4b7b-8073-c8e1524205b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:21.705414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6199b-7f76-4b7b-8073-c8e1524205b0 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:21.755175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.sql.core [None req-0ca6199b-7f76-4b7b-8073-c8e1524205b0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 05:18:21.755175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 05:18:21.755175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [parameters: {'id': '6fba5b04f88649618630ad25e3a52b19', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 05:18:21.755175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81757) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 05:18:21.793419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448638d-a295-4c1e-8d78-62927dd67733 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-0ca6199b-7f76-4b7b-8073-c8e1524205b0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application conn.query(q) Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result.read() Sep 01 05:18:21.828501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 05:18:21.830271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application next(self.gen) Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application yield resource Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application next(self.gen) Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise self.value Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application session.commit() Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 05:18:21.832091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.session.flush() Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application compat.raise_( Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 05:18:21.835312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 05:18:21.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application conn.query(q) Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result.read() Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 05:18:21.849265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [parameters: {'id': '6fba5b04f88649618630ad25e3a52b19', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:21.858146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 05:18:21.859017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:21.859839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 241/477] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Sep 1 05:18:21 2022] POST /identity/v3/roles => generated 144 bytes in 481 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:21.859839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6199b-7f76-4b7b-8073-c8e1524205b0 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:21.909137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4701c1-47db-4290-923d-9f4d02f2bb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:21.910606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4701c1-47db-4290-923d-9f4d02f2bb45 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:21.911106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4701c1-47db-4290-923d-9f4d02f2bb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:21.911592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4701c1-47db-4290-923d-9f4d02f2bb45 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:21.912753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4701c1-47db-4290-923d-9f4d02f2bb45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:21.916118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4701c1-47db-4290-923d-9f4d02f2bb45 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:22.047806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 237/478] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:18:21 2022] POST /identity/v3/users => generated 249 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:22.153185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6199b-7f76-4b7b-8073-c8e1524205b0 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:22.198041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:22.233329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87a06c-36c0-4335-887a-e2715bccd08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:22.233973 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87a06c-36c0-4335-887a-e2715bccd08d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:22.234257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87a06c-36c0-4335-887a-e2715bccd08d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:22.234528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87a06c-36c0-4335-887a-e2715bccd08d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:22.257592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87a06c-36c0-4335-887a-e2715bccd08d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-2e87a06c-36c0-4335-887a-e2715bccd08d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:22.263884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:22.265632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:22.267216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 242/479] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:18:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:18:22.275810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4701c1-47db-4290-923d-9f4d02f2bb45 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:22.484008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:22.524908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4701c1-47db-4290-923d-9f4d02f2bb45 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:22.594871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db68650-d0c0-4001-92c7-2a17f131c0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:22.595901 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db68650-d0c0-4001-92c7-2a17f131c0bd None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:22.596381 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db68650-d0c0-4001-92c7-2a17f131c0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:22.596823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db68650-d0c0-4001-92c7-2a17f131c0bd None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:22.598207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db68650-d0c0-4001-92c7-2a17f131c0bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:22.598713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db68650-d0c0-4001-92c7-2a17f131c0bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:22.603500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db68650-d0c0-4001-92c7-2a17f131c0bd None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:22.617354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 238/480] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:22.832887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301c0f-25a6-4ad5-be1d-a524efcb121c None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:22.833446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301c0f-25a6-4ad5-be1d-a524efcb121c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:22.833446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd301c0f-25a6-4ad5-be1d-a524efcb121c None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:22.835247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 243/481] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:22.852335 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d45fd-6bb7-4357-adad-4f2c1d508baa None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:22.853262 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d45fd-6bb7-4357-adad-4f2c1d508baa None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:22.854019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d45fd-6bb7-4357-adad-4f2c1d508baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:22.890415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-030d45fd-6bb7-4357-adad-4f2c1d508baa None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:22.895318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-030d45fd-6bb7-4357-adad-4f2c1d508baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:23.033954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 239/482] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:23.664744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd301c0f-25a6-4ad5-be1d-a524efcb121c None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:23.825407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd301c0f-25a6-4ad5-be1d-a524efcb121c None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:23.877017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745874d1-ea9e-4cc0-8adf-495ca7f72454 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:23.878008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825056b-df6d-4eb2-b69e-7456768b7d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:23.878637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825056b-df6d-4eb2-b69e-7456768b7d84 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:23.878907 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825056b-df6d-4eb2-b69e-7456768b7d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:23.879180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825056b-df6d-4eb2-b69e-7456768b7d84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:23.879975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745874d1-ea9e-4cc0-8adf-495ca7f72454 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:23.880761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745874d1-ea9e-4cc0-8adf-495ca7f72454 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:23.884159 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 240/483] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:23.902431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca34bf-2682-4b34-bfa1-0dbf78b0df5b None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:23.903345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca34bf-2682-4b34-bfa1-0dbf78b0df5b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:23.904095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca34bf-2682-4b34-bfa1-0dbf78b0df5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:23.904842 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825056b-df6d-4eb2-b69e-7456768b7d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-4825056b-df6d-4eb2-b69e-7456768b7d84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:23.910041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:23.911760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:23.914132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 244/484] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:23.920510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825056b-df6d-4eb2-b69e-7456768b7d84 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:23.948558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-5fca34bf-2682-4b34-bfa1-0dbf78b0df5b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:23.950961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5fca34bf-2682-4b34-bfa1-0dbf78b0df5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:23.989815 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:24.065745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 241/485] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:24.067110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c023103-beeb-4957-802e-89089a8c487c None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:24.067482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c023103-beeb-4957-802e-89089a8c487c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:24.067928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c023103-beeb-4957-802e-89089a8c487c None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:24.070801 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 242/486] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:24.076362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b6679-845e-4b5f-9265-f1efe8ff0705 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:24.076645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b6679-845e-4b5f-9265-f1efe8ff0705 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:24.076940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b6679-845e-4b5f-9265-f1efe8ff0705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:24.083817 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:24.111305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b75b6679-845e-4b5f-9265-f1efe8ff0705 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:24.112568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b75b6679-845e-4b5f-9265-f1efe8ff0705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:24.129421 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825056b-df6d-4eb2-b69e-7456768b7d84 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:24.202452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb5fd4-d118-4c9f-98b0-8ddbc3cd5926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:24.203996 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb5fd4-d118-4c9f-98b0-8ddbc3cd5926 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:24.204771 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb5fd4-d118-4c9f-98b0-8ddbc3cd5926 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:24.205580 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb5fd4-d118-4c9f-98b0-8ddbc3cd5926 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:24.207139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb5fd4-d118-4c9f-98b0-8ddbc3cd5926 None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:24.207985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb5fd4-d118-4c9f-98b0-8ddbc3cd5926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:24.211491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb5fd4-d118-4c9f-98b0-8ddbc3cd5926 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:24.233530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 245/487] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:24.238667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb5fd4-d118-4c9f-98b0-8ddbc3cd5926 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:24.330163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 243/488] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:24.470412 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b6679-845e-4b5f-9265-f1efe8ff0705 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:24.471293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:24.479523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb5fd4-d118-4c9f-98b0-8ddbc3cd5926 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:24.547191 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3079312-8cc4-4d96-bdd4-50d8fea202d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:24.548737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3079312-8cc4-4d96-bdd4-50d8fea202d8 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:24.549549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3079312-8cc4-4d96-bdd4-50d8fea202d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:24.550322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3079312-8cc4-4d96-bdd4-50d8fea202d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:24.571479 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3079312-8cc4-4d96-bdd4-50d8fea202d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:24.574612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3079312-8cc4-4d96-bdd4-50d8fea202d8 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-b3079312-8cc4-4d96-bdd4-50d8fea202d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:24.596295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:24.597297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:24.598183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:24.598183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:24.598183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:24.600431 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 246/489] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:24.606447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3079312-8cc4-4d96-bdd4-50d8fea202d8 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:24.747369 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b6679-845e-4b5f-9265-f1efe8ff0705 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:24.797788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:24.805241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0005b83-fe90-494a-8bbc-8c0fcdd22591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:24.806156 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0005b83-fe90-494a-8bbc-8c0fcdd22591 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:24.806586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0005b83-fe90-494a-8bbc-8c0fcdd22591 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:24.806864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0005b83-fe90-494a-8bbc-8c0fcdd22591 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:24.807616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3079312-8cc4-4d96-bdd4-50d8fea202d8 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0005b83-fe90-494a-8bbc-8c0fcdd22591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-e0005b83-fe90-494a-8bbc-8c0fcdd22591 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:24.833483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:24.834364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:24.835877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:24.837651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 244/490] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:24.838714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0005b83-fe90-494a-8bbc-8c0fcdd22591 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:24.864039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a680c-2df1-4a5c-8fae-4f6db626ea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:24.864708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a680c-2df1-4a5c-8fae-4f6db626ea7f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:24.865050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a680c-2df1-4a5c-8fae-4f6db626ea7f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:24.865331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a680c-2df1-4a5c-8fae-4f6db626ea7f None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:24.866360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a680c-2df1-4a5c-8fae-4f6db626ea7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:24.866840 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a680c-2df1-4a5c-8fae-4f6db626ea7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:24.868366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a680c-2df1-4a5c-8fae-4f6db626ea7f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:24.885427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 247/491] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:24.886420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a680c-2df1-4a5c-8fae-4f6db626ea7f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:24.902278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:24.982221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0005b83-fe90-494a-8bbc-8c0fcdd22591 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:25.025191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1d86a-c6c5-4983-a7be-126dbb373d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:25.026451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1d86a-c6c5-4983-a7be-126dbb373d08 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:25.027120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1d86a-c6c5-4983-a7be-126dbb373d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:25.027647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1d86a-c6c5-4983-a7be-126dbb373d08 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:25.029982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a680c-2df1-4a5c-8fae-4f6db626ea7f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:25.051914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1d86a-c6c5-4983-a7be-126dbb373d08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-0dc1d86a-c6c5-4983-a7be-126dbb373d08 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:25.058280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:25.059264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:25.060150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:25.060150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:25.060150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:25.060150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:25.060150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:25.060150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:25.060150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:25.060150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:25.060150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:25.060150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:25.060150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:25.060150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:25.062883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 245/492] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:25.064019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1d86a-c6c5-4983-a7be-126dbb373d08 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:25.081758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902a83d-7162-4697-b8c7-1829eed52c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:25.082490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902a83d-7162-4697-b8c7-1829eed52c33 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:25.082791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902a83d-7162-4697-b8c7-1829eed52c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:25.083063 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902a83d-7162-4697-b8c7-1829eed52c33 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:25.083741 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902a83d-7162-4697-b8c7-1829eed52c33 None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:25.084046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902a83d-7162-4697-b8c7-1829eed52c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:25.086012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902a83d-7162-4697-b8c7-1829eed52c33 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:25.097243 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 248/493] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:25.098890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902a83d-7162-4697-b8c7-1829eed52c33 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:25.135772 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:25.197073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1d86a-c6c5-4983-a7be-126dbb373d08 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:25.199369 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:25.238953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902a83d-7162-4697-b8c7-1829eed52c33 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:25.242605 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f6dc-f103-47ff-9cfb-8d53b1076e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:25.243668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f6dc-f103-47ff-9cfb-8d53b1076e41 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:25.244201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f6dc-f103-47ff-9cfb-8d53b1076e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:25.244691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f6dc-f103-47ff-9cfb-8d53b1076e41 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:25.253780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078f6dc-f103-47ff-9cfb-8d53b1076e41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:25.255903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078f6dc-f103-47ff-9cfb-8d53b1076e41 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-9078f6dc-f103-47ff-9cfb-8d53b1076e41 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:25.272117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:25.273960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:25.274865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:25.274865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:25.274865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:25.274865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:25.274865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:25.274865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:25.274865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:25.274865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:25.274865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 05:18:25.274865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:25.277356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 246/494] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:25.278556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f6dc-f103-47ff-9cfb-8d53b1076e41 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:25.290381 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca7a8e-577c-41cf-ab88-f993d7780ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:25.290596 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca7a8e-577c-41cf-ab88-f993d7780ecc None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:25.290815 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca7a8e-577c-41cf-ab88-f993d7780ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:25.291111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca7a8e-577c-41cf-ab88-f993d7780ecc None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:25.292233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca7a8e-577c-41cf-ab88-f993d7780ecc None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:25.292744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca7a8e-577c-41cf-ab88-f993d7780ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:25.295357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca7a8e-577c-41cf-ab88-f993d7780ecc None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:25.308126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 249/495] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:25.313937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca7a8e-577c-41cf-ab88-f993d7780ecc None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:25.412300 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f6dc-f103-47ff-9cfb-8d53b1076e41 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:25.431652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:25.445501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca7a8e-577c-41cf-ab88-f993d7780ecc None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:25.455621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c2a69-81a9-46e8-b627-0c63370c1e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:25.456389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c2a69-81a9-46e8-b627-0c63370c1e8f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:25.456674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c2a69-81a9-46e8-b627-0c63370c1e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:25.456953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c2a69-81a9-46e8-b627-0c63370c1e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:25.473297 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c2a69-81a9-46e8-b627-0c63370c1e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:25.475430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c2a69-81a9-46e8-b627-0c63370c1e8f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:25.490021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c19107-32c9-4fc3-a8be-85b11113cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:25.490627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c19107-32c9-4fc3-a8be-85b11113cf1b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:25.491511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c19107-32c9-4fc3-a8be-85b11113cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:25.491992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c19107-32c9-4fc3-a8be-85b11113cf1b None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:25.492767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c19107-32c9-4fc3-a8be-85b11113cf1b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:25.493077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c19107-32c9-4fc3-a8be-85b11113cf1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:25.494667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c19107-32c9-4fc3-a8be-85b11113cf1b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:25.497269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-eb0c2a69-81a9-46e8-b627-0c63370c1e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:25.499559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:25.500514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:25.501351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:25.501351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:25.501351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:25.505792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 247/496] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:25.507030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c2a69-81a9-46e8-b627-0c63370c1e8f None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:25.542529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 250/497] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Sep 1 05:18:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:25.542529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a40b66-ce14-435d-af80-8797846c733c None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:25.542529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a40b66-ce14-435d-af80-8797846c733c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:25.542529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a40b66-ce14-435d-af80-8797846c733c None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:25.542529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 251/498] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:25.542529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a40b66-ce14-435d-af80-8797846c733c None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:25.645908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c2a69-81a9-46e8-b627-0c63370c1e8f None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:25.680065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a40b66-ce14-435d-af80-8797846c733c None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:25.687676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187c248-9bd9-47c3-8abc-62d3c39c6c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:25.688333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187c248-9bd9-47c3-8abc-62d3c39c6c78 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:25.688613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187c248-9bd9-47c3-8abc-62d3c39c6c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:25.688886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187c248-9bd9-47c3-8abc-62d3c39c6c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:25.702856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187c248-9bd9-47c3-8abc-62d3c39c6c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:25.704443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187c248-9bd9-47c3-8abc-62d3c39c6c78 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-f187c248-9bd9-47c3-8abc-62d3c39c6c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:25.721965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:25.722916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:25.723808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:25.723808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:25.723808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:25.723808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 248/499] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:25.724040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187c248-9bd9-47c3-8abc-62d3c39c6c78 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:25.738637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d246e34-fb57-4dde-96b4-828ad8c3a207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:25.739645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d246e34-fb57-4dde-96b4-828ad8c3a207 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:25.740076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d246e34-fb57-4dde-96b4-828ad8c3a207 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:25.740539 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d246e34-fb57-4dde-96b4-828ad8c3a207 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:25.741465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d246e34-fb57-4dde-96b4-828ad8c3a207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:25.741773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d246e34-fb57-4dde-96b4-828ad8c3a207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:25.743233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d246e34-fb57-4dde-96b4-828ad8c3a207 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:25.750892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:25.764163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 252/500] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:25.764163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121ae4-f406-4606-829c-5a994671a869 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:25.764163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121ae4-f406-4606-829c-5a994671a869 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:25.764163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2121ae4-f406-4606-829c-5a994671a869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:25.784633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-d2121ae4-f406-4606-829c-5a994671a869 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:25.785907 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d2121ae4-f406-4606-829c-5a994671a869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:25.847687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:25.865005 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187c248-9bd9-47c3-8abc-62d3c39c6c78 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:25.871786 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 253/501] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:25.872744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121ae4-f406-4606-829c-5a994671a869 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:25.909423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacc96c-cefe-42b2-bacc-86c8d860904d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:25.910063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacc96c-cefe-42b2-bacc-86c8d860904d None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:25.910345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacc96c-cefe-42b2-bacc-86c8d860904d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:25.910620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacc96c-cefe-42b2-bacc-86c8d860904d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:26.006244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacc96c-cefe-42b2-bacc-86c8d860904d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:26.009666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacc96c-cefe-42b2-bacc-86c8d860904d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:26.015654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2121ae4-f406-4606-829c-5a994671a869 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:26.035669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:26.060256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862419d-d0a8-4978-b231-99044dc99e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:26.060891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862419d-d0a8-4978-b231-99044dc99e55 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:26.061173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862419d-d0a8-4978-b231-99044dc99e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:26.061546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862419d-d0a8-4978-b231-99044dc99e55 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:26.062224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862419d-d0a8-4978-b231-99044dc99e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:26.062530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862419d-d0a8-4978-b231-99044dc99e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:26.063969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862419d-d0a8-4978-b231-99044dc99e55 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:26.082354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 254/502] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:26.082354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862419d-d0a8-4978-b231-99044dc99e55 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:26.140112 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:26.161428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 249/503] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:26.161428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3eb29-8749-4cbf-a2ae-0c8a2ccdebc9 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:26.161428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3eb29-8749-4cbf-a2ae-0c8a2ccdebc9 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:26.161428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3eb29-8749-4cbf-a2ae-0c8a2ccdebc9 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:26.163791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 250/504] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:26.164918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3eb29-8749-4cbf-a2ae-0c8a2ccdebc9 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:26.218825 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862419d-d0a8-4978-b231-99044dc99e55 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:26.266973 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95d37e-df75-465a-b4f0-986315319e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:26.290918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d37e-df75-465a-b4f0-986315319e26 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:26.290918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d37e-df75-465a-b4f0-986315319e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:26.290918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95d37e-df75-465a-b4f0-986315319e26 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:26.290918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95d37e-df75-465a-b4f0-986315319e26 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:26.290918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95d37e-df75-465a-b4f0-986315319e26 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:26.293214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3eb29-8749-4cbf-a2ae-0c8a2ccdebc9 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-7b95d37e-df75-465a-b4f0-986315319e26 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:26.296546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:26.298335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:26.299442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:26.299442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:26.299442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:26.299442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:26.299442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:26.299442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:26.299442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:26.299442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:26.299442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:18:26.299442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:26.299442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 255/505] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:26.299442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95d37e-df75-465a-b4f0-986315319e26 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:26.328360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:26.359162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae2ece-0234-4c56-8ec9-6033590d61b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:26.359845 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae2ece-0234-4c56-8ec9-6033590d61b1 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:26.360122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae2ece-0234-4c56-8ec9-6033590d61b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:26.360395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae2ece-0234-4c56-8ec9-6033590d61b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:26.370772 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae2ece-0234-4c56-8ec9-6033590d61b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:26.372433 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae2ece-0234-4c56-8ec9-6033590d61b1 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-8dae2ece-0234-4c56-8ec9-6033590d61b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:26.386337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:26.388195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:26.390014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:26.390014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:26.390014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:26.390014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:26.390014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:26.390014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:26.390014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:26.390014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:26.390014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:18:26.390014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:26.390014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 251/506] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Sep 1 05:18:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:26.390014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae2ece-0234-4c56-8ec9-6033590d61b1 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:26.445256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95d37e-df75-465a-b4f0-986315319e26 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:26.447535 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:26.505775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a04db-9030-4ee3-8311-48f2ac479cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:26.506977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a04db-9030-4ee3-8311-48f2ac479cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:26.507468 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a04db-9030-4ee3-8311-48f2ac479cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:26.507904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a04db-9030-4ee3-8311-48f2ac479cb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:26.519348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae2ece-0234-4c56-8ec9-6033590d61b1 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:26.528200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a04db-9030-4ee3-8311-48f2ac479cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-b06a04db-9030-4ee3-8311-48f2ac479cb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:26.541680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:26.543612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:26.544531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 256/507] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:26.551060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0cee7-461d-4931-8cf7-74f0f9745ed4 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:26.551617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0cee7-461d-4931-8cf7-74f0f9745ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:26.551952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0cee7-461d-4931-8cf7-74f0f9745ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:26.575774 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-55d0cee7-461d-4931-8cf7-74f0f9745ed4 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:26.576850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc71c18-b752-4633-bfba-6083e442ad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:26.577107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-55d0cee7-461d-4931-8cf7-74f0f9745ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:26.577697 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc71c18-b752-4633-bfba-6083e442ad4f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:26.578043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc71c18-b752-4633-bfba-6083e442ad4f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:26.578406 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc71c18-b752-4633-bfba-6083e442ad4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:26.599707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc71c18-b752-4633-bfba-6083e442ad4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:26.602452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc71c18-b752-4633-bfba-6083e442ad4f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-9cc71c18-b752-4633-bfba-6083e442ad4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:26.628990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:26.631127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:26.633690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:26.633690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:26.633690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:26.633690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 252/508] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:26.636301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc71c18-b752-4633-bfba-6083e442ad4f None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:26.679298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 257/509] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:26.680785 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0cee7-461d-4931-8cf7-74f0f9745ed4 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:26.696274 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:26.837649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:26.842126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc71c18-b752-4633-bfba-6083e442ad4f None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:26.852201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0cee7-461d-4931-8cf7-74f0f9745ed4 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:26.906959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf8cf1-37b4-4045-b4c9-bbec96fac7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:26.908559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf8cf1-37b4-4045-b4c9-bbec96fac7cf None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:26.909398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf8cf1-37b4-4045-b4c9-bbec96fac7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:26.910009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf8cf1-37b4-4045-b4c9-bbec96fac7cf None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:26.911369 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf8cf1-37b4-4045-b4c9-bbec96fac7cf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:26.911912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf8cf1-37b4-4045-b4c9-bbec96fac7cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:26.914787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf8cf1-37b4-4045-b4c9-bbec96fac7cf None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:26.915319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8c28f-4fed-4ed6-82c4-ebe8d41c8e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:26.915942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8c28f-4fed-4ed6-82c4-ebe8d41c8e9c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:26.916223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8c28f-4fed-4ed6-82c4-ebe8d41c8e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:26.916498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8c28f-4fed-4ed6-82c4-ebe8d41c8e9c None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:26.917256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8c28f-4fed-4ed6-82c4-ebe8d41c8e9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:26.917592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8c28f-4fed-4ed6-82c4-ebe8d41c8e9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:26.919121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8c28f-4fed-4ed6-82c4-ebe8d41c8e9c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:26.953653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 258/510] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Sep 1 05:18:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:26.953653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8c28f-4fed-4ed6-82c4-ebe8d41c8e9c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:26.997899 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 253/511] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Sep 1 05:18:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:27.000084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf8cf1-37b4-4045-b4c9-bbec96fac7cf None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:27.120145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8c28f-4fed-4ed6-82c4-ebe8d41c8e9c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:27.155364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:27.162284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba384c-5542-41a9-9bce-16c35e380093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:27.163327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba384c-5542-41a9-9bce-16c35e380093 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:27.164350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba384c-5542-41a9-9bce-16c35e380093 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:27.164662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba384c-5542-41a9-9bce-16c35e380093 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:27.165415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba384c-5542-41a9-9bce-16c35e380093 None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:27.165742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba384c-5542-41a9-9bce-16c35e380093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:27.167163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba384c-5542-41a9-9bce-16c35e380093 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:27.177747 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 259/512] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:27.179661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf8cf1-37b4-4045-b4c9-bbec96fac7cf None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:27.179983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba384c-5542-41a9-9bce-16c35e380093 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:27.207553 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:27.248880 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b2e60-4671-4eb8-897e-92385e027194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:27.249931 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b2e60-4671-4eb8-897e-92385e027194 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:27.250421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b2e60-4671-4eb8-897e-92385e027194 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:27.250906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b2e60-4671-4eb8-897e-92385e027194 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:27.252076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b2e60-4671-4eb8-897e-92385e027194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:27.252620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b2e60-4671-4eb8-897e-92385e027194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:27.255292 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b2e60-4671-4eb8-897e-92385e027194 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:27.281201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 254/513] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:27.281201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b2e60-4671-4eb8-897e-92385e027194 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:27.316053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba384c-5542-41a9-9bce-16c35e380093 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:27.370530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e9a86-e6df-4b0d-918d-ad6e24a178ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:27.371852 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e9a86-e6df-4b0d-918d-ad6e24a178ad None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:27.372390 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e9a86-e6df-4b0d-918d-ad6e24a178ad None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:27.372994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e9a86-e6df-4b0d-918d-ad6e24a178ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:27.448106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b2e60-4671-4eb8-897e-92385e027194 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:27.491748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e9a86-e6df-4b0d-918d-ad6e24a178ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:27.494090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e9a86-e6df-4b0d-918d-ad6e24a178ad None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:27.510696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:27.518762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd868ed0-c404-4a44-bedd-10dbd5fd71c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:27.518762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd868ed0-c404-4a44-bedd-10dbd5fd71c9 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:27.518762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd868ed0-c404-4a44-bedd-10dbd5fd71c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:27.518762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd868ed0-c404-4a44-bedd-10dbd5fd71c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:27.547509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:27.650204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd868ed0-c404-4a44-bedd-10dbd5fd71c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:27.652627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd868ed0-c404-4a44-bedd-10dbd5fd71c9 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:27.654415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 260/514] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:27.655443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e9a86-e6df-4b0d-918d-ad6e24a178ad None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:27.791313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e9a86-e6df-4b0d-918d-ad6e24a178ad None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:27.807055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:27.837889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941d830-e0be-465d-8522-c252182c878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:27.838771 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941d830-e0be-465d-8522-c252182c878e None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:27.839274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941d830-e0be-465d-8522-c252182c878e None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:27.841263 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941d830-e0be-465d-8522-c252182c878e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:27.844088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 255/515] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:27.845650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd868ed0-c404-4a44-bedd-10dbd5fd71c9 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:27.863447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941d830-e0be-465d-8522-c252182c878e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:27.866502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941d830-e0be-465d-8522-c252182c878e None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-0941d830-e0be-465d-8522-c252182c878e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:27.886841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:27.888131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:27.888970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:27.888970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:27.888970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:27.888970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 261/516] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:27.888970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941d830-e0be-465d-8522-c252182c878e None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:27.933852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:28.008349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd868ed0-c404-4a44-bedd-10dbd5fd71c9 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:28.031363 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941d830-e0be-465d-8522-c252182c878e None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:28.060572 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7792bcb-5580-43d2-af95-fce6142b6508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:28.061158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7792bcb-5580-43d2-af95-fce6142b6508 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.061465 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7792bcb-5580-43d2-af95-fce6142b6508 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.061744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7792bcb-5580-43d2-af95-fce6142b6508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.076539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7792bcb-5580-43d2-af95-fce6142b6508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:28.078247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7792bcb-5580-43d2-af95-fce6142b6508 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:28.082725 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879af8d4-ed7c-439f-8a38-a3f19dbbff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:28.083515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af8d4-ed7c-439f-8a38-a3f19dbbff9c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.083886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af8d4-ed7c-439f-8a38-a3f19dbbff9c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.084253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879af8d4-ed7c-439f-8a38-a3f19dbbff9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.094196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879af8d4-ed7c-439f-8a38-a3f19dbbff9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:28.095853 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879af8d4-ed7c-439f-8a38-a3f19dbbff9c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-f7792bcb-5580-43d2-af95-fce6142b6508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:28.099926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:28.102279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:28.103968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:28.103968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:28.103968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:28.103968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 256/517] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:28.103968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7792bcb-5580-43d2-af95-fce6142b6508 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-879af8d4-ed7c-439f-8a38-a3f19dbbff9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:28.113316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:28.117726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:28.120118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:28.120118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:28.120118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:28.120118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:28.120118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:28.120118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:28.120118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:28.120118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:28.120118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 262/518] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:28.120118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879af8d4-ed7c-439f-8a38-a3f19dbbff9c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:28.153609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:28.259584 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879af8d4-ed7c-439f-8a38-a3f19dbbff9c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:28.275777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:28.282454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7792bcb-5580-43d2-af95-fce6142b6508 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:28.303702 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bc016-dff0-4b99-afc0-8557971a595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:28.304465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bc016-dff0-4b99-afc0-8557971a595a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.304805 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bc016-dff0-4b99-afc0-8557971a595a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.305010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bc016-dff0-4b99-afc0-8557971a595a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.324327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bc016-dff0-4b99-afc0-8557971a595a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:28.327097 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bc016-dff0-4b99-afc0-8557971a595a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:28.346217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb94756-d005-410e-9f45-db5b752d1955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:28.346871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb94756-d005-410e-9f45-db5b752d1955 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.347149 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb94756-d005-410e-9f45-db5b752d1955 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.347421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb94756-d005-410e-9f45-db5b752d1955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-896bc016-dff0-4b99-afc0-8557971a595a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:28.354165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:28.356067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:28.357675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:28.357675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:28.357675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:28.357675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 263/519] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:28.357675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bc016-dff0-4b99-afc0-8557971a595a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:28.364412 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb94756-d005-410e-9f45-db5b752d1955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:28.367552 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb94756-d005-410e-9f45-db5b752d1955 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-0cb94756-d005-410e-9f45-db5b752d1955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:28.389365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:28.391356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:28.392447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:28.392447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:28.392447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:28.392970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 257/520] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:28.394466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb94756-d005-410e-9f45-db5b752d1955 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:28.494616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:28.524127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb94756-d005-410e-9f45-db5b752d1955 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:28.535036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bc016-dff0-4b99-afc0-8557971a595a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:28.576343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b0a9f-040b-43cc-8839-9450932a6117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:28.577026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b0a9f-040b-43cc-8839-9450932a6117 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.577435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b0a9f-040b-43cc-8839-9450932a6117 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.577859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b0a9f-040b-43cc-8839-9450932a6117 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.578710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b0a9f-040b-43cc-8839-9450932a6117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:28.579112 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b0a9f-040b-43cc-8839-9450932a6117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:28.580641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2b0a9f-040b-43cc-8839-9450932a6117 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:28.584164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f99db0-74a6-47db-9487-9ee6c423196f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:28.585282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f99db0-74a6-47db-9487-9ee6c423196f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.585856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f99db0-74a6-47db-9487-9ee6c423196f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.586120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f99db0-74a6-47db-9487-9ee6c423196f None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.586865 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f99db0-74a6-47db-9487-9ee6c423196f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:28.587226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f99db0-74a6-47db-9487-9ee6c423196f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:28.588794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f99db0-74a6-47db-9487-9ee6c423196f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:28.596813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 258/521] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:28.598299 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b0a9f-040b-43cc-8839-9450932a6117 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:28.608597 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 264/522] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:28.610120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f99db0-74a6-47db-9487-9ee6c423196f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:28.619333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:28.736806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b0a9f-040b-43cc-8839-9450932a6117 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:28.777564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641def3a-334c-44c4-963f-3adae54c8f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:28.778202 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641def3a-334c-44c4-963f-3adae54c8f65 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.778484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641def3a-334c-44c4-963f-3adae54c8f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.778753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641def3a-334c-44c4-963f-3adae54c8f65 None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.779483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641def3a-334c-44c4-963f-3adae54c8f65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:28.779790 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641def3a-334c-44c4-963f-3adae54c8f65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:28.781347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641def3a-334c-44c4-963f-3adae54c8f65 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:28.787275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f99db0-74a6-47db-9487-9ee6c423196f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:28.802373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 259/523] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:28.803348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641def3a-334c-44c4-963f-3adae54c8f65 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:28.847295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9e103-9cdd-4cad-9ac5-a3c0e77a5a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:28.848017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9e103-9cdd-4cad-9ac5-a3c0e77a5a2d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.848371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9e103-9cdd-4cad-9ac5-a3c0e77a5a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.848714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9e103-9cdd-4cad-9ac5-a3c0e77a5a2d None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.849555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9e103-9cdd-4cad-9ac5-a3c0e77a5a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:28.849920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9e103-9cdd-4cad-9ac5-a3c0e77a5a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:28.852222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9e103-9cdd-4cad-9ac5-a3c0e77a5a2d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:28.855378 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:28.868947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 265/524] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:28.870494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9e103-9cdd-4cad-9ac5-a3c0e77a5a2d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:28.910319 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:28.952211 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641def3a-334c-44c4-963f-3adae54c8f65 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:28.995459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547413d-9a78-4847-91fa-11e4382f32e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:28.996094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547413d-9a78-4847-91fa-11e4382f32e2 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:28.996377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547413d-9a78-4847-91fa-11e4382f32e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:28.996654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547413d-9a78-4847-91fa-11e4382f32e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:28.997343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547413d-9a78-4847-91fa-11e4382f32e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:28.997684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547413d-9a78-4847-91fa-11e4382f32e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:28.999123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547413d-9a78-4847-91fa-11e4382f32e2 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.013406 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 260/525] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:29.014297 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547413d-9a78-4847-91fa-11e4382f32e2 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:29.025335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9e103-9cdd-4cad-9ac5-a3c0e77a5a2d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:29.077581 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877f559-3e3a-4dbe-88d9-ebeb2fdcfe2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:29.078672 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877f559-3e3a-4dbe-88d9-ebeb2fdcfe2f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.079123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877f559-3e3a-4dbe-88d9-ebeb2fdcfe2f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.079407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877f559-3e3a-4dbe-88d9-ebeb2fdcfe2f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.089688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877f559-3e3a-4dbe-88d9-ebeb2fdcfe2f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:29.091258 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877f559-3e3a-4dbe-88d9-ebeb2fdcfe2f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-f877f559-3e3a-4dbe-88d9-ebeb2fdcfe2f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:29.105068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:29.106245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:29.107929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:29.107929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:29.107929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:29.107929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:29.107929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:29.107929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:29.107929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:29.107929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:29.107929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 05:18:29.107929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:29.107929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 266/526] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:29.107929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877f559-3e3a-4dbe-88d9-ebeb2fdcfe2f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:29.156627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547413d-9a78-4847-91fa-11e4382f32e2 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:29.190583 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:29.196976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02040-7e87-4203-a174-23d6e2e1df6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:29.197686 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02040-7e87-4203-a174-23d6e2e1df6b None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.206004 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02040-7e87-4203-a174-23d6e2e1df6b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.206004 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02040-7e87-4203-a174-23d6e2e1df6b None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.206233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:29.206668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af02040-7e87-4203-a174-23d6e2e1df6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:29.206668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af02040-7e87-4203-a174-23d6e2e1df6b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.248364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877f559-3e3a-4dbe-88d9-ebeb2fdcfe2f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:29.284918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13e9b3-2269-4588-99e6-976ea8d17048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:29.285567 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13e9b3-2269-4588-99e6-976ea8d17048 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.285854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13e9b3-2269-4588-99e6-976ea8d17048 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.286134 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13e9b3-2269-4588-99e6-976ea8d17048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.286888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13e9b3-2269-4588-99e6-976ea8d17048 None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=c596e424ab8e4637bae1721488c9fcc9) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:29.287202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13e9b3-2269-4588-99e6-976ea8d17048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:29.288755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13e9b3-2269-4588-99e6-976ea8d17048 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.295257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 267/527] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:18:29 2022] GET /identity/v3/role_assignments?user.id=c596e424ab8e4637bae1721488c9fcc9&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:29.296345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13e9b3-2269-4588-99e6-976ea8d17048 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:29.352222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 261/528] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:18:29 2022] POST /identity/v3/users => generated 247 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:29.363056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02040-7e87-4203-a174-23d6e2e1df6b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:29.493095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13e9b3-2269-4588-99e6-976ea8d17048 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:29.531839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:29.552444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02040-7e87-4203-a174-23d6e2e1df6b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:29.565444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fc55a-bc65-41cd-8eca-4f8c9a2a0401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:29.565444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fc55a-bc65-41cd-8eca-4f8c9a2a0401 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.565444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fc55a-bc65-41cd-8eca-4f8c9a2a0401 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.565444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fc55a-bc65-41cd-8eca-4f8c9a2a0401 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.578176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fc55a-bc65-41cd-8eca-4f8c9a2a0401 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:29.580900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fc55a-bc65-41cd-8eca-4f8c9a2a0401 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-244fc55a-bc65-41cd-8eca-4f8c9a2a0401 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:29.608534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:29.611984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:29.613750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:29.613750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:29.613750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:29.613750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:29.613750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:29.613750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:29.613750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:29.613750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:29.613750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 268/529] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:29.613750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fc55a-bc65-41cd-8eca-4f8c9a2a0401 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:29.633074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190f6af-2632-4ed0-b028-9374d501d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:29.635920 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190f6af-2632-4ed0-b028-9374d501d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.636523 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190f6af-2632-4ed0-b028-9374d501d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.636925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190f6af-2632-4ed0-b028-9374d501d2d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.650469 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190f6af-2632-4ed0-b028-9374d501d2d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:29.652893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190f6af-2632-4ed0-b028-9374d501d2d1 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-e190f6af-2632-4ed0-b028-9374d501d2d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:29.678773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:29.680441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:29.682097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:29.682097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:29.682097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:29.682097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:29.682097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:29.682097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:29.682097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:29.682097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:29.685549 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 262/530] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:29.687107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190f6af-2632-4ed0-b028-9374d501d2d1 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:29.801717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:29.846844 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fc55a-bc65-41cd-8eca-4f8c9a2a0401 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:29.907625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d91f4-9e30-4dbd-b699-bac1bb8ea747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:29.908574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d91f4-9e30-4dbd-b699-bac1bb8ea747 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:29.909073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d91f4-9e30-4dbd-b699-bac1bb8ea747 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:29.909548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d91f4-9e30-4dbd-b699-bac1bb8ea747 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:29.910507 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d91f4-9e30-4dbd-b699-bac1bb8ea747 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:29.910987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d91f4-9e30-4dbd-b699-bac1bb8ea747 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:29.914074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d91f4-9e30-4dbd-b699-bac1bb8ea747 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:29.939593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190f6af-2632-4ed0-b028-9374d501d2d1 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:29.940936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 269/531] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Sep 1 05:18:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:29.942031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d91f4-9e30-4dbd-b699-bac1bb8ea747 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.001250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:30.010766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da96b94-d7a5-44f2-929c-32111eb44ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.014894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da96b94-d7a5-44f2-929c-32111eb44ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.014894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da96b94-d7a5-44f2-929c-32111eb44ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.014894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da96b94-d7a5-44f2-929c-32111eb44ff4 None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.014894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da96b94-d7a5-44f2-929c-32111eb44ff4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:30.015236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da96b94-d7a5-44f2-929c-32111eb44ff4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.017995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da96b94-d7a5-44f2-929c-32111eb44ff4 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.044154 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 263/532] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:30.046355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da96b94-d7a5-44f2-929c-32111eb44ff4 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.085970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d91f4-9e30-4dbd-b699-bac1bb8ea747 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.130564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd93712-f984-4739-aae8-d5a3f6e1718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.132623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd93712-f984-4739-aae8-d5a3f6e1718c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.133313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd93712-f984-4739-aae8-d5a3f6e1718c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.133856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd93712-f984-4739-aae8-d5a3f6e1718c None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.134849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd93712-f984-4739-aae8-d5a3f6e1718c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:30.135431 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd93712-f984-4739-aae8-d5a3f6e1718c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.137391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd93712-f984-4739-aae8-d5a3f6e1718c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.160169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 270/533] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:30.161596 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd93712-f984-4739-aae8-d5a3f6e1718c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.255515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da96b94-d7a5-44f2-929c-32111eb44ff4 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.277948 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:30.297950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33b31a-ece6-49c8-b27e-f8df23dbbde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.298984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33b31a-ece6-49c8-b27e-f8df23dbbde5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.299126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33b31a-ece6-49c8-b27e-f8df23dbbde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.299506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33b31a-ece6-49c8-b27e-f8df23dbbde5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.302386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd93712-f984-4739-aae8-d5a3f6e1718c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.318119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:30.354957 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626a70b-c09b-4d9a-98fc-fe288a1c3534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.361252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626a70b-c09b-4d9a-98fc-fe288a1c3534 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.361252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626a70b-c09b-4d9a-98fc-fe288a1c3534 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.361252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626a70b-c09b-4d9a-98fc-fe288a1c3534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.361252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626a70b-c09b-4d9a-98fc-fe288a1c3534 None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=e03daa3b2e334436ad4d0b2915a61aa1) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:30.361252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626a70b-c09b-4d9a-98fc-fe288a1c3534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.361252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626a70b-c09b-4d9a-98fc-fe288a1c3534 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.368918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 271/534] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:18:30 2022] GET /identity/v3/role_assignments?user.id=e03daa3b2e334436ad4d0b2915a61aa1&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:30.370199 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626a70b-c09b-4d9a-98fc-fe288a1c3534 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.448003 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33b31a-ece6-49c8-b27e-f8df23dbbde5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.450861 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33b31a-ece6-49c8-b27e-f8df23dbbde5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.592501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626a70b-c09b-4d9a-98fc-fe288a1c3534 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.638921 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42ebb9-53ad-4ea1-bde5-5fccf1286e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.639971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42ebb9-53ad-4ea1-bde5-5fccf1286e97 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.640516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42ebb9-53ad-4ea1-bde5-5fccf1286e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.640813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42ebb9-53ad-4ea1-bde5-5fccf1286e97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.641603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42ebb9-53ad-4ea1-bde5-5fccf1286e97 None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=b7e84a5652df4d64aa1fd28f3d5383fe) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:30.641917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42ebb9-53ad-4ea1-bde5-5fccf1286e97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.643487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42ebb9-53ad-4ea1-bde5-5fccf1286e97 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.651866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 272/535] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:18:30 2022] GET /identity/v3/role_assignments?user.id=b7e84a5652df4d64aa1fd28f3d5383fe&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:30.732118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 264/536] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:30.737660 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42ebb9-53ad-4ea1-bde5-5fccf1286e97 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.779482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:30.918662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42ebb9-53ad-4ea1-bde5-5fccf1286e97 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.017146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c86d6-03c7-41af-b542-044d6a90297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.018208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c86d6-03c7-41af-b542-044d6a90297f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.018699 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c86d6-03c7-41af-b542-044d6a90297f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.019183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c86d6-03c7-41af-b542-044d6a90297f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.046419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c86d6-03c7-41af-b542-044d6a90297f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.049040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c86d6-03c7-41af-b542-044d6a90297f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-9b8c86d6-03c7-41af-b542-044d6a90297f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:31.080609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:31.081635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:31.082482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:31.082482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:31.082482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:31.083797 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 273/537] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:31.094800 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33b31a-ece6-49c8-b27e-f8df23dbbde5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:31.105829 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:31.249615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33b31a-ece6-49c8-b27e-f8df23dbbde5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.293415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad068-8b77-406b-8c84-c894ae32bec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.293960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad068-8b77-406b-8c84-c894ae32bec4 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.294244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad068-8b77-406b-8c84-c894ae32bec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.294519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad068-8b77-406b-8c84-c894ae32bec4 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.295191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad068-8b77-406b-8c84-c894ae32bec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:31.295498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad068-8b77-406b-8c84-c894ae32bec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.296938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad068-8b77-406b-8c84-c894ae32bec4 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.311740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 265/538] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:31.317494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c86d6-03c7-41af-b542-044d6a90297f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:31.458226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:31.490343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c86d6-03c7-41af-b542-044d6a90297f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.555432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9898b3-b079-46ae-94e7-0735708e47e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.556461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9898b3-b079-46ae-94e7-0735708e47e3 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.556950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9898b3-b079-46ae-94e7-0735708e47e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.557459 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9898b3-b079-46ae-94e7-0735708e47e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.572766 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9898b3-b079-46ae-94e7-0735708e47e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.574733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9898b3-b079-46ae-94e7-0735708e47e3 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-ad9898b3-b079-46ae-94e7-0735708e47e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:31.589114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:31.590066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:31.590928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:31.590928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:31.590928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:31.590928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:31.590928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:31.590928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:31.590928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:31.590928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:31.593533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 274/539] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:31.602701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad068-8b77-406b-8c84-c894ae32bec4 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:31.759332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:31.837417 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad068-8b77-406b-8c84-c894ae32bec4 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.884032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc5ef1-77e0-4179-9bd7-906d7771e65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.884692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc5ef1-77e0-4179-9bd7-906d7771e65e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.884978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc5ef1-77e0-4179-9bd7-906d7771e65e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.885260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc5ef1-77e0-4179-9bd7-906d7771e65e None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.886035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc5ef1-77e0-4179-9bd7-906d7771e65e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:31.886372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc5ef1-77e0-4179-9bd7-906d7771e65e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.890574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc5ef1-77e0-4179-9bd7-906d7771e65e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.904093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 266/540] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:31.910914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9898b3-b079-46ae-94e7-0735708e47e3 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:32.090159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9898b3-b079-46ae-94e7-0735708e47e3 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:32.134953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee501e-0846-4e7c-a269-b8e543931772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:32.135989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee501e-0846-4e7c-a269-b8e543931772 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:32.136484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee501e-0846-4e7c-a269-b8e543931772 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:32.136967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee501e-0846-4e7c-a269-b8e543931772 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:32.137997 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee501e-0846-4e7c-a269-b8e543931772 None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=2e7d31c0ec474c428ed932882b989d2b) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:32.138642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee501e-0846-4e7c-a269-b8e543931772 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:32.140424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee501e-0846-4e7c-a269-b8e543931772 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:32.148518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 275/541] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:18:31 2022] GET /identity/v3/role_assignments?user.id=2e7d31c0ec474c428ed932882b989d2b&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:32.643204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e414f17-e0c4-4d3f-81a0-03bc798a3d67 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:32.644324 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e414f17-e0c4-4d3f-81a0-03bc798a3d67 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:32.644826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e414f17-e0c4-4d3f-81a0-03bc798a3d67 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:32.646986 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 267/542] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:32.656092 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242dd19-142b-482b-b4a2-056fc59d5b1d None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:32.657016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242dd19-142b-482b-b4a2-056fc59d5b1d None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:32.657657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242dd19-142b-482b-b4a2-056fc59d5b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:32.669944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:32.706646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c242dd19-142b-482b-b4a2-056fc59d5b1d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:32.708369 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c242dd19-142b-482b-b4a2-056fc59d5b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:32.710758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ae968-27ce-45a8-b496-5455e9a376b5 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:32.711257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ae968-27ce-45a8-b496-5455e9a376b5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:32.711748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ae968-27ce-45a8-b496-5455e9a376b5 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:32.739040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 268/543] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:32.739040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd273616-8b5e-4ee3-a2f2-6cbb4a0c5eea None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:32.739040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd273616-8b5e-4ee3-a2f2-6cbb4a0c5eea None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:32.739040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd273616-8b5e-4ee3-a2f2-6cbb4a0c5eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:32.784994 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-dd273616-8b5e-4ee3-a2f2-6cbb4a0c5eea None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:32.786804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-dd273616-8b5e-4ee3-a2f2-6cbb4a0c5eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:32.825197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 276/544] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:32.936256 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 269/545] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:18:33.523271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242dd19-142b-482b-b4a2-056fc59d5b1d None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:33.631092 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd273616-8b5e-4ee3-a2f2-6cbb4a0c5eea None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:33.762711 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:33.838910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242dd19-142b-482b-b4a2-056fc59d5b1d None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:33.951306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd273616-8b5e-4ee3-a2f2-6cbb4a0c5eea None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:33.955754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:33.963353 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd525a-e783-4aac-bf85-dd7586bb35d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:33.964039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd525a-e783-4aac-bf85-dd7586bb35d1 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:33.964350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd525a-e783-4aac-bf85-dd7586bb35d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:33.964643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd525a-e783-4aac-bf85-dd7586bb35d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:33.992757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd525a-e783-4aac-bf85-dd7586bb35d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-06bd525a-e783-4aac-bf85-dd7586bb35d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:34.006669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:34.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:34.008523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:34.008523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:34.008523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:34.008523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:34.008523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:34.008523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:34.008523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:34.008523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:34.008523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:34.008523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:34.008523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:34.008523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:34.011144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 277/546] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 490 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:34.017679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd525a-e783-4aac-bf85-dd7586bb35d1 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:34.042371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8a2d0a-9be7-474c-91ff-f273452382af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:34.043753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2d0a-9be7-474c-91ff-f273452382af None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:34.044261 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2d0a-9be7-474c-91ff-f273452382af None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:34.045216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8a2d0a-9be7-474c-91ff-f273452382af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:34.074122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8a2d0a-9be7-474c-91ff-f273452382af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-8b8a2d0a-9be7-474c-91ff-f273452382af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:34.086990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:34.089066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:34.091530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 270/547] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 459 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:18:34.092874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4b4db-9919-4954-a403-b3e41880cd48 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:34.092874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4b4db-9919-4954-a403-b3e41880cd48 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:34.092874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4b4db-9919-4954-a403-b3e41880cd48 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:34.095664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 271/548] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:34.097536 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f009-9506-40fe-8545-4e8b8c5620a3 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:34.097970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f009-9506-40fe-8545-4e8b8c5620a3 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:34.098387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21f009-9506-40fe-8545-4e8b8c5620a3 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:34.102389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 272/549] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:34.103804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21f009-9506-40fe-8545-4e8b8c5620a3 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:34.203145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd525a-e783-4aac-bf85-dd7586bb35d1 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:34.253416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0746348-9687-40be-99b3-2313d96afaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:34.254181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0746348-9687-40be-99b3-2313d96afaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:34.254495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0746348-9687-40be-99b3-2313d96afaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:34.254854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0746348-9687-40be-99b3-2313d96afaa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:34.255687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0746348-9687-40be-99b3-2313d96afaa7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:34.256162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0746348-9687-40be-99b3-2313d96afaa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:34.258479 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0746348-9687-40be-99b3-2313d96afaa7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:34.270152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 278/550] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:34.272380 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9eb81-2008-403d-8f22-12cc0aa950d9 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:34.272864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9eb81-2008-403d-8f22-12cc0aa950d9 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:34.273353 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9eb81-2008-403d-8f22-12cc0aa950d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:34.295784 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c3c9eb81-2008-403d-8f22-12cc0aa950d9 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:34.297141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c3c9eb81-2008-403d-8f22-12cc0aa950d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:34.313519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21f009-9506-40fe-8545-4e8b8c5620a3 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:34.350819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:34.372982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:34.389428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4122138-a562-442c-a5ad-3e930ca98cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:34.390516 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4122138-a562-442c-a5ad-3e930ca98cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:34.390996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4122138-a562-442c-a5ad-3e930ca98cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:34.391491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4122138-a562-442c-a5ad-3e930ca98cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:34.392709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4122138-a562-442c-a5ad-3e930ca98cd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:34.393318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4122138-a562-442c-a5ad-3e930ca98cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:34.396149 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4122138-a562-442c-a5ad-3e930ca98cd6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:34.409413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 279/551] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:34.409413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fb991-7445-421d-81f6-bc2854663fb7 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:34.409413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fb991-7445-421d-81f6-bc2854663fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:34.409413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fb991-7445-421d-81f6-bc2854663fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:34.423943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 273/552] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:34.425831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4122138-a562-442c-a5ad-3e930ca98cd6 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:34.435723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-728fb991-7445-421d-81f6-bc2854663fb7 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:34.437460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-728fb991-7445-421d-81f6-bc2854663fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:34.547576 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 280/553] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:34.547576 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fb991-7445-421d-81f6-bc2854663fb7 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:34.617090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4122138-a562-442c-a5ad-3e930ca98cd6 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:34.710239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15442e71-5a8c-4012-a5bd-46cc0a5b08c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:34.713488 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15442e71-5a8c-4012-a5bd-46cc0a5b08c9 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:34.714044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15442e71-5a8c-4012-a5bd-46cc0a5b08c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:34.714705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15442e71-5a8c-4012-a5bd-46cc0a5b08c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:34.760884 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15442e71-5a8c-4012-a5bd-46cc0a5b08c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:34.763948 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15442e71-5a8c-4012-a5bd-46cc0a5b08c9 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-15442e71-5a8c-4012-a5bd-46cc0a5b08c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:34.785601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:34.786584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:34.788062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:34.788062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:34.788062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:34.791081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 274/554] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:34.792676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15442e71-5a8c-4012-a5bd-46cc0a5b08c9 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:34.823955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fb991-7445-421d-81f6-bc2854663fb7 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:34.839111 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:34.855855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:34.884182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e5e71-021e-42ab-832c-9877a5a887a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:34.884751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5e71-021e-42ab-832c-9877a5a887a8 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:34.885016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5e71-021e-42ab-832c-9877a5a887a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:34.885483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e5e71-021e-42ab-832c-9877a5a887a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:34.897069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e5e71-021e-42ab-832c-9877a5a887a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:34.898605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e5e71-021e-42ab-832c-9877a5a887a8 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-216e5e71-021e-42ab-832c-9877a5a887a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:34.925232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:34.926517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:34.927704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:34.927704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:34.927704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:34.927704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 281/555] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:34.929076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e5e71-021e-42ab-832c-9877a5a887a8 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:34.938448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15442e71-5a8c-4012-a5bd-46cc0a5b08c9 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:34.991095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f72cf-3f2d-4548-95df-38e85ae47deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:34.992096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f72cf-3f2d-4548-95df-38e85ae47deb None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:34.992545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f72cf-3f2d-4548-95df-38e85ae47deb None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:34.993237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f72cf-3f2d-4548-95df-38e85ae47deb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:35.012783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f72cf-3f2d-4548-95df-38e85ae47deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-6a3f72cf-3f2d-4548-95df-38e85ae47deb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:35.022239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:35.023941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 275/556] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:35.025510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f72cf-3f2d-4548-95df-38e85ae47deb None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:35.091884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e5e71-021e-42ab-832c-9877a5a887a8 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:35.152177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff3a4ac-c9b0-4259-a9f5-f15169727eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:35.153045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3a4ac-c9b0-4259-a9f5-f15169727eea None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:35.153546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3a4ac-c9b0-4259-a9f5-f15169727eea None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:35.154003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff3a4ac-c9b0-4259-a9f5-f15169727eea None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:35.155142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3a4ac-c9b0-4259-a9f5-f15169727eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:35.155626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3a4ac-c9b0-4259-a9f5-f15169727eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:35.157718 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff3a4ac-c9b0-4259-a9f5-f15169727eea None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:35.173808 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 282/557] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:35.176075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111fb8c-c709-4c52-9eda-62bbc0e118a2 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:35.176561 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111fb8c-c709-4c52-9eda-62bbc0e118a2 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:35.177033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111fb8c-c709-4c52-9eda-62bbc0e118a2 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:35.184359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 283/558] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:35.184359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111fb8c-c709-4c52-9eda-62bbc0e118a2 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:35.184725 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:35.197555 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f72cf-3f2d-4548-95df-38e85ae47deb None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:35.220365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:35.250436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87757748-bc83-4897-b576-b27d85d290fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:35.251444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87757748-bc83-4897-b576-b27d85d290fe None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:35.251865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87757748-bc83-4897-b576-b27d85d290fe None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:35.252269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87757748-bc83-4897-b576-b27d85d290fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:35.266415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87757748-bc83-4897-b576-b27d85d290fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-87757748-bc83-4897-b576-b27d85d290fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:35.273348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:35.275918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 276/559] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:35.277620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87757748-bc83-4897-b576-b27d85d290fe None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:35.340121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111fb8c-c709-4c52-9eda-62bbc0e118a2 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:35.393624 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededc3ce-5cb8-4ac2-9dec-01d058c697ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:35.394452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededc3ce-5cb8-4ac2-9dec-01d058c697ff None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:35.394804 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededc3ce-5cb8-4ac2-9dec-01d058c697ff None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:35.395150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededc3ce-5cb8-4ac2-9dec-01d058c697ff None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:35.396002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededc3ce-5cb8-4ac2-9dec-01d058c697ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:35.396369 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededc3ce-5cb8-4ac2-9dec-01d058c697ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:35.399142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededc3ce-5cb8-4ac2-9dec-01d058c697ff None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:35.407622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87757748-bc83-4897-b576-b27d85d290fe None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:35.415532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 284/560] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:35.416701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededc3ce-5cb8-4ac2-9dec-01d058c697ff None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:35.459584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e7a4-7c87-4e2b-8354-6476c09ee0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:35.460226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e7a4-7c87-4e2b-8354-6476c09ee0be None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:35.460774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e7a4-7c87-4e2b-8354-6476c09ee0be None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:35.461041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e7a4-7c87-4e2b-8354-6476c09ee0be None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:35.461786 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e7a4-7c87-4e2b-8354-6476c09ee0be None admin] RBAC: Adding query filter params (name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:35.462088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e7a4-7c87-4e2b-8354-6476c09ee0be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:35.463539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e7a4-7c87-4e2b-8354-6476c09ee0be None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:35.473453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 277/561] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:35.475376 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed00d0f-7d6b-4068-8fa4-4fef717e4791 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:35.475894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed00d0f-7d6b-4068-8fa4-4fef717e4791 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:35.476411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed00d0f-7d6b-4068-8fa4-4fef717e4791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:35.497959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-eed00d0f-7d6b-4068-8fa4-4fef717e4791 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:35.499404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-eed00d0f-7d6b-4068-8fa4-4fef717e4791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:35.512220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:35.549059 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:35.572189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededc3ce-5cb8-4ac2-9dec-01d058c697ff None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:35.604700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 278/562] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:35.616468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed00d0f-7d6b-4068-8fa4-4fef717e4791 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:35.641560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624d52a-0e3b-44c8-a884-38717198dda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:35.642591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624d52a-0e3b-44c8-a884-38717198dda5 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:35.643064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624d52a-0e3b-44c8-a884-38717198dda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:35.643534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624d52a-0e3b-44c8-a884-38717198dda5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:35.658130 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624d52a-0e3b-44c8-a884-38717198dda5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:35.660482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624d52a-0e3b-44c8-a884-38717198dda5 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-c624d52a-0e3b-44c8-a884-38717198dda5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:35.682344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:35.684185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:35.689160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:35.689160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:35.689160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:35.689160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:35.689160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:35.689160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:35.689160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:35.689160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:35.689160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 05:18:35.689160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:35.689160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 285/563] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:35.689160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624d52a-0e3b-44c8-a884-38717198dda5 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:35.788416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed00d0f-7d6b-4068-8fa4-4fef717e4791 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:35.864805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac030fa-df1d-4266-bdbd-8770862de0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:35.866445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac030fa-df1d-4266-bdbd-8770862de0ec None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:35.866898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac030fa-df1d-4266-bdbd-8770862de0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:35.867349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac030fa-df1d-4266-bdbd-8770862de0ec None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:35.868563 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac030fa-df1d-4266-bdbd-8770862de0ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:35.869104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac030fa-df1d-4266-bdbd-8770862de0ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:35.871752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac030fa-df1d-4266-bdbd-8770862de0ec None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:35.879658 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624d52a-0e3b-44c8-a884-38717198dda5 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:35.888057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 279/564] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:35.892917 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac030fa-df1d-4266-bdbd-8770862de0ec None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:35.900050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:35.924420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bcb31-f34c-4ce9-930c-75e0e10e3682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:35.925008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bcb31-f34c-4ce9-930c-75e0e10e3682 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:35.925350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bcb31-f34c-4ce9-930c-75e0e10e3682 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:35.925673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bcb31-f34c-4ce9-930c-75e0e10e3682 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:35.935218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bcb31-f34c-4ce9-930c-75e0e10e3682 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:35.936731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bcb31-f34c-4ce9-930c-75e0e10e3682 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-e43bcb31-f34c-4ce9-930c-75e0e10e3682 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:35.949694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:35.950967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:35.952791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:35.952791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:35.952791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:35.952791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:35.952791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:35.952791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:35.952791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:35.952791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:35.952791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:18:35.952791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:35.952791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 286/565] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:18:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:35.952791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bcb31-f34c-4ce9-930c-75e0e10e3682 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:35.966975 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:36.076700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac030fa-df1d-4266-bdbd-8770862de0ec None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:36.095371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bcb31-f34c-4ce9-930c-75e0e10e3682 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:36.128958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784073f-969e-4abe-a920-6be5ac539647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:36.129855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784073f-969e-4abe-a920-6be5ac539647 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:36.130304 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784073f-969e-4abe-a920-6be5ac539647 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:36.130753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784073f-969e-4abe-a920-6be5ac539647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:36.148813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de63799-8c81-4fc1-b9df-b81dc70f37b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:36.149817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de63799-8c81-4fc1-b9df-b81dc70f37b9 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:36.150276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de63799-8c81-4fc1-b9df-b81dc70f37b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:36.150718 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de63799-8c81-4fc1-b9df-b81dc70f37b9 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:36.151943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784073f-969e-4abe-a920-6be5ac539647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:36.152126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de63799-8c81-4fc1-b9df-b81dc70f37b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:36.152548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de63799-8c81-4fc1-b9df-b81dc70f37b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:36.154563 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784073f-969e-4abe-a920-6be5ac539647 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:36.154991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de63799-8c81-4fc1-b9df-b81dc70f37b9 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-5784073f-969e-4abe-a920-6be5ac539647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:36.183152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:36.185248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:36.187101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:36.187101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:36.187101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:36.187101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 280/566] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:36.187101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784073f-969e-4abe-a920-6be5ac539647 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:36.187655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 287/567] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Sep 1 05:18:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:36.188366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de63799-8c81-4fc1-b9df-b81dc70f37b9 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:36.269399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:36.288389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:36.329127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784073f-969e-4abe-a920-6be5ac539647 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:36.348771 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de63799-8c81-4fc1-b9df-b81dc70f37b9 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:36.385455 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9baa24-be2c-4602-9a28-a705869bcb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:36.386602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9baa24-be2c-4602-9a28-a705869bcb0b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:36.387191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9baa24-be2c-4602-9a28-a705869bcb0b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:36.387678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9baa24-be2c-4602-9a28-a705869bcb0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:36.405276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d15f39-5ea0-4124-a377-d6c192d2184e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:36.408638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d15f39-5ea0-4124-a377-d6c192d2184e None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:36.408638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d15f39-5ea0-4124-a377-d6c192d2184e None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:36.408638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d15f39-5ea0-4124-a377-d6c192d2184e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:36.409086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9baa24-be2c-4602-9a28-a705869bcb0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-3e9baa24-be2c-4602-9a28-a705869bcb0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:36.413458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:36.415322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 281/568] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:36.416740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9baa24-be2c-4602-9a28-a705869bcb0b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:36.430076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d15f39-5ea0-4124-a377-d6c192d2184e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:36.432786 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d15f39-5ea0-4124-a377-d6c192d2184e None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-a4d15f39-5ea0-4124-a377-d6c192d2184e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:36.460021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:36.462397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:36.464536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:36.464536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:36.464536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:36.464536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 288/569] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:36.467751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d15f39-5ea0-4124-a377-d6c192d2184e None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:36.568410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9baa24-be2c-4602-9a28-a705869bcb0b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:36.591359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:36.614444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d67654-b751-446d-9579-47c3dc6c2b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:36.615944 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d67654-b751-446d-9579-47c3dc6c2b1e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:36.616417 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d67654-b751-446d-9579-47c3dc6c2b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:36.616874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d67654-b751-446d-9579-47c3dc6c2b1e None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:36.618177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d67654-b751-446d-9579-47c3dc6c2b1e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:36.618386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d15f39-5ea0-4124-a377-d6c192d2184e None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:36.618670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d67654-b751-446d-9579-47c3dc6c2b1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:36.621347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d67654-b751-446d-9579-47c3dc6c2b1e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:36.644548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:36.666054 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ef2fb-5c4d-4aac-93eb-d50b9be82410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:36.666690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ef2fb-5c4d-4aac-93eb-d50b9be82410 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:36.666970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ef2fb-5c4d-4aac-93eb-d50b9be82410 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:36.667244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ef2fb-5c4d-4aac-93eb-d50b9be82410 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:36.667919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ef2fb-5c4d-4aac-93eb-d50b9be82410 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:36.668226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ef2fb-5c4d-4aac-93eb-d50b9be82410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:36.669683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ef2fb-5c4d-4aac-93eb-d50b9be82410 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:36.684574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 289/570] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:36.685325 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ef2fb-5c4d-4aac-93eb-d50b9be82410 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:36.695273 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 282/571] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Sep 1 05:18:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:36.696304 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d67654-b751-446d-9579-47c3dc6c2b1e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:36.845838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d67654-b751-446d-9579-47c3dc6c2b1e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:36.848242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ef2fb-5c4d-4aac-93eb-d50b9be82410 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:36.889165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5931-c29d-4fb4-8826-9ba0700ca4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:36.890410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5931-c29d-4fb4-8826-9ba0700ca4fb None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:36.890929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5931-c29d-4fb4-8826-9ba0700ca4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:36.891519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5931-c29d-4fb4-8826-9ba0700ca4fb None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:36.892453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d5931-c29d-4fb4-8826-9ba0700ca4fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:36.893058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d5931-c29d-4fb4-8826-9ba0700ca4fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:36.895295 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d5931-c29d-4fb4-8826-9ba0700ca4fb None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:36.899704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368996b-8d01-46f0-ac39-5c44832f8a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:36.900558 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368996b-8d01-46f0-ac39-5c44832f8a41 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:36.900696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368996b-8d01-46f0-ac39-5c44832f8a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:36.900886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368996b-8d01-46f0-ac39-5c44832f8a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:36.913763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 283/572] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:36.913763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5931-c29d-4fb4-8826-9ba0700ca4fb None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:36.914648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368996b-8d01-46f0-ac39-5c44832f8a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:36.916178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368996b-8d01-46f0-ac39-5c44832f8a41 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-d368996b-8d01-46f0-ac39-5c44832f8a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:36.933637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:36.943807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:36.946181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:36.946181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:36.946181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:36.946181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 290/573] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:36.946181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368996b-8d01-46f0-ac39-5c44832f8a41 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:36.963136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:36.978574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:37.042912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5931-c29d-4fb4-8826-9ba0700ca4fb None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:37.084145 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da73567-9b7c-4402-b3a8-bc950d373091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:37.085045 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da73567-9b7c-4402-b3a8-bc950d373091 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:37.085045 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da73567-9b7c-4402-b3a8-bc950d373091 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:37.085620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da73567-9b7c-4402-b3a8-bc950d373091 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:37.086186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da73567-9b7c-4402-b3a8-bc950d373091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:37.086492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da73567-9b7c-4402-b3a8-bc950d373091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:37.087938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da73567-9b7c-4402-b3a8-bc950d373091 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:37.101607 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 284/574] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:37.102507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da73567-9b7c-4402-b3a8-bc950d373091 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:37.115370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368996b-8d01-46f0-ac39-5c44832f8a41 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:37.180420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83613ead-5106-435c-84f5-311fd31790c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:37.181548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83613ead-5106-435c-84f5-311fd31790c7 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:37.182048 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83613ead-5106-435c-84f5-311fd31790c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:37.182521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83613ead-5106-435c-84f5-311fd31790c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:37.197171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83613ead-5106-435c-84f5-311fd31790c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:37.199877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83613ead-5106-435c-84f5-311fd31790c7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-83613ead-5106-435c-84f5-311fd31790c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:37.215575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:37.217762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:37.219991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:37.219991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:37.219991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:37.219991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:37.219991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:37.219991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:37.219991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:37.219991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:37.219991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:18:37.219991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:37.219991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 291/575] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Sep 1 05:18:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:37.221129 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83613ead-5106-435c-84f5-311fd31790c7 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:37.223876 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:37.233757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da73567-9b7c-4402-b3a8-bc950d373091 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:37.279217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cbe45-4f45-495b-b26d-15a7c6ab5e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:37.279839 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cbe45-4f45-495b-b26d-15a7c6ab5e86 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:37.280120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cbe45-4f45-495b-b26d-15a7c6ab5e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:37.280394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cbe45-4f45-495b-b26d-15a7c6ab5e86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:37.370296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cbe45-4f45-495b-b26d-15a7c6ab5e86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:37.372361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cbe45-4f45-495b-b26d-15a7c6ab5e86 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:37.384178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:37.406081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83613ead-5106-435c-84f5-311fd31790c7 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:37.466942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4283e6-c95b-4b23-8c39-cbddda49a637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:37.467594 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4283e6-c95b-4b23-8c39-cbddda49a637 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:37.467877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4283e6-c95b-4b23-8c39-cbddda49a637 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:37.468151 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4283e6-c95b-4b23-8c39-cbddda49a637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:37.480935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4283e6-c95b-4b23-8c39-cbddda49a637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:37.482499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4283e6-c95b-4b23-8c39-cbddda49a637 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-3f4283e6-c95b-4b23-8c39-cbddda49a637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:37.499628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:37.501564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:37.502490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:37.502490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:37.502490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:37.502490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 292/576] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:37.502490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4283e6-c95b-4b23-8c39-cbddda49a637 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:37.515939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:37.524586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 285/577] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:37.528244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cbe45-4f45-495b-b26d-15a7c6ab5e86 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:37.672447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cbe45-4f45-495b-b26d-15a7c6ab5e86 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:37.674950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4283e6-c95b-4b23-8c39-cbddda49a637 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:37.716799 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91df04d-eb26-4b3f-adfd-efc24fc78bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:37.717613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91df04d-eb26-4b3f-adfd-efc24fc78bba None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:37.717978 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91df04d-eb26-4b3f-adfd-efc24fc78bba None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:37.718837 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91df04d-eb26-4b3f-adfd-efc24fc78bba None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:37.719681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91df04d-eb26-4b3f-adfd-efc24fc78bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:37.719985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91df04d-eb26-4b3f-adfd-efc24fc78bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:37.721510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91df04d-eb26-4b3f-adfd-efc24fc78bba None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:37.725348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40376c2-74d1-4c4c-a7b0-f04ff58625f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:37.726424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40376c2-74d1-4c4c-a7b0-f04ff58625f8 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:37.726721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40376c2-74d1-4c4c-a7b0-f04ff58625f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:37.727017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40376c2-74d1-4c4c-a7b0-f04ff58625f8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:37.733698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:37.735752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40376c2-74d1-4c4c-a7b0-f04ff58625f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:37.737241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40376c2-74d1-4c4c-a7b0-f04ff58625f8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:37.737553 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 293/578] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:37.738661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91df04d-eb26-4b3f-adfd-efc24fc78bba None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-f40376c2-74d1-4c4c-a7b0-f04ff58625f8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:37.751794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:37.753812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:37.761071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:37.761071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:37.761071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:37.761071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:37.761071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:37.761071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:37.761071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:37.761071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:37.761071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:18:37.761071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:37.761071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 286/579] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:37.761071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40376c2-74d1-4c4c-a7b0-f04ff58625f8 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:37.859391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:37.894304 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91df04d-eb26-4b3f-adfd-efc24fc78bba None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:37.912196 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40376c2-74d1-4c4c-a7b0-f04ff58625f8 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:37.951441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4470b-31ca-4f4e-8d39-290e8ca4bbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:37.952217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4470b-31ca-4f4e-8d39-290e8ca4bbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:37.952217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4470b-31ca-4f4e-8d39-290e8ca4bbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:37.952490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4470b-31ca-4f4e-8d39-290e8ca4bbe5 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:37.953227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4470b-31ca-4f4e-8d39-290e8ca4bbe5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:37.953563 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4470b-31ca-4f4e-8d39-290e8ca4bbe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:37.955065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4470b-31ca-4f4e-8d39-290e8ca4bbe5 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:37.960102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ba663-5755-455a-b946-10b9287fd252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:37.961409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ba663-5755-455a-b946-10b9287fd252 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:37.961886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ba663-5755-455a-b946-10b9287fd252 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:37.962360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ba663-5755-455a-b946-10b9287fd252 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:37.963534 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ba663-5755-455a-b946-10b9287fd252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:37.964053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ba663-5755-455a-b946-10b9287fd252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:37.966584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ba663-5755-455a-b946-10b9287fd252 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:37.977051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 294/580] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Sep 1 05:18:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:37.977977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4470b-31ca-4f4e-8d39-290e8ca4bbe5 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:37.993821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 287/581] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:37.995220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ba663-5755-455a-b946-10b9287fd252 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:38.054816 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:38.128497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4470b-31ca-4f4e-8d39-290e8ca4bbe5 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:38.152619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ba663-5755-455a-b946-10b9287fd252 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:38.174180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:38.175896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdbb94-f69b-4a47-923d-4ee7d75e7aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:38.176817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdbb94-f69b-4a47-923d-4ee7d75e7aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:38.177148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdbb94-f69b-4a47-923d-4ee7d75e7aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:38.177450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdbb94-f69b-4a47-923d-4ee7d75e7aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:38.191698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdbb94-f69b-4a47-923d-4ee7d75e7aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:38.193294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdbb94-f69b-4a47-923d-4ee7d75e7aa2 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:38.199810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb5673-2ce9-4073-8ad7-af40bafe7e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:38.200523 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb5673-2ce9-4073-8ad7-af40bafe7e86 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:38.200835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb5673-2ce9-4073-8ad7-af40bafe7e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:38.201226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb5673-2ce9-4073-8ad7-af40bafe7e86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:38.211109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb5673-2ce9-4073-8ad7-af40bafe7e86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-ecbdbb94-f69b-4a47-923d-4ee7d75e7aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:38.211402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:38.213314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:38.215177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:38.215177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:38.215177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:38.215177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 295/582] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:38.215177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdbb94-f69b-4a47-923d-4ee7d75e7aa2 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:38.215741 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb5673-2ce9-4073-8ad7-af40bafe7e86 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-15bb5673-2ce9-4073-8ad7-af40bafe7e86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:38.238850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:38.241204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:38.243140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:38.243140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:38.243140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:38.243140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:38.243140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:38.243140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:38.243140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:38.243140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:38.243140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 288/583] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:38.245718 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb5673-2ce9-4073-8ad7-af40bafe7e86 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:38.361582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdbb94-f69b-4a47-923d-4ee7d75e7aa2 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:38.377073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:38.402956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb5673-2ce9-4073-8ad7-af40bafe7e86 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:38.417317 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c48f2-139d-4a78-9b7b-72beea5fe03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:38.418008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c48f2-139d-4a78-9b7b-72beea5fe03d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:38.418292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c48f2-139d-4a78-9b7b-72beea5fe03d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:38.418572 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c48f2-139d-4a78-9b7b-72beea5fe03d None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:38.419360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c48f2-139d-4a78-9b7b-72beea5fe03d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:38.419668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c48f2-139d-4a78-9b7b-72beea5fe03d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:38.421285 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c48f2-139d-4a78-9b7b-72beea5fe03d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:38.442054 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 296/584] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Sep 1 05:18:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:38.442811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c48f2-139d-4a78-9b7b-72beea5fe03d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:38.460694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5449c5-79bc-48f3-9401-4d9fa6c51508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:38.461840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5449c5-79bc-48f3-9401-4d9fa6c51508 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:38.462228 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5449c5-79bc-48f3-9401-4d9fa6c51508 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:38.462691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5449c5-79bc-48f3-9401-4d9fa6c51508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:38.478818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5449c5-79bc-48f3-9401-4d9fa6c51508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:38.481259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5449c5-79bc-48f3-9401-4d9fa6c51508 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-5f5449c5-79bc-48f3-9401-4d9fa6c51508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:38.504705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:38.507270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:38.510522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:38.510522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:38.510522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:38.510522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 289/585] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:38.510522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5449c5-79bc-48f3-9401-4d9fa6c51508 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:38.549425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:38.626729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c48f2-139d-4a78-9b7b-72beea5fe03d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:38.663161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5449c5-79bc-48f3-9401-4d9fa6c51508 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:38.679574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450370c-9328-4178-a9df-51dd7944c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:38.680400 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450370c-9328-4178-a9df-51dd7944c171 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:38.680755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450370c-9328-4178-a9df-51dd7944c171 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:38.681100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450370c-9328-4178-a9df-51dd7944c171 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:38.690457 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450370c-9328-4178-a9df-51dd7944c171 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:38.692148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450370c-9328-4178-a9df-51dd7944c171 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-c450370c-9328-4178-a9df-51dd7944c171 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:38.715078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:38.722698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:38.724346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:38.724346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:38.724346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:38.724346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:38.724346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:38.724346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:38.724346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:38.724346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:38.724346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 05:18:38.724346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:38.725170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df872d7-74f7-4674-9c12-2d47f61e9567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:38.725170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df872d7-74f7-4674-9c12-2d47f61e9567 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:38.725170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df872d7-74f7-4674-9c12-2d47f61e9567 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:38.725170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df872d7-74f7-4674-9c12-2d47f61e9567 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:38.726232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 297/586] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:38.726375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df872d7-74f7-4674-9c12-2d47f61e9567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:38.726375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df872d7-74f7-4674-9c12-2d47f61e9567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:38.726693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450370c-9328-4178-a9df-51dd7944c171 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:38.726841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df872d7-74f7-4674-9c12-2d47f61e9567 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:38.744866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 290/587] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:38.746025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df872d7-74f7-4674-9c12-2d47f61e9567 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:38.769438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:38.895170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450370c-9328-4178-a9df-51dd7944c171 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:38.897254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:38.914026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df872d7-74f7-4674-9c12-2d47f61e9567 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:38.957706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb107ea9-6338-4cea-8804-47d695418de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:38.958008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ed2c6-cfa3-4f11-ae39-1858b9e6ce53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:38.959400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb107ea9-6338-4cea-8804-47d695418de6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:38.959563 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ed2c6-cfa3-4f11-ae39-1858b9e6ce53 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:38.959773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb107ea9-6338-4cea-8804-47d695418de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:38.959773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb107ea9-6338-4cea-8804-47d695418de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:38.960060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ed2c6-cfa3-4f11-ae39-1858b9e6ce53 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:38.960614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ed2c6-cfa3-4f11-ae39-1858b9e6ce53 None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:38.961446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ed2c6-cfa3-4f11-ae39-1858b9e6ce53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:38.961843 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ed2c6-cfa3-4f11-ae39-1858b9e6ce53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:38.963912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ed2c6-cfa3-4f11-ae39-1858b9e6ce53 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:38.973615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb107ea9-6338-4cea-8804-47d695418de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:38.975524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb107ea9-6338-4cea-8804-47d695418de6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:38.989650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 298/588] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:38.989650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ed2c6-cfa3-4f11-ae39-1858b9e6ce53 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-fb107ea9-6338-4cea-8804-47d695418de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:39.000467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:39.010253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:39.012337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:39.012337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:39.012337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:39.012337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 291/589] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:39.012337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb107ea9-6338-4cea-8804-47d695418de6 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.147767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:39.167779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ed2c6-cfa3-4f11-ae39-1858b9e6ce53 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.193937 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb107ea9-6338-4cea-8804-47d695418de6 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.231502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ccd0a-9e6a-46ab-b006-af0f2a10c3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.232370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ccd0a-9e6a-46ab-b006-af0f2a10c3eb None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.232671 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ccd0a-9e6a-46ab-b006-af0f2a10c3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.233036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ccd0a-9e6a-46ab-b006-af0f2a10c3eb None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.234297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ccd0a-9e6a-46ab-b006-af0f2a10c3eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:39.235210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ccd0a-9e6a-46ab-b006-af0f2a10c3eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.237962 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ccd0a-9e6a-46ab-b006-af0f2a10c3eb None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.255392 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 299/590] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:39.258258 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ccd0a-9e6a-46ab-b006-af0f2a10c3eb None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.267047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362505c1-1c7f-4c27-9016-a8b1ac00b32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.267763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362505c1-1c7f-4c27-9016-a8b1ac00b32e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.268095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362505c1-1c7f-4c27-9016-a8b1ac00b32e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.268454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362505c1-1c7f-4c27-9016-a8b1ac00b32e None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.269277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362505c1-1c7f-4c27-9016-a8b1ac00b32e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:39.269781 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362505c1-1c7f-4c27-9016-a8b1ac00b32e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.272940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362505c1-1c7f-4c27-9016-a8b1ac00b32e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.289180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:39.300400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 292/591] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Sep 1 05:18:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:39.301844 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362505c1-1c7f-4c27-9016-a8b1ac00b32e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.408560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ccd0a-9e6a-46ab-b006-af0f2a10c3eb None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.460040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362505c1-1c7f-4c27-9016-a8b1ac00b32e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.462476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be2d0f-74eb-407f-86fa-ced2c093ba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.463228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be2d0f-74eb-407f-86fa-ced2c093ba91 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.463667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be2d0f-74eb-407f-86fa-ced2c093ba91 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.464116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be2d0f-74eb-407f-86fa-ced2c093ba91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.472622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be2d0f-74eb-407f-86fa-ced2c093ba91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.474680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be2d0f-74eb-407f-86fa-ced2c093ba91 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-36be2d0f-74eb-407f-86fa-ced2c093ba91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:39.491039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:39.492985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:39.494318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:39.494318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:39.494318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:39.494318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:39.494318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:39.494318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:39.494318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:39.494318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:39.494318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 300/592] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:39.494840 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be2d0f-74eb-407f-86fa-ced2c093ba91 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.513446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:39.518820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f085eb-2ccb-4704-8ced-e3cb6e4cbc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.519888 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f085eb-2ccb-4704-8ced-e3cb6e4cbc92 None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.520332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f085eb-2ccb-4704-8ced-e3cb6e4cbc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.520764 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f085eb-2ccb-4704-8ced-e3cb6e4cbc92 None admin] PATH_INFO: `/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/c596e424ab8e4637bae1721488c9fcc9/roles/64f98692a39a4f16bab66cd26ad8f65e` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.547239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f085eb-2ccb-4704-8ced-e3cb6e4cbc92 None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c3fe9229c45f1bfd295115ef94cd7, user_id=c596e424ab8e4637bae1721488c9fcc9, role_id=64f98692a39a4f16bab66cd26ad8f65e)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.549108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f085eb-2ccb-4704-8ced-e3cb6e4cbc92 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.633075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be2d0f-74eb-407f-86fa-ced2c093ba91 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.658950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 293/593] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:18:39 2022] PUT /identity/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/c596e424ab8e4637bae1721488c9fcc9/roles/64f98692a39a4f16bab66cd26ad8f65e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:39.658950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f085eb-2ccb-4704-8ced-e3cb6e4cbc92 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.681742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663152fc-9503-4737-a7e2-3a2ca9a22e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.682750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663152fc-9503-4737-a7e2-3a2ca9a22e4f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.683212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663152fc-9503-4737-a7e2-3a2ca9a22e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.683763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663152fc-9503-4737-a7e2-3a2ca9a22e4f None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.684888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663152fc-9503-4737-a7e2-3a2ca9a22e4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:39.685414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663152fc-9503-4737-a7e2-3a2ca9a22e4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.687690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663152fc-9503-4737-a7e2-3a2ca9a22e4f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.718555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 301/594] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:39.718555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663152fc-9503-4737-a7e2-3a2ca9a22e4f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.778026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:39.855441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:39.887080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f085eb-2ccb-4704-8ced-e3cb6e4cbc92 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.922338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663152fc-9503-4737-a7e2-3a2ca9a22e4f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.938120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc832449-e8a4-4939-bdc2-b0394f689e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.939223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc832449-e8a4-4939-bdc2-b0394f689e24 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.939744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc832449-e8a4-4939-bdc2-b0394f689e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.940199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc832449-e8a4-4939-bdc2-b0394f689e24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.954234 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc832449-e8a4-4939-bdc2-b0394f689e24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.957283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc832449-e8a4-4939-bdc2-b0394f689e24 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.967891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f97419-1b45-4048-8edc-1eb4457d2c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.969185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f97419-1b45-4048-8edc-1eb4457d2c29 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.969663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f97419-1b45-4048-8edc-1eb4457d2c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.970158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f97419-1b45-4048-8edc-1eb4457d2c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-dc832449-e8a4-4939-bdc2-b0394f689e24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:39.982746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:39.983779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:39.984688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:39.984688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:39.984688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:39.984688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:39.984688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:39.984688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:39.984688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:39.984688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:39.985121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f97419-1b45-4048-8edc-1eb4457d2c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.985750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 294/595] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:39.985860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f97419-1b45-4048-8edc-1eb4457d2c29 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.987218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc832449-e8a4-4939-bdc2-b0394f689e24 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-d5f97419-1b45-4048-8edc-1eb4457d2c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:40.011494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:40.013289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:40.015122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:40.015122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:40.015122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:40.015122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 302/596] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:40.015122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f97419-1b45-4048-8edc-1eb4457d2c29 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.180459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc832449-e8a4-4939-bdc2-b0394f689e24 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.196343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:40.203701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f97419-1b45-4048-8edc-1eb4457d2c29 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.239198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ae5ba-5a91-48a4-bc4d-7410df73da3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.241011 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ae5ba-5a91-48a4-bc4d-7410df73da3b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.241859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ae5ba-5a91-48a4-bc4d-7410df73da3b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.242590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ae5ba-5a91-48a4-bc4d-7410df73da3b None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.243912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ae5ba-5a91-48a4-bc4d-7410df73da3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:40.244618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ae5ba-5a91-48a4-bc4d-7410df73da3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.245786 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:40.247798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ae5ba-5a91-48a4-bc4d-7410df73da3b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.271735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 295/597] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:40.271735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ae5ba-5a91-48a4-bc4d-7410df73da3b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.277340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64159eb-0e2d-430b-aa08-57064fe98109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.278957 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64159eb-0e2d-430b-aa08-57064fe98109 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.279173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64159eb-0e2d-430b-aa08-57064fe98109 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.279533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64159eb-0e2d-430b-aa08-57064fe98109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.293346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64159eb-0e2d-430b-aa08-57064fe98109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.295479 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64159eb-0e2d-430b-aa08-57064fe98109 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-f64159eb-0e2d-430b-aa08-57064fe98109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:40.310223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:40.311862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:40.313712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:40.313712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:40.313712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:40.313712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:40.313712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:40.313712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:40.313712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:40.313712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:40.313712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 303/598] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:40.313712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64159eb-0e2d-430b-aa08-57064fe98109 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.481786 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ae5ba-5a91-48a4-bc4d-7410df73da3b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.489741 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64159eb-0e2d-430b-aa08-57064fe98109 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.539351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f0056-c75e-4063-b912-fa14ed530653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.540214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f0056-c75e-4063-b912-fa14ed530653 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.540657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f0056-c75e-4063-b912-fa14ed530653 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.541066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f0056-c75e-4063-b912-fa14ed530653 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.542150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f0056-c75e-4063-b912-fa14ed530653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:40.542613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f0056-c75e-4063-b912-fa14ed530653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.544886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f0056-c75e-4063-b912-fa14ed530653 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.551762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8d586-75ed-4bc2-8146-ef95de3c543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.552834 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8d586-75ed-4bc2-8146-ef95de3c543a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.553305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8d586-75ed-4bc2-8146-ef95de3c543a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.554044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8d586-75ed-4bc2-8146-ef95de3c543a None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.555290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8d586-75ed-4bc2-8146-ef95de3c543a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:40.555799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8d586-75ed-4bc2-8146-ef95de3c543a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.558513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8d586-75ed-4bc2-8146-ef95de3c543a None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.567684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 304/599] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:40.567684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f0056-c75e-4063-b912-fa14ed530653 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.589517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 296/600] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:40.591141 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8d586-75ed-4bc2-8146-ef95de3c543a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.632701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:40.650947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:40.724955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f0056-c75e-4063-b912-fa14ed530653 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.783426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8d586-75ed-4bc2-8146-ef95de3c543a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.788115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f451a96-8fc1-433c-94a1-e943794a4fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.788992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f451a96-8fc1-433c-94a1-e943794a4fdf None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.789409 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f451a96-8fc1-433c-94a1-e943794a4fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.789802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f451a96-8fc1-433c-94a1-e943794a4fdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.791005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f451a96-8fc1-433c-94a1-e943794a4fdf None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=8a0d07b79212443480c87f4a4ff3ca00) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:40.791447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f451a96-8fc1-433c-94a1-e943794a4fdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.793726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f451a96-8fc1-433c-94a1-e943794a4fdf None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.804116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 305/601] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:18:40 2022] GET /identity/v3/role_assignments?user.id=8a0d07b79212443480c87f4a4ff3ca00&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:40.805588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f451a96-8fc1-433c-94a1-e943794a4fdf None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.861509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7bec2-ed79-4010-879c-93885382d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.862811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7bec2-ed79-4010-879c-93885382d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.863465 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7bec2-ed79-4010-879c-93885382d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.863982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7bec2-ed79-4010-879c-93885382d4e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.865347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7bec2-ed79-4010-879c-93885382d4e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:40.865902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7bec2-ed79-4010-879c-93885382d4e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.869534 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7bec2-ed79-4010-879c-93885382d4e5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.906083 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 297/602] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:40.907269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7bec2-ed79-4010-879c-93885382d4e5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.996034 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f451a96-8fc1-433c-94a1-e943794a4fdf None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.999620 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:41.065727 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b97de-699f-4516-a8d2-5e0998cbe68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:41.066711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b97de-699f-4516-a8d2-5e0998cbe68f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:41.067191 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b97de-699f-4516-a8d2-5e0998cbe68f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:41.067662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b97de-699f-4516-a8d2-5e0998cbe68f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:41.069509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:41.083365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b97de-699f-4516-a8d2-5e0998cbe68f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:41.085670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7bec2-ed79-4010-879c-93885382d4e5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:41.087697 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b97de-699f-4516-a8d2-5e0998cbe68f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-e80b97de-699f-4516-a8d2-5e0998cbe68f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:41.110956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:41.113125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:41.115525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:41.115525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:41.115525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:41.115525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:41.115525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:41.115525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:41.115525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:41.115525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:41.125608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 306/603] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:41.127757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b97de-699f-4516-a8d2-5e0998cbe68f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:41.144622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a14c8-0464-40e0-a03b-0f16b43a8861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:41.146877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a14c8-0464-40e0-a03b-0f16b43a8861 None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:41.147622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a14c8-0464-40e0-a03b-0f16b43a8861 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:41.148414 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a14c8-0464-40e0-a03b-0f16b43a8861 None admin] PATH_INFO: `/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/b7e84a5652df4d64aa1fd28f3d5383fe/roles/64f98692a39a4f16bab66cd26ad8f65e` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:41.186803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a14c8-0464-40e0-a03b-0f16b43a8861 None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c3fe9229c45f1bfd295115ef94cd7, user_id=b7e84a5652df4d64aa1fd28f3d5383fe, role_id=64f98692a39a4f16bab66cd26ad8f65e)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:41.191196 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a14c8-0464-40e0-a03b-0f16b43a8861 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:41.289837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 298/604] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:18:40 2022] PUT /identity/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/b7e84a5652df4d64aa1fd28f3d5383fe/roles/64f98692a39a4f16bab66cd26ad8f65e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:41.291742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a14c8-0464-40e0-a03b-0f16b43a8861 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:41.373212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b97de-699f-4516-a8d2-5e0998cbe68f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:41.470698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f563c-9bf5-4773-82da-d4efbb765e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:41.472096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f563c-9bf5-4773-82da-d4efbb765e2f None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:41.472598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f563c-9bf5-4773-82da-d4efbb765e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:41.473090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f563c-9bf5-4773-82da-d4efbb765e2f None admin] PATH_INFO: `/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/e03daa3b2e334436ad4d0b2915a61aa1/roles/64f98692a39a4f16bab66cd26ad8f65e` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:41.509178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f563c-9bf5-4773-82da-d4efbb765e2f None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c3fe9229c45f1bfd295115ef94cd7, user_id=e03daa3b2e334436ad4d0b2915a61aa1, role_id=64f98692a39a4f16bab66cd26ad8f65e)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:41.512031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f563c-9bf5-4773-82da-d4efbb765e2f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:41.609524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a14c8-0464-40e0-a03b-0f16b43a8861 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:41.649389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 307/605] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:18:41 2022] PUT /identity/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/e03daa3b2e334436ad4d0b2915a61aa1/roles/64f98692a39a4f16bab66cd26ad8f65e => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:41.700865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7a8e3-3598-4b54-9df6-040259d1346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:41.701969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7a8e3-3598-4b54-9df6-040259d1346b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:41.702436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7a8e3-3598-4b54-9df6-040259d1346b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:41.702914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7a8e3-3598-4b54-9df6-040259d1346b None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:41.704277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7a8e3-3598-4b54-9df6-040259d1346b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:41.704824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7a8e3-3598-4b54-9df6-040259d1346b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:41.707564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7a8e3-3598-4b54-9df6-040259d1346b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:41.723413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:41.734490 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 299/606] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:41.744998 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f563c-9bf5-4773-82da-d4efbb765e2f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:41.785474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:41.987873 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f563c-9bf5-4773-82da-d4efbb765e2f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:42.048688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0efc5-6e4e-4582-88da-01ecc9887447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:42.049934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0efc5-6e4e-4582-88da-01ecc9887447 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.050309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0efc5-6e4e-4582-88da-01ecc9887447 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.050791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0efc5-6e4e-4582-88da-01ecc9887447 None admin] PATH_INFO: `/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/2e7d31c0ec474c428ed932882b989d2b/roles/64f98692a39a4f16bab66cd26ad8f65e` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.082099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0efc5-6e4e-4582-88da-01ecc9887447 None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c3fe9229c45f1bfd295115ef94cd7, user_id=2e7d31c0ec474c428ed932882b989d2b, role_id=64f98692a39a4f16bab66cd26ad8f65e)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:42.085154 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0efc5-6e4e-4582-88da-01ecc9887447 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:42.216776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 308/607] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:18:41 2022] PUT /identity/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/2e7d31c0ec474c428ed932882b989d2b/roles/64f98692a39a4f16bab66cd26ad8f65e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:42.577302 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983c103-713a-4502-b40d-664ef03483c0 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.578054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983c103-713a-4502-b40d-664ef03483c0 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.578369 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3983c103-713a-4502-b40d-664ef03483c0 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.581478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 300/608] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:42.588606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b91792-c245-4d2e-be49-fdd3798a0fd3 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.589115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b91792-c245-4d2e-be49-fdd3798a0fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.589647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b91792-c245-4d2e-be49-fdd3798a0fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.629061 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-63b91792-c245-4d2e-be49-fdd3798a0fd3 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:42.631191 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-63b91792-c245-4d2e-be49-fdd3798a0fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:42.770089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:42.788128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 309/609] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:43.282226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983c103-713a-4502-b40d-664ef03483c0 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:43.509457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3983c103-713a-4502-b40d-664ef03483c0 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:43.595219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f38682-935c-4901-ba70-66b993387c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:43.598045 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38682-935c-4901-ba70-66b993387c39 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.598886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38682-935c-4901-ba70-66b993387c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.600172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f38682-935c-4901-ba70-66b993387c39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.623312 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f38682-935c-4901-ba70-66b993387c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-85f38682-935c-4901-ba70-66b993387c39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:43.636096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:43.646345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:43.647930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 301/610] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:43.650206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b91792-c245-4d2e-be49-fdd3798a0fd3 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:43.793977 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f963-e208-4581-a84b-72ad867f98aa None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.794870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f963-e208-4581-a84b-72ad867f98aa None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.795591 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61f963-e208-4581-a84b-72ad867f98aa None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.798934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 302/611] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:43.807814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84bfe0-1ff2-41f1-8a56-6fe2826ef06f None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.808076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84bfe0-1ff2-41f1-8a56-6fe2826ef06f None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.808390 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84bfe0-1ff2-41f1-8a56-6fe2826ef06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.853293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ac84bfe0-1ff2-41f1-8a56-6fe2826ef06f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:43.855620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ac84bfe0-1ff2-41f1-8a56-6fe2826ef06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:43.860794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b91792-c245-4d2e-be49-fdd3798a0fd3 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:43.961334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a368c8d-fcb0-4b99-872d-2c2e4d887b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:43.962224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a368c8d-fcb0-4b99-872d-2c2e4d887b35 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.962611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a368c8d-fcb0-4b99-872d-2c2e4d887b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.962988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a368c8d-fcb0-4b99-872d-2c2e4d887b35 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.964037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a368c8d-fcb0-4b99-872d-2c2e4d887b35 None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:43.964523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a368c8d-fcb0-4b99-872d-2c2e4d887b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:43.967124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a368c8d-fcb0-4b99-872d-2c2e4d887b35 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:44.005506 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 310/612] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:44.013480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a368c8d-fcb0-4b99-872d-2c2e4d887b35 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:44.026207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:44.066372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 303/613] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:44.153608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:44.244107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a368c8d-fcb0-4b99-872d-2c2e4d887b35 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:44.312960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27516c-0ff6-4f49-924b-56f7e9b9cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:44.314064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27516c-0ff6-4f49-924b-56f7e9b9cf8e None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:44.314553 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27516c-0ff6-4f49-924b-56f7e9b9cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:44.315048 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27516c-0ff6-4f49-924b-56f7e9b9cf8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:44.337344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27516c-0ff6-4f49-924b-56f7e9b9cf8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:44.340118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27516c-0ff6-4f49-924b-56f7e9b9cf8e None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-ab27516c-0ff6-4f49-924b-56f7e9b9cf8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:44.373201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:44.375145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:44.376543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:44.376543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:44.376543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:44.376543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 311/614] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:18:44.387957 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84bfe0-1ff2-41f1-8a56-6fe2826ef06f None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:44.582696 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84bfe0-1ff2-41f1-8a56-6fe2826ef06f None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:44.631769 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27516c-0ff6-4f49-924b-56f7e9b9cf8e None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:44.674895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785d9c2-9d9d-4a5b-9419-09084acc393e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:44.675725 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785d9c2-9d9d-4a5b-9419-09084acc393e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:44.676050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785d9c2-9d9d-4a5b-9419-09084acc393e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:44.676215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785d9c2-9d9d-4a5b-9419-09084acc393e None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:44.676846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785d9c2-9d9d-4a5b-9419-09084acc393e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:44.681423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785d9c2-9d9d-4a5b-9419-09084acc393e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:44.681423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8785d9c2-9d9d-4a5b-9419-09084acc393e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:44.694185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 304/615] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:44.695533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d5a1-4b01-42bc-954a-5a4ccbffa006 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:44.695817 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d5a1-4b01-42bc-954a-5a4ccbffa006 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:44.696091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d5a1-4b01-42bc-954a-5a4ccbffa006 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:44.702066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 305/616] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:44.704377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225c79-7547-469f-a6e5-7165c95e3686 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:44.704731 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225c79-7547-469f-a6e5-7165c95e3686 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:44.705032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225c79-7547-469f-a6e5-7165c95e3686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:44.727399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ed225c79-7547-469f-a6e5-7165c95e3686 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:44.728837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ed225c79-7547-469f-a6e5-7165c95e3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:44.787382 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:44.833132 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 306/617] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:18:44.835732 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed225c79-7547-469f-a6e5-7165c95e3686 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:44.872866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27516c-0ff6-4f49-924b-56f7e9b9cf8e None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:44.901085 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:45.001748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9a60d-4f29-4bfe-807c-b6c7e41e7c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:45.005723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9a60d-4f29-4bfe-807c-b6c7e41e7c57 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:45.007088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9a60d-4f29-4bfe-807c-b6c7e41e7c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:45.013571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9a60d-4f29-4bfe-807c-b6c7e41e7c57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:45.047630 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9a60d-4f29-4bfe-807c-b6c7e41e7c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-faf9a60d-4f29-4bfe-807c-b6c7e41e7c57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:45.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:45.059777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:45.062704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 312/618] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 428 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:18:45.070974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9a60d-4f29-4bfe-807c-b6c7e41e7c57 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:45.151532 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed225c79-7547-469f-a6e5-7165c95e3686 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:45.212084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9a60d-4f29-4bfe-807c-b6c7e41e7c57 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:45.255867 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c4bc5-1f96-4c10-87b2-b61e6c5c4472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:45.256545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c4bc5-1f96-4c10-87b2-b61e6c5c4472 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:45.256833 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c4bc5-1f96-4c10-87b2-b61e6c5c4472 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:45.257104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c4bc5-1f96-4c10-87b2-b61e6c5c4472 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:45.261926 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42749eb1-c143-48bf-9098-7f758b078fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:45.262588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42749eb1-c143-48bf-9098-7f758b078fde None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:45.262896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42749eb1-c143-48bf-9098-7f758b078fde None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:45.263189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42749eb1-c143-48bf-9098-7f758b078fde None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:45.263912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42749eb1-c143-48bf-9098-7f758b078fde None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:45.264241 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42749eb1-c143-48bf-9098-7f758b078fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:45.265733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42749eb1-c143-48bf-9098-7f758b078fde None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:45.282136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 313/619] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:45.290479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c4bc5-1f96-4c10-87b2-b61e6c5c4472 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:45.293171 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c4bc5-1f96-4c10-87b2-b61e6c5c4472 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:45.300236 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42749eb1-c143-48bf-9098-7f758b078fde None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-7d4c4bc5-1f96-4c10-87b2-b61e6c5c4472 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:45.327389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:45.331483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 307/620] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 494 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaa964-3459-43e9-adc6-ef5a0fb03bf8 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:45.335785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaa964-3459-43e9-adc6-ef5a0fb03bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:45.339568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafaa964-3459-43e9-adc6-ef5a0fb03bf8 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:45.339568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 308/621] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:45.339568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaa964-3459-43e9-adc6-ef5a0fb03bf8 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:45.340906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:45.402873 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:45.451432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42749eb1-c143-48bf-9098-7f758b078fde None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:45.480049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafaa964-3459-43e9-adc6-ef5a0fb03bf8 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:45.492201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b0e6e-15db-4087-ad62-ebe2a31e6494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:45.492847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0e6e-15db-4087-ad62-ebe2a31e6494 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:45.493144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0e6e-15db-4087-ad62-ebe2a31e6494 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:45.493441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b0e6e-15db-4087-ad62-ebe2a31e6494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:45.504847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b0e6e-15db-4087-ad62-ebe2a31e6494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:45.506731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b0e6e-15db-4087-ad62-ebe2a31e6494 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:45.522775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad7b0-0594-40b7-8401-b06f49495641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:45.523850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad7b0-0594-40b7-8401-b06f49495641 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:45.524312 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad7b0-0594-40b7-8401-b06f49495641 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:45.524768 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad7b0-0594-40b7-8401-b06f49495641 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:45.526092 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ad7b0-0594-40b7-8401-b06f49495641 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:45.526587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ad7b0-0594-40b7-8401-b06f49495641 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-fa4b0e6e-15db-4087-ad62-ebe2a31e6494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:45.528383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:45.529490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:45.530401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:45.530401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:45.530401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:45.530577 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ad7b0-0594-40b7-8401-b06f49495641 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:45.530659 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 314/622] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:45.532725 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df410a4-a42f-4881-83d4-260cb17dcdaf None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:45.533174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df410a4-a42f-4881-83d4-260cb17dcdaf None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:45.533697 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df410a4-a42f-4881-83d4-260cb17dcdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:45.556828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 309/623] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Sep 1 05:18:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:45.557742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad7b0-0594-40b7-8401-b06f49495641 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:45.563178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-0df410a4-a42f-4881-83d4-260cb17dcdaf None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:45.564648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0df410a4-a42f-4881-83d4-260cb17dcdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:45.644819 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 315/624] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:45.646698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88103c5-c60f-4215-aed2-e3bfc6048a3e None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:45.647047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88103c5-c60f-4215-aed2-e3bfc6048a3e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:45.647442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88103c5-c60f-4215-aed2-e3bfc6048a3e None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:45.648801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 316/625] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:45.649611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88103c5-c60f-4215-aed2-e3bfc6048a3e None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:45.678325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:45.684115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:45.685109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad7b0-0594-40b7-8401-b06f49495641 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:45.725298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f702661-bbf9-4706-9df1-d851c57127bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:45.725994 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f702661-bbf9-4706-9df1-d851c57127bc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:45.726271 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f702661-bbf9-4706-9df1-d851c57127bc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:45.726541 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f702661-bbf9-4706-9df1-d851c57127bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:45.738832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f702661-bbf9-4706-9df1-d851c57127bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-0f702661-bbf9-4706-9df1-d851c57127bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:45.744900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:45.751082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:45.751926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 310/626] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:45.752635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f702661-bbf9-4706-9df1-d851c57127bc None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:45.821194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88103c5-c60f-4215-aed2-e3bfc6048a3e None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:45.862332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1ff86-1dc5-49b0-b761-d6f9a280622b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:45.862955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1ff86-1dc5-49b0-b761-d6f9a280622b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:45.863234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1ff86-1dc5-49b0-b761-d6f9a280622b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:45.863506 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1ff86-1dc5-49b0-b761-d6f9a280622b None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:45.864214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1ff86-1dc5-49b0-b761-d6f9a280622b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:45.864490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1ff86-1dc5-49b0-b761-d6f9a280622b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:45.866134 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1ff86-1dc5-49b0-b761-d6f9a280622b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:45.879555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 317/627] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:45.881126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca54ddf-0160-4200-bd2f-647b4feb1730 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:45.881428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca54ddf-0160-4200-bd2f-647b4feb1730 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:45.881695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca54ddf-0160-4200-bd2f-647b4feb1730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:45.905643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5ca54ddf-0160-4200-bd2f-647b4feb1730 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:45.907794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5ca54ddf-0160-4200-bd2f-647b4feb1730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:45.935210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f702661-bbf9-4706-9df1-d851c57127bc None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:46.005756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 318/628] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:46.005756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca54ddf-0160-4200-bd2f-647b4feb1730 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:46.005756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:46.008905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bcd0f-e9dd-4a43-a095-e649faea9e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:46.010050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bcd0f-e9dd-4a43-a095-e649faea9e30 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:46.010536 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bcd0f-e9dd-4a43-a095-e649faea9e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:46.015098 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576bcd0f-e9dd-4a43-a095-e649faea9e30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:46.063901 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:46.141404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bcd0f-e9dd-4a43-a095-e649faea9e30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:46.143102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576bcd0f-e9dd-4a43-a095-e649faea9e30 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:46.171794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca54ddf-0160-4200-bd2f-647b4feb1730 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:46.215005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8926ea-1eb9-40d7-9039-0a2904c68a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:46.215555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8926ea-1eb9-40d7-9039-0a2904c68a91 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:46.215835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8926ea-1eb9-40d7-9039-0a2904c68a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:46.216110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8926ea-1eb9-40d7-9039-0a2904c68a91 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:46.216796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8926ea-1eb9-40d7-9039-0a2904c68a91 None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:46.217099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8926ea-1eb9-40d7-9039-0a2904c68a91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:46.218622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8926ea-1eb9-40d7-9039-0a2904c68a91 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:46.228445 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 319/629] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:46.229330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8926ea-1eb9-40d7-9039-0a2904c68a91 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:46.299989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 311/630] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:46.301551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bcd0f-e9dd-4a43-a095-e649faea9e30 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:46.320514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:46.379286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:46.382937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8926ea-1eb9-40d7-9039-0a2904c68a91 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:46.421713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26efc1-8af7-48f8-95ba-6d3e86224f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:46.422348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26efc1-8af7-48f8-95ba-6d3e86224f3a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:46.422633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26efc1-8af7-48f8-95ba-6d3e86224f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:46.422914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26efc1-8af7-48f8-95ba-6d3e86224f3a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:46.432879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26efc1-8af7-48f8-95ba-6d3e86224f3a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:46.434467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26efc1-8af7-48f8-95ba-6d3e86224f3a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:46.444087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576bcd0f-e9dd-4a43-a095-e649faea9e30 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-fa26efc1-8af7-48f8-95ba-6d3e86224f3a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:46.447568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:46.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:46.451621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:46.451621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:46.451621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:46.451621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:46.451621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:46.451621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:46.451621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:46.451621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:46.451621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:18:46.451621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:46.451621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 320/631] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:18:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:46.451621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26efc1-8af7-48f8-95ba-6d3e86224f3a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:46.486547 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb363be-f9a8-434e-81ca-25f34ee1c83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:46.487409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb363be-f9a8-434e-81ca-25f34ee1c83a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:46.487815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb363be-f9a8-434e-81ca-25f34ee1c83a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:46.488342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb363be-f9a8-434e-81ca-25f34ee1c83a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:46.502013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb363be-f9a8-434e-81ca-25f34ee1c83a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-cdb363be-f9a8-434e-81ca-25f34ee1c83a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:46.507749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:46.509929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 312/632] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:46.511871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb363be-f9a8-434e-81ca-25f34ee1c83a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:46.577133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26efc1-8af7-48f8-95ba-6d3e86224f3a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:46.605471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:46.618614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c98cc-e652-443d-b7d1-424e1f23966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:46.619259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c98cc-e652-443d-b7d1-424e1f23966c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:46.619537 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c98cc-e652-443d-b7d1-424e1f23966c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:46.619803 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c98cc-e652-443d-b7d1-424e1f23966c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:46.633145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c98cc-e652-443d-b7d1-424e1f23966c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:46.633820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb363be-f9a8-434e-81ca-25f34ee1c83a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:46.634666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c98cc-e652-443d-b7d1-424e1f23966c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-c22c98cc-e652-443d-b7d1-424e1f23966c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:46.651564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:46.652749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:46.654089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:46.654089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:46.654089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:46.654089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 321/633] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:46.654089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c98cc-e652-443d-b7d1-424e1f23966c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:46.659071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:46.691835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb39b4-9872-4015-b8fe-fe15fdc6d9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:46.693999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb39b4-9872-4015-b8fe-fe15fdc6d9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:46.694510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb39b4-9872-4015-b8fe-fe15fdc6d9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:46.694988 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb39b4-9872-4015-b8fe-fe15fdc6d9d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:46.715038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb39b4-9872-4015-b8fe-fe15fdc6d9d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:46.717956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb39b4-9872-4015-b8fe-fe15fdc6d9d4 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-0edb39b4-9872-4015-b8fe-fe15fdc6d9d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:46.740142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:46.741645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:46.742690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:46.742690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:46.742690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:46.747285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 313/634] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:46.748164 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb39b4-9872-4015-b8fe-fe15fdc6d9d4 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:46.775249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c98cc-e652-443d-b7d1-424e1f23966c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:46.827180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869628f-b159-4e95-98c7-626bc71fdbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:46.828058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869628f-b159-4e95-98c7-626bc71fdbe0 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:46.828406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869628f-b159-4e95-98c7-626bc71fdbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:46.828831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869628f-b159-4e95-98c7-626bc71fdbe0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:46.843005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869628f-b159-4e95-98c7-626bc71fdbe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-6869628f-b159-4e95-98c7-626bc71fdbe0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:46.848568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:46.851217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:46.853172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:46.853172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:46.853172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:46.853172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:46.853172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:46.853172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:46.853172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:46.853172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:46.853172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:46.853172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:46.853172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:46.853172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:46.855964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 322/635] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:46.856787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869628f-b159-4e95-98c7-626bc71fdbe0 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:46.874529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb39b4-9872-4015-b8fe-fe15fdc6d9d4 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:46.904055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:46.924690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f382c12-c3a7-4f9c-9daa-2f3818e6bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:46.925477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f382c12-c3a7-4f9c-9daa-2f3818e6bf01 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:46.925847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f382c12-c3a7-4f9c-9daa-2f3818e6bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:46.926219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f382c12-c3a7-4f9c-9daa-2f3818e6bf01 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:46.927765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f382c12-c3a7-4f9c-9daa-2f3818e6bf01 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:46.928862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f382c12-c3a7-4f9c-9daa-2f3818e6bf01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:46.930491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f382c12-c3a7-4f9c-9daa-2f3818e6bf01 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:46.952021 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 314/636] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Sep 1 05:18:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:46.952940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f382c12-c3a7-4f9c-9daa-2f3818e6bf01 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:46.984387 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869628f-b159-4e95-98c7-626bc71fdbe0 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:46.987750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:47.026327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53ec0c-ff9b-43f3-a8f8-f202399db157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:47.027224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53ec0c-ff9b-43f3-a8f8-f202399db157 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:47.027695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53ec0c-ff9b-43f3-a8f8-f202399db157 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:47.028141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53ec0c-ff9b-43f3-a8f8-f202399db157 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:47.029313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53ec0c-ff9b-43f3-a8f8-f202399db157 None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:47.029832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53ec0c-ff9b-43f3-a8f8-f202399db157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:47.032279 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab53ec0c-ff9b-43f3-a8f8-f202399db157 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:47.048023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 323/637] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:47.049351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53ec0c-ff9b-43f3-a8f8-f202399db157 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:47.095401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f382c12-c3a7-4f9c-9daa-2f3818e6bf01 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:47.145067 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165c225-64d9-4912-927d-84191fa6ea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:47.145721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165c225-64d9-4912-927d-84191fa6ea01 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:47.146596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165c225-64d9-4912-927d-84191fa6ea01 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:47.146874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165c225-64d9-4912-927d-84191fa6ea01 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:47.147566 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165c225-64d9-4912-927d-84191fa6ea01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:47.147870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165c225-64d9-4912-927d-84191fa6ea01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:47.149630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165c225-64d9-4912-927d-84191fa6ea01 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:47.163093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 315/638] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:47.164031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165c225-64d9-4912-927d-84191fa6ea01 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:47.186719 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:47.191049 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53ec0c-ff9b-43f3-a8f8-f202399db157 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:47.234028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbede3-184a-47b2-baab-60cc0155dc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:47.234653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbede3-184a-47b2-baab-60cc0155dc21 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:47.234934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbede3-184a-47b2-baab-60cc0155dc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:47.235267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbede3-184a-47b2-baab-60cc0155dc21 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:47.235940 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbede3-184a-47b2-baab-60cc0155dc21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:47.236243 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbede3-184a-47b2-baab-60cc0155dc21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:47.237709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbede3-184a-47b2-baab-60cc0155dc21 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:47.252126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 324/639] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:47.253004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbede3-184a-47b2-baab-60cc0155dc21 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:47.267768 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:47.287328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165c225-64d9-4912-927d-84191fa6ea01 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:47.332123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac33884-bac0-48b1-a21c-a0d78bea2f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:47.332748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac33884-bac0-48b1-a21c-a0d78bea2f7e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:47.333030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac33884-bac0-48b1-a21c-a0d78bea2f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:47.333365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac33884-bac0-48b1-a21c-a0d78bea2f7e None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:47.334084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac33884-bac0-48b1-a21c-a0d78bea2f7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:47.334388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac33884-bac0-48b1-a21c-a0d78bea2f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:47.336130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac33884-bac0-48b1-a21c-a0d78bea2f7e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:47.345905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 316/640] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:47.346700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac33884-bac0-48b1-a21c-a0d78bea2f7e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:47.383862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbede3-184a-47b2-baab-60cc0155dc21 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:47.423071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d4649-020e-44a7-bf25-3aaa21540efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:47.423712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d4649-020e-44a7-bf25-3aaa21540efb None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:47.423987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d4649-020e-44a7-bf25-3aaa21540efb None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:47.424256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d4649-020e-44a7-bf25-3aaa21540efb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:47.436387 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d4649-020e-44a7-bf25-3aaa21540efb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:47.437941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d4649-020e-44a7-bf25-3aaa21540efb None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-656d4649-020e-44a7-bf25-3aaa21540efb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:47.455127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:47.457007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:47.458902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:47.458902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:47.458902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:47.458902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 325/641] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:47.458902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d4649-020e-44a7-bf25-3aaa21540efb None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:47.473399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:47.481706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac33884-bac0-48b1-a21c-a0d78bea2f7e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:47.523000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0001681-fdb2-41ab-b1a4-7bd55d40eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:47.523663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0001681-fdb2-41ab-b1a4-7bd55d40eafa None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:47.523942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0001681-fdb2-41ab-b1a4-7bd55d40eafa None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:47.524217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0001681-fdb2-41ab-b1a4-7bd55d40eafa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:47.538496 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0001681-fdb2-41ab-b1a4-7bd55d40eafa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:47.541436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0001681-fdb2-41ab-b1a4-7bd55d40eafa None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:47.558982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-a0001681-fdb2-41ab-b1a4-7bd55d40eafa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:47.573219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:47.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:47.578486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:47.578486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:47.578486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:47.578486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 317/642] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:47.578486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0001681-fdb2-41ab-b1a4-7bd55d40eafa None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:47.582010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d4649-020e-44a7-bf25-3aaa21540efb None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:47.622194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0630910-8429-4b5c-b5d8-7af9be4caf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:47.622850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0630910-8429-4b5c-b5d8-7af9be4caf0e None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:47.623133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0630910-8429-4b5c-b5d8-7af9be4caf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:47.623405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0630910-8429-4b5c-b5d8-7af9be4caf0e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:47.632920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0630910-8429-4b5c-b5d8-7af9be4caf0e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:47.634523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0630910-8429-4b5c-b5d8-7af9be4caf0e None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-c0630910-8429-4b5c-b5d8-7af9be4caf0e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:47.648172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:47.649700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:47.650773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:47.650773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:47.650773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:47.650773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:47.650773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:47.650773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:47.650773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:47.650773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:47.650773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:18:47.650773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:47.650773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 326/643] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Sep 1 05:18:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:47.650773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0630910-8429-4b5c-b5d8-7af9be4caf0e None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:47.752989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:47.755735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0001681-fdb2-41ab-b1a4-7bd55d40eafa None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:47.799082 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0630910-8429-4b5c-b5d8-7af9be4caf0e None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:47.806990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc1883-03cc-44cb-aee7-64bd4ccde131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:47.807801 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc1883-03cc-44cb-aee7-64bd4ccde131 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:47.808175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc1883-03cc-44cb-aee7-64bd4ccde131 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:47.808538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc1883-03cc-44cb-aee7-64bd4ccde131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:47.819125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc1883-03cc-44cb-aee7-64bd4ccde131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:47.821993 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc1883-03cc-44cb-aee7-64bd4ccde131 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-20fc1883-03cc-44cb-aee7-64bd4ccde131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:47.837960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:47.839777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:47.842161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:47.842161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:47.842161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:47.842161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:47.842161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:47.842161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:47.842161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:47.842161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:47.842161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 318/644] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:47.842161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc1883-03cc-44cb-aee7-64bd4ccde131 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:47.854728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8185e3-3b05-4324-b0bf-7d7f32348832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:47.855721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8185e3-3b05-4324-b0bf-7d7f32348832 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:47.856154 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8185e3-3b05-4324-b0bf-7d7f32348832 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:47.856588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8185e3-3b05-4324-b0bf-7d7f32348832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:47.875404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8185e3-3b05-4324-b0bf-7d7f32348832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:47.878176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8185e3-3b05-4324-b0bf-7d7f32348832 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-fc8185e3-3b05-4324-b0bf-7d7f32348832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:47.905131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:47.906749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:47.909142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:47.909142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:47.909142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:47.909142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 327/645] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:47.909645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8185e3-3b05-4324-b0bf-7d7f32348832 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:47.948729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:48.005565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc1883-03cc-44cb-aee7-64bd4ccde131 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:48.044882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8185e3-3b05-4324-b0bf-7d7f32348832 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:48.050823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b092cc-f8a5-4af6-b3e8-7ddc53e03dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:48.051427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b092cc-f8a5-4af6-b3e8-7ddc53e03dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:48.051766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b092cc-f8a5-4af6-b3e8-7ddc53e03dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:48.052221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b092cc-f8a5-4af6-b3e8-7ddc53e03dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:48.053052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b092cc-f8a5-4af6-b3e8-7ddc53e03dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:48.053433 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b092cc-f8a5-4af6-b3e8-7ddc53e03dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:48.054975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b092cc-f8a5-4af6-b3e8-7ddc53e03dc7 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:48.071875 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 319/646] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:48.072984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b092cc-f8a5-4af6-b3e8-7ddc53e03dc7 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:48.080668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:48.101136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d575a-2edd-43ce-8640-c56a6c130bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:48.102144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d575a-2edd-43ce-8640-c56a6c130bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:48.102583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d575a-2edd-43ce-8640-c56a6c130bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:48.103026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d575a-2edd-43ce-8640-c56a6c130bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:48.104099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d575a-2edd-43ce-8640-c56a6c130bf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:48.104597 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d575a-2edd-43ce-8640-c56a6c130bf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:48.106950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d575a-2edd-43ce-8640-c56a6c130bf3 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:48.127774 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 328/647] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:48.129292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d575a-2edd-43ce-8640-c56a6c130bf3 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:48.251266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b092cc-f8a5-4af6-b3e8-7ddc53e03dc7 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:48.266224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d575a-2edd-43ce-8640-c56a6c130bf3 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:48.290661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:48.309065 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dabb6e-ceb2-431a-ae79-d81430a7dc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:48.309806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dabb6e-ceb2-431a-ae79-d81430a7dc0e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:48.310104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dabb6e-ceb2-431a-ae79-d81430a7dc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:48.310433 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dabb6e-ceb2-431a-ae79-d81430a7dc0e None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:48.311229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dabb6e-ceb2-431a-ae79-d81430a7dc0e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:48.311578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dabb6e-ceb2-431a-ae79-d81430a7dc0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:48.313347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dabb6e-ceb2-431a-ae79-d81430a7dc0e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:48.313751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34748bc-3387-467c-8e8b-8fe9c08ed5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:48.314376 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34748bc-3387-467c-8e8b-8fe9c08ed5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:48.314652 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34748bc-3387-467c-8e8b-8fe9c08ed5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:48.314924 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34748bc-3387-467c-8e8b-8fe9c08ed5f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:48.315630 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34748bc-3387-467c-8e8b-8fe9c08ed5f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:48.315929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34748bc-3387-467c-8e8b-8fe9c08ed5f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:48.317436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34748bc-3387-467c-8e8b-8fe9c08ed5f1 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:48.335753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 320/648] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Sep 1 05:18:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:48.336653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dabb6e-ceb2-431a-ae79-d81430a7dc0e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:48.337279 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 329/649] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:48.339188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34748bc-3387-467c-8e8b-8fe9c08ed5f1 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:48.417155 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:48.465732 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dabb6e-ceb2-431a-ae79-d81430a7dc0e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:48.493031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34748bc-3387-467c-8e8b-8fe9c08ed5f1 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:48.514227 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f998a5f-87bb-4b1d-921e-64156170e653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:48.515142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f998a5f-87bb-4b1d-921e-64156170e653 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:48.515587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f998a5f-87bb-4b1d-921e-64156170e653 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:48.516029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f998a5f-87bb-4b1d-921e-64156170e653 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:48.517121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f998a5f-87bb-4b1d-921e-64156170e653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:48.517679 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f998a5f-87bb-4b1d-921e-64156170e653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:48.520191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f998a5f-87bb-4b1d-921e-64156170e653 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:48.546182 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 321/650] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:48.546182 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f998a5f-87bb-4b1d-921e-64156170e653 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:48.547137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6782d28-f0ba-4903-ae23-b9c86bad0c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:48.547940 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6782d28-f0ba-4903-ae23-b9c86bad0c82 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:48.548373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6782d28-f0ba-4903-ae23-b9c86bad0c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:48.548818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6782d28-f0ba-4903-ae23-b9c86bad0c82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:48.557985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6782d28-f0ba-4903-ae23-b9c86bad0c82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:48.559697 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6782d28-f0ba-4903-ae23-b9c86bad0c82 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-f6782d28-f0ba-4903-ae23-b9c86bad0c82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:48.574211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:48.576125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:48.577942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:48.577942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:48.577942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:48.577942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:48.577942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:48.577942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:48.577942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:48.577942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:48.577942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 330/651] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:48.577942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6782d28-f0ba-4903-ae23-b9c86bad0c82 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:48.606128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:48.681711 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f998a5f-87bb-4b1d-921e-64156170e653 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:48.715062 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6782d28-f0ba-4903-ae23-b9c86bad0c82 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:48.717873 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:48.731901 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40562c15-a16c-4c68-9a74-d0671b986373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:48.732933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40562c15-a16c-4c68-9a74-d0671b986373 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:48.733414 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40562c15-a16c-4c68-9a74-d0671b986373 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:48.733857 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40562c15-a16c-4c68-9a74-d0671b986373 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:48.748248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40562c15-a16c-4c68-9a74-d0671b986373 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:48.750520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40562c15-a16c-4c68-9a74-d0671b986373 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-40562c15-a16c-4c68-9a74-d0671b986373 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:48.771914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:48.774529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:48.776569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:48.776569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:48.776569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:48.776569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:48.776569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:48.776569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:48.776569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:48.776569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:48.776569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:18:48.776569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:48.778235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632600f-45a1-492f-af9b-e30cb5818615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:48.778235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632600f-45a1-492f-af9b-e30cb5818615 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:48.778235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632600f-45a1-492f-af9b-e30cb5818615 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:48.778235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632600f-45a1-492f-af9b-e30cb5818615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:48.778788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 322/652] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:48.779075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40562c15-a16c-4c68-9a74-d0671b986373 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:48.871436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632600f-45a1-492f-af9b-e30cb5818615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:48.872940 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632600f-45a1-492f-af9b-e30cb5818615 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:48.930982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:48.936246 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40562c15-a16c-4c68-9a74-d0671b986373 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:48.986261 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8fac0-7707-4773-9573-7510a1ca9b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:48.987476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8fac0-7707-4773-9573-7510a1ca9b94 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:48.987971 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8fac0-7707-4773-9573-7510a1ca9b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:48.988437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8fac0-7707-4773-9573-7510a1ca9b94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:48.989979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8fac0-7707-4773-9573-7510a1ca9b94 None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=c596e424ab8e4637bae1721488c9fcc9) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:48.990553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8fac0-7707-4773-9573-7510a1ca9b94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:48.993413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8fac0-7707-4773-9573-7510a1ca9b94 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:49.003290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 323/653] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:18:48 2022] GET /identity/v3/role_assignments?user.id=c596e424ab8e4637bae1721488c9fcc9&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:49.012338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 331/654] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:49.012338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632600f-45a1-492f-af9b-e30cb5818615 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:49.013290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8fac0-7707-4773-9573-7510a1ca9b94 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:49.013469 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:49.177954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632600f-45a1-492f-af9b-e30cb5818615 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:49.234649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8fac0-7707-4773-9573-7510a1ca9b94 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:49.247968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22a62c-3c67-42c3-9614-c1cff6fbedb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:49.249275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22a62c-3c67-42c3-9614-c1cff6fbedb6 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:49.249938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22a62c-3c67-42c3-9614-c1cff6fbedb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:49.250542 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22a62c-3c67-42c3-9614-c1cff6fbedb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:49.252555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22a62c-3c67-42c3-9614-c1cff6fbedb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:49.252555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22a62c-3c67-42c3-9614-c1cff6fbedb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:49.256201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d22a62c-3c67-42c3-9614-c1cff6fbedb6 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:49.279649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 332/655] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:49.281096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22a62c-3c67-42c3-9614-c1cff6fbedb6 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:49.301104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e1aab-78d9-47d1-b32f-894bb6f91d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:49.301828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e1aab-78d9-47d1-b32f-894bb6f91d46 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:49.302664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e1aab-78d9-47d1-b32f-894bb6f91d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:49.302943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e1aab-78d9-47d1-b32f-894bb6f91d46 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:49.312390 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e1aab-78d9-47d1-b32f-894bb6f91d46 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:49.313998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e1aab-78d9-47d1-b32f-894bb6f91d46 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-b18e1aab-78d9-47d1-b32f-894bb6f91d46 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:49.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:49.338051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:49.340102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:49.340102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:49.340102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:49.340102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:49.340102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:49.340102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:49.340102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:49.340102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:49.340102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 05:18:49.340102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:49.343846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 324/656] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:49.345466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e1aab-78d9-47d1-b32f-894bb6f91d46 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:49.388545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:49.394136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:49.451653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22a62c-3c67-42c3-9614-c1cff6fbedb6 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:49.493159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a17369-ad25-41fc-88ff-f8dc5c4e7614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:49.493824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a17369-ad25-41fc-88ff-f8dc5c4e7614 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:49.494124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a17369-ad25-41fc-88ff-f8dc5c4e7614 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:49.494395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a17369-ad25-41fc-88ff-f8dc5c4e7614 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:49.495232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a17369-ad25-41fc-88ff-f8dc5c4e7614 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:49.495550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a17369-ad25-41fc-88ff-f8dc5c4e7614 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:49.497070 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a17369-ad25-41fc-88ff-f8dc5c4e7614 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:49.515699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e1aab-78d9-47d1-b32f-894bb6f91d46 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:49.518043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 333/657] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Sep 1 05:18:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:49.519022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a17369-ad25-41fc-88ff-f8dc5c4e7614 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:49.589560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9386965-6c84-42cf-a643-37ad396c3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:49.590588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9386965-6c84-42cf-a643-37ad396c3a95 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:49.591044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9386965-6c84-42cf-a643-37ad396c3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:49.591499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9386965-6c84-42cf-a643-37ad396c3a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:49.618485 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9386965-6c84-42cf-a643-37ad396c3a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:49.620979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9386965-6c84-42cf-a643-37ad396c3a95 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-d9386965-6c84-42cf-a643-37ad396c3a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:49.651651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:49.656277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:49.658617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:49.658617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:49.658617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:49.658617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 325/658] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:49.658617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9386965-6c84-42cf-a643-37ad396c3a95 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:49.702410 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a17369-ad25-41fc-88ff-f8dc5c4e7614 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:49.733994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:49.753833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440cf6-eb1e-4c3f-908f-a114ed5e03bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:49.756000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440cf6-eb1e-4c3f-908f-a114ed5e03bd None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:49.756432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440cf6-eb1e-4c3f-908f-a114ed5e03bd None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:49.756842 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80440cf6-eb1e-4c3f-908f-a114ed5e03bd None admin] PATH_INFO: `/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/8a0d07b79212443480c87f4a4ff3ca00/roles/64f98692a39a4f16bab66cd26ad8f65e` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:49.777702 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80440cf6-eb1e-4c3f-908f-a114ed5e03bd None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c3fe9229c45f1bfd295115ef94cd7, user_id=8a0d07b79212443480c87f4a4ff3ca00, role_id=64f98692a39a4f16bab66cd26ad8f65e)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:49.780123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80440cf6-eb1e-4c3f-908f-a114ed5e03bd None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:49.814056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:49.865257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9386965-6c84-42cf-a643-37ad396c3a95 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:49.872861 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 334/659] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:18:49 2022] PUT /identity/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/8a0d07b79212443480c87f4a4ff3ca00/roles/64f98692a39a4f16bab66cd26ad8f65e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:49.874017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440cf6-eb1e-4c3f-908f-a114ed5e03bd None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:49.946433 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27808f7-3091-4caf-a555-e2aa76b18a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:49.947461 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27808f7-3091-4caf-a555-e2aa76b18a3b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:49.947941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27808f7-3091-4caf-a555-e2aa76b18a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:49.948975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27808f7-3091-4caf-a555-e2aa76b18a3b None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:49.950494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27808f7-3091-4caf-a555-e2aa76b18a3b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:49.951293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27808f7-3091-4caf-a555-e2aa76b18a3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:49.954746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27808f7-3091-4caf-a555-e2aa76b18a3b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:50.001685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 326/660] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Sep 1 05:18:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:50.003898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27808f7-3091-4caf-a555-e2aa76b18a3b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:50.111015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80440cf6-eb1e-4c3f-908f-a114ed5e03bd None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:50.191158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bf2dd-c105-451b-99f2-699ffd392a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:50.192397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bf2dd-c105-451b-99f2-699ffd392a03 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:50.193019 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bf2dd-c105-451b-99f2-699ffd392a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:50.193989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49bf2dd-c105-451b-99f2-699ffd392a03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:50.254186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27808f7-3091-4caf-a555-e2aa76b18a3b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:50.258488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:50.296182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bf2dd-c105-451b-99f2-699ffd392a03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:50.298128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49bf2dd-c105-451b-99f2-699ffd392a03 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:50.325347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:50.335056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909e310-442f-4124-ad5a-e65c8b9cb16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:50.336637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909e310-442f-4124-ad5a-e65c8b9cb16e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:50.337278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909e310-442f-4124-ad5a-e65c8b9cb16e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:50.337938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909e310-442f-4124-ad5a-e65c8b9cb16e None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:50.339310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909e310-442f-4124-ad5a-e65c8b9cb16e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:50.340007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909e310-442f-4124-ad5a-e65c8b9cb16e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:50.342910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909e310-442f-4124-ad5a-e65c8b9cb16e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:50.372909 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 327/661] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:50.375173 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909e310-442f-4124-ad5a-e65c8b9cb16e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:50.464320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 335/662] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:50.466294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bf2dd-c105-451b-99f2-699ffd392a03 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:50.594287 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909e310-442f-4124-ad5a-e65c8b9cb16e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:50.630878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:50.673436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dcd64-1f8d-4ace-95f2-683bf492234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:50.673436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dcd64-1f8d-4ace-95f2-683bf492234f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:50.673436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dcd64-1f8d-4ace-95f2-683bf492234f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:50.673436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dcd64-1f8d-4ace-95f2-683bf492234f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:50.689333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49bf2dd-c105-451b-99f2-699ffd392a03 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:50.734751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57a247-11ed-4b17-b027-567b93569bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:50.735824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57a247-11ed-4b17-b027-567b93569bbc None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:50.736297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57a247-11ed-4b17-b027-567b93569bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:50.736870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57a247-11ed-4b17-b027-567b93569bbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:50.746797 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57a247-11ed-4b17-b027-567b93569bbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:50.748793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57a247-11ed-4b17-b027-567b93569bbc None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-0e57a247-11ed-4b17-b027-567b93569bbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:50.762670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:50.763647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:50.764547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:50.764547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:50.764547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:50.764547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:50.764547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:50.764547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:50.764547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:50.764547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:50.767284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 336/663] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:50.768505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57a247-11ed-4b17-b027-567b93569bbc None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:50.800479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:50.821722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dcd64-1f8d-4ace-95f2-683bf492234f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:50.824585 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dcd64-1f8d-4ace-95f2-683bf492234f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:50.904671 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57a247-11ed-4b17-b027-567b93569bbc None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:50.957906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:50.971970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f44349-377e-429d-a8cc-19ce356328ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:50.974218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f44349-377e-429d-a8cc-19ce356328ad None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:50.982835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f44349-377e-429d-a8cc-19ce356328ad None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:50.982835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f44349-377e-429d-a8cc-19ce356328ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:51.010968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f44349-377e-429d-a8cc-19ce356328ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:51.015776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f44349-377e-429d-a8cc-19ce356328ad None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:51.025902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 328/664] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:51.027812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dcd64-1f8d-4ace-95f2-683bf492234f None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-c8f44349-377e-429d-a8cc-19ce356328ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:51.050648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:51.052505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:51.054952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:51.054952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:51.054952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:51.058115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 337/665] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:51.060004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f44349-377e-429d-a8cc-19ce356328ad None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:51.166119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:51.184270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dcd64-1f8d-4ace-95f2-683bf492234f None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:51.250017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f44349-377e-429d-a8cc-19ce356328ad None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:51.262249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dd98c-a019-4ffb-82ea-93d05c594dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:51.262923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dd98c-a019-4ffb-82ea-93d05c594dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:51.263409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dd98c-a019-4ffb-82ea-93d05c594dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:51.263897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dd98c-a019-4ffb-82ea-93d05c594dc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:51.265241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dd98c-a019-4ffb-82ea-93d05c594dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:51.266196 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dd98c-a019-4ffb-82ea-93d05c594dc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:51.269051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dd98c-a019-4ffb-82ea-93d05c594dc5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:51.300218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 329/666] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:51.300218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dd98c-a019-4ffb-82ea-93d05c594dc5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:51.306993 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10810bc-12f0-4daf-b43d-fd24fedbeabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:51.308049 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10810bc-12f0-4daf-b43d-fd24fedbeabc None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:51.308561 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10810bc-12f0-4daf-b43d-fd24fedbeabc None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:51.309060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10810bc-12f0-4daf-b43d-fd24fedbeabc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:51.325934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10810bc-12f0-4daf-b43d-fd24fedbeabc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:51.328438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10810bc-12f0-4daf-b43d-fd24fedbeabc None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-f10810bc-12f0-4daf-b43d-fd24fedbeabc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:51.349428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:51.350495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:51.351422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:51.351422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:51.351422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:51.353662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 338/667] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:51.354760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10810bc-12f0-4daf-b43d-fd24fedbeabc None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:51.416759 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:51.507313 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dd98c-a019-4ffb-82ea-93d05c594dc5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:51.560008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10810bc-12f0-4daf-b43d-fd24fedbeabc None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:51.592278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45db2c2-c990-4297-b079-1e877f82ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:51.593704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45db2c2-c990-4297-b079-1e877f82ed19 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:51.594290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45db2c2-c990-4297-b079-1e877f82ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:51.594978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45db2c2-c990-4297-b079-1e877f82ed19 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:51.601515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45db2c2-c990-4297-b079-1e877f82ed19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:51.602363 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45db2c2-c990-4297-b079-1e877f82ed19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:51.605161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45db2c2-c990-4297-b079-1e877f82ed19 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:51.609784 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7b7ad-d074-4e3b-a7a2-24b2ff3b2ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:51.610760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7b7ad-d074-4e3b-a7a2-24b2ff3b2ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:51.612359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7b7ad-d074-4e3b-a7a2-24b2ff3b2ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:51.612956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7b7ad-d074-4e3b-a7a2-24b2ff3b2ef6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:51.615209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7b7ad-d074-4e3b-a7a2-24b2ff3b2ef6 None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=b7e84a5652df4d64aa1fd28f3d5383fe) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:51.615813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7b7ad-d074-4e3b-a7a2-24b2ff3b2ef6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:51.619009 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7b7ad-d074-4e3b-a7a2-24b2ff3b2ef6 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:51.636450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 330/668] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:51.638341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45db2c2-c990-4297-b079-1e877f82ed19 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:51.644231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 339/669] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:18:51 2022] GET /identity/v3/role_assignments?user.id=b7e84a5652df4d64aa1fd28f3d5383fe&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:51.646299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7b7ad-d074-4e3b-a7a2-24b2ff3b2ef6 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:51.679878 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:51.962185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45db2c2-c990-4297-b079-1e877f82ed19 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:51.969782 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:51.979720 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7b7ad-d074-4e3b-a7a2-24b2ff3b2ef6 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:52.035216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb024f73-e795-4703-857a-ce85496804e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:52.035878 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb024f73-e795-4703-857a-ce85496804e5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:52.036782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb024f73-e795-4703-857a-ce85496804e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:52.037219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb024f73-e795-4703-857a-ce85496804e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:52.038070 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb024f73-e795-4703-857a-ce85496804e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:52.038386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb024f73-e795-4703-857a-ce85496804e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:52.039875 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb024f73-e795-4703-857a-ce85496804e5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:52.057067 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 331/670] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:52.063035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb024f73-e795-4703-857a-ce85496804e5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:52.080219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f679-2e6f-46d2-98b6-104fbe1ba9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:52.082791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f679-2e6f-46d2-98b6-104fbe1ba9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:52.084305 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f679-2e6f-46d2-98b6-104fbe1ba9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:52.085464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07f679-2e6f-46d2-98b6-104fbe1ba9e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:52.104658 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07f679-2e6f-46d2-98b6-104fbe1ba9e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:52.108155 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07f679-2e6f-46d2-98b6-104fbe1ba9e8 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-3a07f679-2e6f-46d2-98b6-104fbe1ba9e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:52.155927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:52.157882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:52.159511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:52.159511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:52.159511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:52.159511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:52.159511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:52.159511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:52.159511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:52.159511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:52.160333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 340/671] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 515 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:52.171131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f679-2e6f-46d2-98b6-104fbe1ba9e8 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:52.196564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:52.358085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb024f73-e795-4703-857a-ce85496804e5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:52.358085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb9e01-f9ae-47ac-af3e-a451beb2cae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:52.358085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb9e01-f9ae-47ac-af3e-a451beb2cae1 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:52.358085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb9e01-f9ae-47ac-af3e-a451beb2cae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:52.359332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb9e01-f9ae-47ac-af3e-a451beb2cae1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:52.359332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb9e01-f9ae-47ac-af3e-a451beb2cae1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:52.359332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb9e01-f9ae-47ac-af3e-a451beb2cae1 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-c0cb9e01-f9ae-47ac-af3e-a451beb2cae1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:52.393879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:52.396904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:52.399421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:52.399421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:52.399421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:52.399421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:52.399421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:52.399421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:52.399421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:52.399421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:52.405062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 332/672] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:52.412676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504e1d-8c9f-44d5-94dc-9357fbf9dc0f None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:52.413807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504e1d-8c9f-44d5-94dc-9357fbf9dc0f None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:52.414632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45504e1d-8c9f-44d5-94dc-9357fbf9dc0f None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:52.418541 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 333/673] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:52.425232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07f679-2e6f-46d2-98b6-104fbe1ba9e8 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:52.429012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5d075-7dc4-4410-ba9d-93053659b3f3 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:52.429892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5d075-7dc4-4410-ba9d-93053659b3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:52.430677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5d075-7dc4-4410-ba9d-93053659b3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:52.478884 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-dcb5d075-7dc4-4410-ba9d-93053659b3f3 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:52.480960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-dcb5d075-7dc4-4410-ba9d-93053659b3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:52.520323 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7766d74-1d23-4e0a-883e-75cfe8adc210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:52.523086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7766d74-1d23-4e0a-883e-75cfe8adc210 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:52.523755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7766d74-1d23-4e0a-883e-75cfe8adc210 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:52.524470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7766d74-1d23-4e0a-883e-75cfe8adc210 None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:52.526137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7766d74-1d23-4e0a-883e-75cfe8adc210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:52.526901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7766d74-1d23-4e0a-883e-75cfe8adc210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:52.528909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7766d74-1d23-4e0a-883e-75cfe8adc210 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:52.546768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 341/674] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:18:52.547675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7766d74-1d23-4e0a-883e-75cfe8adc210 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:52.585413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:52.615828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 334/675] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:52.615828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5d075-7dc4-4410-ba9d-93053659b3f3 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:52.697866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:52.761450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7766d74-1d23-4e0a-883e-75cfe8adc210 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:52.778588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5d075-7dc4-4410-ba9d-93053659b3f3 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:52.823458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484d2a4-6f63-43c7-a9bb-f5db08079ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:52.824341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484d2a4-6f63-43c7-a9bb-f5db08079ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:52.824840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484d2a4-6f63-43c7-a9bb-f5db08079ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:52.825419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484d2a4-6f63-43c7-a9bb-f5db08079ea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:52.826388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484d2a4-6f63-43c7-a9bb-f5db08079ea6 None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=e03daa3b2e334436ad4d0b2915a61aa1) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:52.827049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484d2a4-6f63-43c7-a9bb-f5db08079ea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:52.828736 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484d2a4-6f63-43c7-a9bb-f5db08079ea6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:52.836526 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 335/676] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:18:52 2022] GET /identity/v3/role_assignments?user.id=e03daa3b2e334436ad4d0b2915a61aa1&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:52.840525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd5a2b-8fe6-46ee-b419-3295c9afdbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:52.840525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd5a2b-8fe6-46ee-b419-3295c9afdbf4 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:52.840525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd5a2b-8fe6-46ee-b419-3295c9afdbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:52.840890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd5a2b-8fe6-46ee-b419-3295c9afdbf4 None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:52.842144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd5a2b-8fe6-46ee-b419-3295c9afdbf4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:52.842726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd5a2b-8fe6-46ee-b419-3295c9afdbf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:52.845583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd5a2b-8fe6-46ee-b419-3295c9afdbf4 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:52.873847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 342/677] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:52.883493 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484d2a4-6f63-43c7-a9bb-f5db08079ea6 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:52.948788 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935d81a-3bf1-41ce-84fe-82fbef9ac51d None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:52.949305 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935d81a-3bf1-41ce-84fe-82fbef9ac51d None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:52.949930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935d81a-3bf1-41ce-84fe-82fbef9ac51d None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:52.953208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 343/678] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:52.959339 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a8533-68ae-4473-b30f-9fa3af3253a4 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:52.959851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a8533-68ae-4473-b30f-9fa3af3253a4 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:52.960442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a8533-68ae-4473-b30f-9fa3af3253a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:53.022918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-795a8533-68ae-4473-b30f-9fa3af3253a4 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:53.024283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-795a8533-68ae-4473-b30f-9fa3af3253a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:53.066748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484d2a4-6f63-43c7-a9bb-f5db08079ea6 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:53.120640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:53.136616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5222b-91d6-4e95-9530-a170cef3bd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:53.138074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5222b-91d6-4e95-9530-a170cef3bd8e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:53.138834 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5222b-91d6-4e95-9530-a170cef3bd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:53.139568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5222b-91d6-4e95-9530-a170cef3bd8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:53.141133 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5222b-91d6-4e95-9530-a170cef3bd8e None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=2e7d31c0ec474c428ed932882b989d2b) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:53.142230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5222b-91d6-4e95-9530-a170cef3bd8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:53.145188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5222b-91d6-4e95-9530-a170cef3bd8e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:53.157692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 336/679] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:18:52 2022] GET /identity/v3/role_assignments?user.id=2e7d31c0ec474c428ed932882b989d2b&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:53.213535 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 344/680] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 05:18:53.290842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5222b-91d6-4e95-9530-a170cef3bd8e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:53.552448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5222b-91d6-4e95-9530-a170cef3bd8e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:53.623201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e7d23-155c-44d4-ad84-962280c43079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:53.624204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e7d23-155c-44d4-ad84-962280c43079 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:53.624659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e7d23-155c-44d4-ad84-962280c43079 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:53.625112 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e7d23-155c-44d4-ad84-962280c43079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:53.654853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e7d23-155c-44d4-ad84-962280c43079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:53.657592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e7d23-155c-44d4-ad84-962280c43079 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-084e7d23-155c-44d4-ad84-962280c43079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:53.695430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:53.697298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:53.698967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:53.698967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:53.698967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:53.698967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 337/681] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:53.711871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a8533-68ae-4473-b30f-9fa3af3253a4 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:53.749444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e7d23-155c-44d4-ad84-962280c43079 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:53.752072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:53.918658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:54.079204 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a8533-68ae-4473-b30f-9fa3af3253a4 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:54.090126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e7d23-155c-44d4-ad84-962280c43079 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:54.201698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf908ec4-dcf8-4cd2-b524-54da20e63600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:54.202895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf908ec4-dcf8-4cd2-b524-54da20e63600 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:54.203524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf908ec4-dcf8-4cd2-b524-54da20e63600 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:54.204025 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf908ec4-dcf8-4cd2-b524-54da20e63600 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:54.204202 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d38088-e1e2-43e2-ab06-2c622e32cd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:54.205104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d38088-e1e2-43e2-ab06-2c622e32cd25 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:54.205269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf908ec4-dcf8-4cd2-b524-54da20e63600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:54.205612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d38088-e1e2-43e2-ab06-2c622e32cd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:54.205827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf908ec4-dcf8-4cd2-b524-54da20e63600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:54.206106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d38088-e1e2-43e2-ab06-2c622e32cd25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:54.209851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf908ec4-dcf8-4cd2-b524-54da20e63600 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:54.241901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 345/682] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 531 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:54.250999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf908ec4-dcf8-4cd2-b524-54da20e63600 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:54.253686 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d38088-e1e2-43e2-ab06-2c622e32cd25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-19d38088-e1e2-43e2-ab06-2c622e32cd25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:54.277981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:54.279779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:54.281316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 338/683] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 531 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:54.291408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d38088-e1e2-43e2-ab06-2c622e32cd25 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:54.417797 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:54.501248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf908ec4-dcf8-4cd2-b524-54da20e63600 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:54.574783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d38088-e1e2-43e2-ab06-2c622e32cd25 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:54.578763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0ce9c-7f0a-4cba-a5fb-ad0e8cd5d555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:54.579394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0ce9c-7f0a-4cba-a5fb-ad0e8cd5d555 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:54.579678 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0ce9c-7f0a-4cba-a5fb-ad0e8cd5d555 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:54.579963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0ce9c-7f0a-4cba-a5fb-ad0e8cd5d555 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:54.580651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0ce9c-7f0a-4cba-a5fb-ad0e8cd5d555 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:54.582173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0ce9c-7f0a-4cba-a5fb-ad0e8cd5d555 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:54.585923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:54.635745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fce47d-5b0c-4c77-8bc0-31922b87cb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:54.636380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fce47d-5b0c-4c77-8bc0-31922b87cb10 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:54.636734 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fce47d-5b0c-4c77-8bc0-31922b87cb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:54.637017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fce47d-5b0c-4c77-8bc0-31922b87cb10 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:54.637796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fce47d-5b0c-4c77-8bc0-31922b87cb10 None admin] RBAC: Adding query filter params (name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:54.638105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fce47d-5b0c-4c77-8bc0-31922b87cb10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:54.639528 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fce47d-5b0c-4c77-8bc0-31922b87cb10 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:54.650453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 339/684] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:54.656035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fce47d-5b0c-4c77-8bc0-31922b87cb10 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:54.824389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 346/685] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:18:54 2022] POST /identity/v3/users => generated 254 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:54.876809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fce47d-5b0c-4c77-8bc0-31922b87cb10 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:54.963467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd2ac7-60e6-4392-ab7e-67a2d1410778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:54.964569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd2ac7-60e6-4392-ab7e-67a2d1410778 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:54.965051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd2ac7-60e6-4392-ab7e-67a2d1410778 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:54.965567 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd2ac7-60e6-4392-ab7e-67a2d1410778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:54.996556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd2ac7-60e6-4392-ab7e-67a2d1410778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:55.008325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd2ac7-60e6-4392-ab7e-67a2d1410778 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-c2bd2ac7-60e6-4392-ab7e-67a2d1410778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:55.023104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:55.024924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:55.026662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:55.026662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:55.026662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:55.026662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 340/686] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:18:55.037850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0ce9c-7f0a-4cba-a5fb-ad0e8cd5d555 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:55.168802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0ce9c-7f0a-4cba-a5fb-ad0e8cd5d555 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:55.199611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:55.212068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7448-edf5-49d8-a8b9-f6b456a6a0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:55.212691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7448-edf5-49d8-a8b9-f6b456a6a0eb None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:55.215069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7448-edf5-49d8-a8b9-f6b456a6a0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:55.215069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7448-edf5-49d8-a8b9-f6b456a6a0eb None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:55.215069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7448-edf5-49d8-a8b9-f6b456a6a0eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:55.215069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7448-edf5-49d8-a8b9-f6b456a6a0eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:55.215704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7448-edf5-49d8-a8b9-f6b456a6a0eb None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:55.230124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 347/687] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:55.236201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd2ac7-60e6-4392-ab7e-67a2d1410778 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:55.279155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:55.423292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe02eda-3ac4-4b2d-af77-f6ed8d53a279 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:55.424395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe02eda-3ac4-4b2d-af77-f6ed8d53a279 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:55.424395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe02eda-3ac4-4b2d-af77-f6ed8d53a279 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:55.425753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 348/688] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:55.445457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd2ac7-60e6-4392-ab7e-67a2d1410778 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:55.450960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97263a-d103-492f-931d-9b52f46dfe0d None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:55.451370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97263a-d103-492f-931d-9b52f46dfe0d None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:55.451530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97263a-d103-492f-931d-9b52f46dfe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:55.482344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-bd97263a-d103-492f-931d-9b52f46dfe0d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:55.482344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-bd97263a-d103-492f-931d-9b52f46dfe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:55.554362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16a989-d431-4d73-8e79-f09d0087da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:55.555040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16a989-d431-4d73-8e79-f09d0087da4c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:55.555327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16a989-d431-4d73-8e79-f09d0087da4c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:55.555606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16a989-d431-4d73-8e79-f09d0087da4c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:55.564983 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16a989-d431-4d73-8e79-f09d0087da4c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:55.566695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16a989-d431-4d73-8e79-f09d0087da4c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:55.589412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 349/689] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-fb16a989-d431-4d73-8e79-f09d0087da4c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:55.591346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:55.593345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:55.595317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:55.595317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:55.595317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:55.595317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:55.595317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:55.595317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:55.595317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:55.595317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:55.595317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:18:55.595317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:55.598943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 341/690] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:18:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:55.606302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97263a-d103-492f-931d-9b52f46dfe0d None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:55.791425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97263a-d103-492f-931d-9b52f46dfe0d None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:55.825441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:55.853264 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea71193-73fc-49a2-b971-e95b07363efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:55.853924 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea71193-73fc-49a2-b971-e95b07363efa None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:55.854202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea71193-73fc-49a2-b971-e95b07363efa None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:55.854478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea71193-73fc-49a2-b971-e95b07363efa None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:55.855230 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea71193-73fc-49a2-b971-e95b07363efa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:55.855538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea71193-73fc-49a2-b971-e95b07363efa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:55.857013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea71193-73fc-49a2-b971-e95b07363efa None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:55.879425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 350/691] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Sep 1 05:18:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:55.887733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16a989-d431-4d73-8e79-f09d0087da4c None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:56.030917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea71193-73fc-49a2-b971-e95b07363efa None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:56.065915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:56.105409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16a989-d431-4d73-8e79-f09d0087da4c None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:56.190929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ffcf3-2018-4861-86cc-add6efd68134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:56.191965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ffcf3-2018-4861-86cc-add6efd68134 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:56.192596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ffcf3-2018-4861-86cc-add6efd68134 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:56.193437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ffcf3-2018-4861-86cc-add6efd68134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:56.263134 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea71193-73fc-49a2-b971-e95b07363efa None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:56.352170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a03a5d-ffaf-494b-b6dc-99901e216865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:56.353327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a03a5d-ffaf-494b-b6dc-99901e216865 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:56.353883 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a03a5d-ffaf-494b-b6dc-99901e216865 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:56.354407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a03a5d-ffaf-494b-b6dc-99901e216865 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:56.359469 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ffcf3-2018-4861-86cc-add6efd68134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:56.361059 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ffcf3-2018-4861-86cc-add6efd68134 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:56.372111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a03a5d-ffaf-494b-b6dc-99901e216865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-64a03a5d-ffaf-494b-b6dc-99901e216865 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:56.378449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:56.379498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:56.381700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:56.381700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:56.381700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:56.381700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:56.381700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:56.381700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:56.381700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:56.381700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:56.381700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:56.381700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:56.381700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:18:56.381700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:56.382404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 351/692] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:18:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:18:56.383192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98195fcd-b7fd-4643-a503-8f94bcb99a14 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:56.383465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98195fcd-b7fd-4643-a503-8f94bcb99a14 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:56.383737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98195fcd-b7fd-4643-a503-8f94bcb99a14 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:56.385255 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 352/693] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:56.386490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99967f21-9fb0-44d5-8411-ec239d8ec1f1 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:56.386830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99967f21-9fb0-44d5-8411-ec239d8ec1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:56.387110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99967f21-9fb0-44d5-8411-ec239d8ec1f1 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:56.389253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 353/694] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:56.394362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99967f21-9fb0-44d5-8411-ec239d8ec1f1 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:56.436198 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:56.491225 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:56.539074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 342/695] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:56.540557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11c6c9-8950-4f60-9665-58dc531cd65d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:56.541054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11c6c9-8950-4f60-9665-58dc531cd65d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:56.541584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11c6c9-8950-4f60-9665-58dc531cd65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:56.570485 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-bf11c6c9-8950-4f60-9665-58dc531cd65d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:56.571973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bf11c6c9-8950-4f60-9665-58dc531cd65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:56.613418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99967f21-9fb0-44d5-8411-ec239d8ec1f1 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:56.674085 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b4d44-71af-4a3c-bbda-8f187a1b9d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:56.675098 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4d44-71af-4a3c-bbda-8f187a1b9d7f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:56.675533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4d44-71af-4a3c-bbda-8f187a1b9d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:56.675982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4d44-71af-4a3c-bbda-8f187a1b9d7f None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:56.677956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b4d44-71af-4a3c-bbda-8f187a1b9d7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:56.678198 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b4d44-71af-4a3c-bbda-8f187a1b9d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:56.680695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b4d44-71af-4a3c-bbda-8f187a1b9d7f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:56.694835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 354/696] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:18:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:56.696552 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c94754-3cb1-4bba-8356-9dc2a4f30da7 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:56.697016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c94754-3cb1-4bba-8356-9dc2a4f30da7 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:56.697505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c94754-3cb1-4bba-8356-9dc2a4f30da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:56.702278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 343/697] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:56.703477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11c6c9-8950-4f60-9665-58dc531cd65d None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:56.731561 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-d4c94754-3cb1-4bba-8356-9dc2a4f30da7 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:56.734161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d4c94754-3cb1-4bba-8356-9dc2a4f30da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:56.841770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 355/698] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:56.843453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c94754-3cb1-4bba-8356-9dc2a4f30da7 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:56.861908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11c6c9-8950-4f60-9665-58dc531cd65d None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:56.874781 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:56.894904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:56.914352 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee49aff-4460-47f2-b76d-cc71a73e0bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:56.915019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee49aff-4460-47f2-b76d-cc71a73e0bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:56.915438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee49aff-4460-47f2-b76d-cc71a73e0bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:56.915809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee49aff-4460-47f2-b76d-cc71a73e0bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:56.936837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee49aff-4460-47f2-b76d-cc71a73e0bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:56.938553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee49aff-4460-47f2-b76d-cc71a73e0bf2 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-dee49aff-4460-47f2-b76d-cc71a73e0bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:56.960542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:56.962733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:56.965325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:56.965325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:56.965325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:56.965325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 344/699] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:56.973830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee49aff-4460-47f2-b76d-cc71a73e0bf2 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:57.094477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c94754-3cb1-4bba-8356-9dc2a4f30da7 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:57.162363 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71993d-54f9-41fe-89c8-dd02a7a7f1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:57.162934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71993d-54f9-41fe-89c8-dd02a7a7f1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:57.163256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71993d-54f9-41fe-89c8-dd02a7a7f1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:57.163546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71993d-54f9-41fe-89c8-dd02a7a7f1b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:57.175770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71993d-54f9-41fe-89c8-dd02a7a7f1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:57.177721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71993d-54f9-41fe-89c8-dd02a7a7f1b9 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:57.190018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee49aff-4460-47f2-b76d-cc71a73e0bf2 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-5c71993d-54f9-41fe-89c8-dd02a7a7f1b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:57.201408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:57.203449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:57.205159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:57.205159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:57.205159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:57.205159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 356/700] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:57.205159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71993d-54f9-41fe-89c8-dd02a7a7f1b9 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:57.253519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d9ec6-5e06-4c23-bed2-7e235250aac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:57.254163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d9ec6-5e06-4c23-bed2-7e235250aac2 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:57.254446 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d9ec6-5e06-4c23-bed2-7e235250aac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:57.255281 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d9ec6-5e06-4c23-bed2-7e235250aac2 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:57.255962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d9ec6-5e06-4c23-bed2-7e235250aac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:57.256266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d9ec6-5e06-4c23-bed2-7e235250aac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:57.257727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d9ec6-5e06-4c23-bed2-7e235250aac2 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:57.277525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 345/701] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:57.278611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d9ec6-5e06-4c23-bed2-7e235250aac2 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:57.299978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:57.310563 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:57.341775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71993d-54f9-41fe-89c8-dd02a7a7f1b9 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:57.387511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d9fcd-657f-48c9-ab3e-51b747400a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:57.388441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d9fcd-657f-48c9-ab3e-51b747400a1f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:57.388608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d9fcd-657f-48c9-ab3e-51b747400a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:57.388838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d9fcd-657f-48c9-ab3e-51b747400a1f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:57.389467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d9fcd-657f-48c9-ab3e-51b747400a1f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:57.390978 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d9fcd-657f-48c9-ab3e-51b747400a1f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-6b7d9fcd-657f-48c9-ab3e-51b747400a1f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:57.403891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:57.406920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:57.408588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 357/702] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Sep 1 05:18:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:57.410245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d9fcd-657f-48c9-ab3e-51b747400a1f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:57.418842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d9ec6-5e06-4c23-bed2-7e235250aac2 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:57.461984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783b0c6-5c58-44e7-ad49-12c100f345ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:57.462614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783b0c6-5c58-44e7-ad49-12c100f345ff None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:57.462893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783b0c6-5c58-44e7-ad49-12c100f345ff None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:57.463165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783b0c6-5c58-44e7-ad49-12c100f345ff None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:57.463974 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783b0c6-5c58-44e7-ad49-12c100f345ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:57.464279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783b0c6-5c58-44e7-ad49-12c100f345ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:57.465957 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783b0c6-5c58-44e7-ad49-12c100f345ff None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:57.483979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 346/703] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:57.488271 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783b0c6-5c58-44e7-ad49-12c100f345ff None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:57.562908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d9fcd-657f-48c9-ab3e-51b747400a1f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:57.603866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:57.622252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bb263-163b-4b87-b364-9e28453bf1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:57.623230 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bb263-163b-4b87-b364-9e28453bf1fb None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:57.623636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bb263-163b-4b87-b364-9e28453bf1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:57.624089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bb263-163b-4b87-b364-9e28453bf1fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:57.633805 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bb263-163b-4b87-b364-9e28453bf1fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:57.634222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783b0c6-5c58-44e7-ad49-12c100f345ff None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:57.635667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bb263-163b-4b87-b364-9e28453bf1fb None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:57.639235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-e05bb263-163b-4b87-b364-9e28453bf1fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:18:57.651053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:57.652222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:57.653261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:18:57.653261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:18:57.653261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:18:57.653261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:18:57.653261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:18:57.653261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:18:57.653261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:18:57.653261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:57.653261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 358/704] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:57.657859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bb263-163b-4b87-b364-9e28453bf1fb None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:57.678729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9354d-d40c-45ff-80b7-92aca551995c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:57.679546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9354d-d40c-45ff-80b7-92aca551995c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:57.679897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9354d-d40c-45ff-80b7-92aca551995c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:57.680172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9354d-d40c-45ff-80b7-92aca551995c None admin] PATH_INFO: `/v3/services/network` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:57.680762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9354d-d40c-45ff-80b7-92aca551995c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:57.682213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9354d-d40c-45ff-80b7-92aca551995c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-35b9354d-d40c-45ff-80b7-92aca551995c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:57.695996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:57.697125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:57.697995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 347/705] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:18:57 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:57.698782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9354d-d40c-45ff-80b7-92aca551995c None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:57.800934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bb263-163b-4b87-b364-9e28453bf1fb None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:57.848974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5e3ff-8377-4a70-abd9-644659d6c274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:57.849951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5e3ff-8377-4a70-abd9-644659d6c274 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:57.849951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5e3ff-8377-4a70-abd9-644659d6c274 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:57.850148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5e3ff-8377-4a70-abd9-644659d6c274 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:57.850797 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5e3ff-8377-4a70-abd9-644659d6c274 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:57.851096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5e3ff-8377-4a70-abd9-644659d6c274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:57.852506 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5e3ff-8377-4a70-abd9-644659d6c274 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:57.857251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9354d-d40c-45ff-80b7-92aca551995c None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:57.858013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 359/706] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Sep 1 05:18:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:57.858898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5e3ff-8377-4a70-abd9-644659d6c274 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:57.921615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6b0a2-08c2-4a69-bae7-322b1f294e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:57.922283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6b0a2-08c2-4a69-bae7-322b1f294e9d None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:57.922617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6b0a2-08c2-4a69-bae7-322b1f294e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:57.922862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6b0a2-08c2-4a69-bae7-322b1f294e9d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:57.932167 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6b0a2-08c2-4a69-bae7-322b1f294e9d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:57.933595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6b0a2-08c2-4a69-bae7-322b1f294e9d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-acf6b0a2-08c2-4a69-bae7-322b1f294e9d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:18:57.953359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:57.954935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:57.957897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:57.957897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:57.957897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:18:57.957897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:18:57.957897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:18:57.957897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:18:57.957897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:18:57.957897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:18:57.957897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:18:57.957897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:57.957897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 348/707] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Sep 1 05:18:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:57.957897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6b0a2-08c2-4a69-bae7-322b1f294e9d None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:57.961954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:57.969361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:58.026955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5e3ff-8377-4a70-abd9-644659d6c274 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:58.069411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38ec27-a471-4515-ab1c-dcd8a1a70c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:58.070053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38ec27-a471-4515-ab1c-dcd8a1a70c4f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:58.070332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38ec27-a471-4515-ab1c-dcd8a1a70c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:58.070609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38ec27-a471-4515-ab1c-dcd8a1a70c4f None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:58.071308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38ec27-a471-4515-ab1c-dcd8a1a70c4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:58.071613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38ec27-a471-4515-ab1c-dcd8a1a70c4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:58.073105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38ec27-a471-4515-ab1c-dcd8a1a70c4f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:58.086969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 360/708] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:18:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:58.087850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38ec27-a471-4515-ab1c-dcd8a1a70c4f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:58.123314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6b0a2-08c2-4a69-bae7-322b1f294e9d None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:58.162408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f564e-2e3b-4f9e-aea6-349b7b276446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:58.163038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f564e-2e3b-4f9e-aea6-349b7b276446 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:58.163323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f564e-2e3b-4f9e-aea6-349b7b276446 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:58.163600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f564e-2e3b-4f9e-aea6-349b7b276446 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:58.164311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f564e-2e3b-4f9e-aea6-349b7b276446 None admin] RBAC: Adding query filter params (name=network) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:58.164608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f564e-2e3b-4f9e-aea6-349b7b276446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:58.166091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f564e-2e3b-4f9e-aea6-349b7b276446 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:58.171519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 349/709] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:18:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:58.172407 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f564e-2e3b-4f9e-aea6-349b7b276446 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:58.221433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38ec27-a471-4515-ab1c-dcd8a1a70c4f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:58.251968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:58.260772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:58.278930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e2fc9-f02f-4bad-8e92-26aa2e184703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:58.279955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e2fc9-f02f-4bad-8e92-26aa2e184703 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:58.280448 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e2fc9-f02f-4bad-8e92-26aa2e184703 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:58.280930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e2fc9-f02f-4bad-8e92-26aa2e184703 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:58.282117 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e2fc9-f02f-4bad-8e92-26aa2e184703 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:58.282645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e2fc9-f02f-4bad-8e92-26aa2e184703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:58.285310 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e2fc9-f02f-4bad-8e92-26aa2e184703 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:58.295633 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f564e-2e3b-4f9e-aea6-349b7b276446 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:58.305451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 361/710] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Sep 1 05:18:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:58.305451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96196a8f-54ef-4641-9cd3-41fd5235bd02 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:58.305451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96196a8f-54ef-4641-9cd3-41fd5235bd02 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:58.305451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96196a8f-54ef-4641-9cd3-41fd5235bd02 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:58.305451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 362/711] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:18:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:18:58.305451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96196a8f-54ef-4641-9cd3-41fd5235bd02 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:58.365660 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fbb00-4d08-4a61-b1f9-a8d9a3b6b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:58.366796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fbb00-4d08-4a61-b1f9-a8d9a3b6b12a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:58.367291 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fbb00-4d08-4a61-b1f9-a8d9a3b6b12a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:58.367964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fbb00-4d08-4a61-b1f9-a8d9a3b6b12a None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:58.369046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fbb00-4d08-4a61-b1f9-a8d9a3b6b12a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:58.369605 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fbb00-4d08-4a61-b1f9-a8d9a3b6b12a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:58.371148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fbb00-4d08-4a61-b1f9-a8d9a3b6b12a None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:58.401311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 350/712] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Sep 1 05:18:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:58.402357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fbb00-4d08-4a61-b1f9-a8d9a3b6b12a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:58.514688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96196a8f-54ef-4641-9cd3-41fd5235bd02 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:58.558990 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e3dee-34a1-4110-a704-4f55a2f01fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:58.559474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e3dee-34a1-4110-a704-4f55a2f01fbc None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:58.559757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e3dee-34a1-4110-a704-4f55a2f01fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:58.560111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e3dee-34a1-4110-a704-4f55a2f01fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:58.560780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e3dee-34a1-4110-a704-4f55a2f01fbc None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=8a0d07b79212443480c87f4a4ff3ca00) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:58.561082 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e3dee-34a1-4110-a704-4f55a2f01fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:58.562595 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e3dee-34a1-4110-a704-4f55a2f01fbc None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:58.565363 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fbb00-4d08-4a61-b1f9-a8d9a3b6b12a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:58.570117 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 363/713] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:18:58 2022] GET /identity/v3/role_assignments?user.id=8a0d07b79212443480c87f4a4ff3ca00&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:58.575937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb75aa-b7d4-40fe-87ea-d257a3bf6a68 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:58.576575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb75aa-b7d4-40fe-87ea-d257a3bf6a68 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:58.577233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb75aa-b7d4-40fe-87ea-d257a3bf6a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:58.617895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:58.618343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-dfdb75aa-b7d4-40fe-87ea-d257a3bf6a68 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:58.620219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-dfdb75aa-b7d4-40fe-87ea-d257a3bf6a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:58.647988 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd81cc-6387-48c3-aca4-dad4894af9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:58.649016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd81cc-6387-48c3-aca4-dad4894af9ca None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:58.649541 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd81cc-6387-48c3-aca4-dad4894af9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:58.650011 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd81cc-6387-48c3-aca4-dad4894af9ca None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:58.651129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd81cc-6387-48c3-aca4-dad4894af9ca None admin] RBAC: Adding query filter params (type=network) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:58.651648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd81cc-6387-48c3-aca4-dad4894af9ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:58.654336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd81cc-6387-48c3-aca4-dad4894af9ca None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:58.668495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 351/714] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:18:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:58.670059 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd81cc-6387-48c3-aca4-dad4894af9ca None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:58.772461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:58.834735 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 364/715] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:18:58.929905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd81cc-6387-48c3-aca4-dad4894af9ca None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:58.977873 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c62e0-ec16-412b-a7a9-e5e966ff54a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:58.978507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c62e0-ec16-412b-a7a9-e5e966ff54a8 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:58.978797 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c62e0-ec16-412b-a7a9-e5e966ff54a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:58.979052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c62e0-ec16-412b-a7a9-e5e966ff54a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:59.102393 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:59.125615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c62e0-ec16-412b-a7a9-e5e966ff54a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:59.128351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c62e0-ec16-412b-a7a9-e5e966ff54a8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:59.164541 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb75aa-b7d4-40fe-87ea-d257a3bf6a68 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:59.331527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 352/716] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:18:59.340859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c62e0-ec16-412b-a7a9-e5e966ff54a8 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:59.392141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb75aa-b7d4-40fe-87ea-d257a3bf6a68 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:59.492084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cb346-68b8-4eb1-96aa-9709cbd1cb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:59.493129 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cb346-68b8-4eb1-96aa-9709cbd1cb49 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:59.493691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cb346-68b8-4eb1-96aa-9709cbd1cb49 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:59.494193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cb346-68b8-4eb1-96aa-9709cbd1cb49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:59.530977 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:59.532456 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cb346-68b8-4eb1-96aa-9709cbd1cb49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-5f5cb346-68b8-4eb1-96aa-9709cbd1cb49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:18:59.538664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:59.545772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:59.547521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:59.547521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:59.547521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:59.547521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:59.547521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:18:59.547521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:18:59.547521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:18:59.547521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:18:59.547521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:18:59.547521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:18:59.547521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:18:59.547521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:18:59.550312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 365/717] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:18:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:18:59.553432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cb346-68b8-4eb1-96aa-9709cbd1cb49 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:59.556203 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c62e0-ec16-412b-a7a9-e5e966ff54a8 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:59.643623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20a3c9-021a-412c-86b9-ffef5f689cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:59.651377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20a3c9-021a-412c-86b9-ffef5f689cff None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:59.651868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20a3c9-021a-412c-86b9-ffef5f689cff None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:59.652354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20a3c9-021a-412c-86b9-ffef5f689cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:59.662571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:59.691310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20a3c9-021a-412c-86b9-ffef5f689cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:59.692975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20a3c9-021a-412c-86b9-ffef5f689cff None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-6b20a3c9-021a-412c-86b9-ffef5f689cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:18:59.726107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:18:59.727222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:18:59.728142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:18:59.728142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:18:59.728142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:18:59.735850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 353/718] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:18:59.743877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20a3c9-021a-412c-86b9-ffef5f689cff None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:59.774735 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cb346-68b8-4eb1-96aa-9709cbd1cb49 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:59.845663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d80f1-a936-4f79-8fbd-62dcbb60f79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:59.847379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d80f1-a936-4f79-8fbd-62dcbb60f79e None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:59.847683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d80f1-a936-4f79-8fbd-62dcbb60f79e None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:59.847927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d80f1-a936-4f79-8fbd-62dcbb60f79e None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:59.848696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d80f1-a936-4f79-8fbd-62dcbb60f79e None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:59.849001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d80f1-a936-4f79-8fbd-62dcbb60f79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:59.853589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d80f1-a936-4f79-8fbd-62dcbb60f79e None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:59.874563 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 366/719] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:18:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:59.880956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d80f1-a936-4f79-8fbd-62dcbb60f79e None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:00.048604 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d80f1-a936-4f79-8fbd-62dcbb60f79e None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:00.053260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:00.076980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20a3c9-021a-412c-86b9-ffef5f689cff None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:00.124737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901dc0f-3564-43e2-a7d2-ad2a21544fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:00.126450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901dc0f-3564-43e2-a7d2-ad2a21544fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:00.130670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901dc0f-3564-43e2-a7d2-ad2a21544fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:00.132047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901dc0f-3564-43e2-a7d2-ad2a21544fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:00.148962 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901dc0f-3564-43e2-a7d2-ad2a21544fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:00.150919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901dc0f-3564-43e2-a7d2-ad2a21544fd7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:00.165631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63f174-bafa-407a-af43-bfd8dc9f33ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:00.166269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63f174-bafa-407a-af43-bfd8dc9f33ae None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:00.166552 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63f174-bafa-407a-af43-bfd8dc9f33ae None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:00.166830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d63f174-bafa-407a-af43-bfd8dc9f33ae None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:00.167502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63f174-bafa-407a-af43-bfd8dc9f33ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:00.167809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63f174-bafa-407a-af43-bfd8dc9f33ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:00.169306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d63f174-bafa-407a-af43-bfd8dc9f33ae None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-a901dc0f-3564-43e2-a7d2-ad2a21544fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:00.172164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:00.173485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:00.174490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:00.174490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:00.174490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:00.181677 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 367/720] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:00.185979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901dc0f-3564-43e2-a7d2-ad2a21544fd7 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:00.186973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:00.197247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 354/721] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:00.203014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63f174-bafa-407a-af43-bfd8dc9f33ae None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:00.311665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901dc0f-3564-43e2-a7d2-ad2a21544fd7 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:00.355163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac7ed6-1ad5-4246-86d0-a91f752d50c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:00.356195 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac7ed6-1ad5-4246-86d0-a91f752d50c3 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:00.356713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac7ed6-1ad5-4246-86d0-a91f752d50c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:00.357200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac7ed6-1ad5-4246-86d0-a91f752d50c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:00.358150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac7ed6-1ad5-4246-86d0-a91f752d50c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:00.358670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac7ed6-1ad5-4246-86d0-a91f752d50c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:00.360325 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac7ed6-1ad5-4246-86d0-a91f752d50c3 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:00.379230 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 368/722] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:00.381754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac7ed6-1ad5-4246-86d0-a91f752d50c3 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:00.403099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:00.525963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d63f174-bafa-407a-af43-bfd8dc9f33ae None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:00.533279 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac7ed6-1ad5-4246-86d0-a91f752d50c3 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:00.635090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615a021-c481-453e-9daa-93a7106316d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:00.637651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a021-c481-453e-9daa-93a7106316d6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:00.638500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a021-c481-453e-9daa-93a7106316d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:00.639271 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a021-c481-453e-9daa-93a7106316d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:00.641114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679ef3-6982-4cd3-a8ce-22a6575e91da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:00.641793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679ef3-6982-4cd3-a8ce-22a6575e91da None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:00.642160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679ef3-6982-4cd3-a8ce-22a6575e91da None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:00.642336 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679ef3-6982-4cd3-a8ce-22a6575e91da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:00.651685 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26679ef3-6982-4cd3-a8ce-22a6575e91da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:00.653165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26679ef3-6982-4cd3-a8ce-22a6575e91da None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:00.656339 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615a021-c481-453e-9daa-93a7106316d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:00.660117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615a021-c481-453e-9daa-93a7106316d6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-26679ef3-6982-4cd3-a8ce-22a6575e91da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:00.666946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:00.670253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:00.672175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:00.672175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:00.672175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:00.672175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:00.672175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:00.672175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:00.672175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:00.672175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:00.672175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:19:00.672175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:00.672175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 369/723] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Sep 1 05:19:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:00.678782 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679ef3-6982-4cd3-a8ce-22a6575e91da None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-1615a021-c481-453e-9daa-93a7106316d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:00.705002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:00.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:00.712692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:00.712692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:00.712692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:00.712692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:00.712692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:00.712692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:00.712692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:00.712692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:00.712692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 355/724] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 504 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:00.714627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615a021-c481-453e-9daa-93a7106316d6 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:00.847267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:00.866676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:00.874826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26679ef3-6982-4cd3-a8ce-22a6575e91da None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:00.919646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31545b8-9183-430c-a31c-62b1508ae787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:00.920225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31545b8-9183-430c-a31c-62b1508ae787 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:00.920509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31545b8-9183-430c-a31c-62b1508ae787 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:00.920787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31545b8-9183-430c-a31c-62b1508ae787 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:00.922528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31545b8-9183-430c-a31c-62b1508ae787 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:00.922840 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31545b8-9183-430c-a31c-62b1508ae787 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:00.924320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31545b8-9183-430c-a31c-62b1508ae787 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:00.961239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 370/725] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Sep 1 05:19:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:00.966955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615a021-c481-453e-9daa-93a7106316d6 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:00.968954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31545b8-9183-430c-a31c-62b1508ae787 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:01.060149 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3e4b-d7da-4647-b15a-525ed6ce4699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:01.060922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3e4b-d7da-4647-b15a-525ed6ce4699 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:01.061450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3e4b-d7da-4647-b15a-525ed6ce4699 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:01.061934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c3e4b-d7da-4647-b15a-525ed6ce4699 None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:01.062823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c3e4b-d7da-4647-b15a-525ed6ce4699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:01.063139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c3e4b-d7da-4647-b15a-525ed6ce4699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:01.071777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c3e4b-d7da-4647-b15a-525ed6ce4699 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:01.107185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 356/726] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:01.112490 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3e4b-d7da-4647-b15a-525ed6ce4699 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:01.263480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31545b8-9183-430c-a31c-62b1508ae787 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:01.314712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e57509-8dc6-49e6-97a3-b685342a04f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:01.317327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e57509-8dc6-49e6-97a3-b685342a04f1 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:01.317902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e57509-8dc6-49e6-97a3-b685342a04f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:01.318411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e57509-8dc6-49e6-97a3-b685342a04f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:01.324563 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:01.363037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c3e4b-d7da-4647-b15a-525ed6ce4699 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:01.417984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:01.434114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e57509-8dc6-49e6-97a3-b685342a04f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:01.439554 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e57509-8dc6-49e6-97a3-b685342a04f1 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:01.447985 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684b5dd-6ce7-4f00-a548-2928bd3134fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:01.449737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684b5dd-6ce7-4f00-a548-2928bd3134fb None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:01.450540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684b5dd-6ce7-4f00-a548-2928bd3134fb None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:01.451355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684b5dd-6ce7-4f00-a548-2928bd3134fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:01.453014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684b5dd-6ce7-4f00-a548-2928bd3134fb None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=b7e84a5652df4d64aa1fd28f3d5383fe) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:01.453858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684b5dd-6ce7-4f00-a548-2928bd3134fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:01.457024 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684b5dd-6ce7-4f00-a548-2928bd3134fb None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:01.470182 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 357/727] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:19:01 2022] GET /identity/v3/role_assignments?user.id=b7e84a5652df4d64aa1fd28f3d5383fe&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 259 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:01.474979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e252b-5a3a-47ae-8458-3a382bda6395 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:01.475909 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e252b-5a3a-47ae-8458-3a382bda6395 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:01.476623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e252b-5a3a-47ae-8458-3a382bda6395 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:01.480155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 358/728] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:01.490408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67e297-05aa-44b1-acd9-624f4fc6dc74 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:01.491274 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67e297-05aa-44b1-acd9-624f4fc6dc74 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:01.491998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67e297-05aa-44b1-acd9-624f4fc6dc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:01.532017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-db67e297-05aa-44b1-acd9-624f4fc6dc74 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:01.533231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-db67e297-05aa-44b1-acd9-624f4fc6dc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:01.663551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 371/729] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:19:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 05:19:01.675951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e57509-8dc6-49e6-97a3-b685342a04f1 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:01.706779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 359/730] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:19:01.708925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db61551-da41-4fb9-9784-c36d06c810da None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:01.709512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db61551-da41-4fb9-9784-c36d06c810da None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:01.710257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db61551-da41-4fb9-9784-c36d06c810da None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:01.712196 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 360/731] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:01.718831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4182957-d547-495c-9a34-31e2a030b650 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:01.719460 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4182957-d547-495c-9a34-31e2a030b650 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:01.719943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4182957-d547-495c-9a34-31e2a030b650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:01.742131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a4182957-d547-495c-9a34-31e2a030b650 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:01.743734 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a4182957-d547-495c-9a34-31e2a030b650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:01.752606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:01.845658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 361/732] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:19:01.845658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec8032-e270-4327-9071-4c1c309cdbc1 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:01.845658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec8032-e270-4327-9071-4c1c309cdbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:01.845658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec8032-e270-4327-9071-4c1c309cdbc1 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:01.853027 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 362/733] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:01.869934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775287ec-a1af-4980-9f9f-19450570fbb9 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:01.870609 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775287ec-a1af-4980-9f9f-19450570fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:01.871114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775287ec-a1af-4980-9f9f-19450570fbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:01.934506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-775287ec-a1af-4980-9f9f-19450570fbb9 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:01.936654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-775287ec-a1af-4980-9f9f-19450570fbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:01.956466 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e57509-8dc6-49e6-97a3-b685342a04f1 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:02.024044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:02.055383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d464f46-c462-43ed-8733-59a256b0097a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:02.056376 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d464f46-c462-43ed-8733-59a256b0097a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:02.056666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d464f46-c462-43ed-8733-59a256b0097a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:02.056946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d464f46-c462-43ed-8733-59a256b0097a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:02.073219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d464f46-c462-43ed-8733-59a256b0097a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:02.073938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 363/734] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 05:19:02.074668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d464f46-c462-43ed-8733-59a256b0097a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:02.075561 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775287ec-a1af-4980-9f9f-19450570fbb9 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-6d464f46-c462-43ed-8733-59a256b0097a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:02.097012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:02.098429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:02.099756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:02.099756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:02.099756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:02.099756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 372/735] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:02.106596 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d464f46-c462-43ed-8733-59a256b0097a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:02.253248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:02.264218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775287ec-a1af-4980-9f9f-19450570fbb9 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:02.276692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d464f46-c462-43ed-8733-59a256b0097a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:02.323128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbb1fc-47b8-4a96-a2d7-ce7b97eda950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:02.323830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbb1fc-47b8-4a96-a2d7-ce7b97eda950 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:02.324056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbb1fc-47b8-4a96-a2d7-ce7b97eda950 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:02.324334 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbb1fc-47b8-4a96-a2d7-ce7b97eda950 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:02.325013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbb1fc-47b8-4a96-a2d7-ce7b97eda950 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:02.326600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbb1fc-47b8-4a96-a2d7-ce7b97eda950 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:02.340592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd5a65-4528-4e2e-b9d5-6318cf7e3d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:02.346737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd5a65-4528-4e2e-b9d5-6318cf7e3d89 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:02.346737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd5a65-4528-4e2e-b9d5-6318cf7e3d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:02.346737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd5a65-4528-4e2e-b9d5-6318cf7e3d89 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:02.346737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd5a65-4528-4e2e-b9d5-6318cf7e3d89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:02.346737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd5a65-4528-4e2e-b9d5-6318cf7e3d89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:02.346737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd5a65-4528-4e2e-b9d5-6318cf7e3d89 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:02.361517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 373/736] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:02.361517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd5a65-4528-4e2e-b9d5-6318cf7e3d89 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:02.474726 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 364/737] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:19:02 2022] POST /identity/v3/services => generated 251 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:02.475889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbb1fc-47b8-4a96-a2d7-ce7b97eda950 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:02.487424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd5a65-4528-4e2e-b9d5-6318cf7e3d89 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:02.525685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:02.590316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bdba4-3a1d-43b5-a1a6-8799f0b43c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:02.590874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bdba4-3a1d-43b5-a1a6-8799f0b43c05 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:02.591150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bdba4-3a1d-43b5-a1a6-8799f0b43c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:02.591433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bdba4-3a1d-43b5-a1a6-8799f0b43c05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:02.609485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022bdba4-3a1d-43b5-a1a6-8799f0b43c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-022bdba4-3a1d-43b5-a1a6-8799f0b43c05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:19:02.616225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:02.618182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:02.619832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:02.619832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:02.619832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:02.619832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:02.619832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:19:02.619832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:19:02.619832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:19:02.619832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:19:02.619832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:19:02.619832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:19:02.619832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:19:02.619832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:02.622662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 374/738] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:19:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:02.627533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bdba4-3a1d-43b5-a1a6-8799f0b43c05 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:02.632083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:02.663193 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbb1fc-47b8-4a96-a2d7-ce7b97eda950 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:02.734941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31013811-8abc-4b0a-8414-9d4897c402bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:02.737589 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31013811-8abc-4b0a-8414-9d4897c402bd None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:02.739543 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31013811-8abc-4b0a-8414-9d4897c402bd None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:02.740564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31013811-8abc-4b0a-8414-9d4897c402bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:02.754861 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31013811-8abc-4b0a-8414-9d4897c402bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:02.758519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31013811-8abc-4b0a-8414-9d4897c402bd None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:02.777335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bdba4-3a1d-43b5-a1a6-8799f0b43c05 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-31013811-8abc-4b0a-8414-9d4897c402bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:02.784401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:02.786391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:02.788198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:02.788198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:02.788198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:02.788198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:02.788198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:02.788198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:02.788198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:02.788198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:02.792912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 365/739] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:02.795233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31013811-8abc-4b0a-8414-9d4897c402bd None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:02.842813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272bb1e-2dd9-4adc-ba24-009701750e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:02.844655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272bb1e-2dd9-4adc-ba24-009701750e60 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:02.845822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272bb1e-2dd9-4adc-ba24-009701750e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:02.846309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272bb1e-2dd9-4adc-ba24-009701750e60 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:02.847472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272bb1e-2dd9-4adc-ba24-009701750e60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:02.850564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a272bb1e-2dd9-4adc-ba24-009701750e60 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:02.964143 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 375/740] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:19:02 2022] POST /identity/v3/services => generated 240 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:02.965743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272bb1e-2dd9-4adc-ba24-009701750e60 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:02.991542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:03.008766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31013811-8abc-4b0a-8414-9d4897c402bd None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:03.137569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:03.137818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa52193-7485-4352-9d76-cb30999f1b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:03.137818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa52193-7485-4352-9d76-cb30999f1b0a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:03.137818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa52193-7485-4352-9d76-cb30999f1b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:03.137818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa52193-7485-4352-9d76-cb30999f1b0a None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:03.138345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa52193-7485-4352-9d76-cb30999f1b0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:03.138345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa52193-7485-4352-9d76-cb30999f1b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:03.138345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa52193-7485-4352-9d76-cb30999f1b0a None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:03.138345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 366/741] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:19:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:03.144634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa52193-7485-4352-9d76-cb30999f1b0a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:03.189815 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a272bb1e-2dd9-4adc-ba24-009701750e60 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:03.257334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed5732-8f27-42f2-94d5-08f959275a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:03.258923 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed5732-8f27-42f2-94d5-08f959275a2b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:03.259782 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed5732-8f27-42f2-94d5-08f959275a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:03.260533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed5732-8f27-42f2-94d5-08f959275a2b None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:03.262088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed5732-8f27-42f2-94d5-08f959275a2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:03.262910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed5732-8f27-42f2-94d5-08f959275a2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:03.266008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aed5732-8f27-42f2-94d5-08f959275a2b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:03.290520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 376/742] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:03.304196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed5732-8f27-42f2-94d5-08f959275a2b None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:03.356981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa52193-7485-4352-9d76-cb30999f1b0a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:03.444355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7c14c-08c9-47d9-9582-dc5fa06baf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:03.445281 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7c14c-08c9-47d9-9582-dc5fa06baf23 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:03.448130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7c14c-08c9-47d9-9582-dc5fa06baf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:03.448614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7c14c-08c9-47d9-9582-dc5fa06baf23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:03.471880 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7c14c-08c9-47d9-9582-dc5fa06baf23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:03.475224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7c14c-08c9-47d9-9582-dc5fa06baf23 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-49c7c14c-08c9-47d9-9582-dc5fa06baf23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:03.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:03.509963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:03.511782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:03.511782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:03.511782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:03.511782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 367/743] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:03.521597 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7c14c-08c9-47d9-9582-dc5fa06baf23 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:03.528731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed5732-8f27-42f2-94d5-08f959275a2b None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:03.530016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:03.595095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:03.619812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157822c-f373-4c97-980b-59f24e26c7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:03.620803 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157822c-f373-4c97-980b-59f24e26c7da None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:03.621281 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157822c-f373-4c97-980b-59f24e26c7da None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:03.621783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157822c-f373-4c97-980b-59f24e26c7da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:03.623078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157822c-f373-4c97-980b-59f24e26c7da None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=eb75c0fb10484f3d80813962a4283b02) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:03.623611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157822c-f373-4c97-980b-59f24e26c7da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:03.629407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157822c-f373-4c97-980b-59f24e26c7da None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:03.641630 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 377/744] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:19:03 2022] GET /identity/v3/role_assignments?user.id=eb75c0fb10484f3d80813962a4283b02&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:03.774528 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7c14c-08c9-47d9-9582-dc5fa06baf23 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:03.855522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932e99-fead-472d-ae06-d561d24c33b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:03.856547 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932e99-fead-472d-ae06-d561d24c33b7 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:03.857017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932e99-fead-472d-ae06-d561d24c33b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:03.857515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932e99-fead-472d-ae06-d561d24c33b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:03.858650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91932e99-fead-472d-ae06-d561d24c33b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:03.859159 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91932e99-fead-472d-ae06-d561d24c33b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:03.861659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91932e99-fead-472d-ae06-d561d24c33b7 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:03.886758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 368/745] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:03.896304 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157822c-f373-4c97-980b-59f24e26c7da None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:04.084695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bccf50-0125-4558-9954-f5101eada54c None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.085872 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bccf50-0125-4558-9954-f5101eada54c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.086611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bccf50-0125-4558-9954-f5101eada54c None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.089861 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 369/746] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:19:04.100077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b1b0a-1276-4ff7-879c-b335aebf71d8 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.101148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b1b0a-1276-4ff7-879c-b335aebf71d8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.101958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b1b0a-1276-4ff7-879c-b335aebf71d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.125085 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157822c-f373-4c97-980b-59f24e26c7da None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:04.163214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-427b1b0a-1276-4ff7-879c-b335aebf71d8 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:04.165340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-427b1b0a-1276-4ff7-879c-b335aebf71d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:04.229209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef143bb-a366-4f6b-884f-865a6867267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:04.230285 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef143bb-a366-4f6b-884f-865a6867267e None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.230766 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef143bb-a366-4f6b-884f-865a6867267e None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.231250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef143bb-a366-4f6b-884f-865a6867267e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.259445 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef143bb-a366-4f6b-884f-865a6867267e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:04.263010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef143bb-a366-4f6b-884f-865a6867267e None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-eef143bb-a366-4f6b-884f-865a6867267e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:04.296224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:04.298859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:04.300730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:04.300730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:04.300730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:04.300730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:04.300730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:04.300730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:04.300730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:04.300730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:04.300730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:19:04.300730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:04.314645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 378/747] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:19:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:04.328432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:04.335887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef143bb-a366-4f6b-884f-865a6867267e None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:04.346530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 370/748] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:04.448301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:04.575954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef143bb-a366-4f6b-884f-865a6867267e None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:04.669748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b0315-cf8d-4b0a-be3a-ca9aa26dbd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:04.671208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0315-cf8d-4b0a-be3a-ca9aa26dbd58 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.671969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0315-cf8d-4b0a-be3a-ca9aa26dbd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.672699 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b0315-cf8d-4b0a-be3a-ca9aa26dbd58 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.674285 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b0315-cf8d-4b0a-be3a-ca9aa26dbd58 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:04.675090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b0315-cf8d-4b0a-be3a-ca9aa26dbd58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:04.678027 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b0315-cf8d-4b0a-be3a-ca9aa26dbd58 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:04.708479 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 379/749] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Sep 1 05:19:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:04.717232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b1b0a-1276-4ff7-879c-b335aebf71d8 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:04.828049 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b0315-cf8d-4b0a-be3a-ca9aa26dbd58 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:04.946919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b1b0a-1276-4ff7-879c-b335aebf71d8 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:05.018265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7c624-8944-4a98-a57f-67ec46303ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:05.019346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7c624-8944-4a98-a57f-67ec46303ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:05.020424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7c624-8944-4a98-a57f-67ec46303ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:05.020919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7c624-8944-4a98-a57f-67ec46303ae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:05.115856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b0315-cf8d-4b0a-be3a-ca9aa26dbd58 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:05.121605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:05.227789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:05.235637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279a80b8-59cc-4f67-9a43-a150cdfc922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:05.236657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a80b8-59cc-4f67-9a43-a150cdfc922b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:05.237142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a80b8-59cc-4f67-9a43-a150cdfc922b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:05.237822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279a80b8-59cc-4f67-9a43-a150cdfc922b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:05.240607 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7c624-8944-4a98-a57f-67ec46303ae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:05.242822 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7c624-8944-4a98-a57f-67ec46303ae4 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:05.263235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279a80b8-59cc-4f67-9a43-a150cdfc922b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-279a80b8-59cc-4f67-9a43-a150cdfc922b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:19:05.272606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:05.273743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:05.274650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:05.274650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:05.274650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:05.274650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:05.274650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:19:05.274650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:19:05.274650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:19:05.274650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:19:05.274650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:19:05.274650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:19:05.274650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:19:05.274650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:05.275613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 380/750] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:19:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:05.279925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1e4b0-d0f0-423c-8d46-310da11d2bf0 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:05.279925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1e4b0-d0f0-423c-8d46-310da11d2bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:05.279925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1e4b0-d0f0-423c-8d46-310da11d2bf0 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:05.281184 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 381/751] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:05.282723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1e4b0-d0f0-423c-8d46-310da11d2bf0 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:05.489159 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 371/752] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:19:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 773 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:05.492040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b5dc5-7313-4123-80e1-69d1d371c682 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:05.492954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b5dc5-7313-4123-80e1-69d1d371c682 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:05.493934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b5dc5-7313-4123-80e1-69d1d371c682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:05.525151 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff1e4b0-d0f0-423c-8d46-310da11d2bf0 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:05.532033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-039b5dc5-7313-4123-80e1-69d1d371c682 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:05.534497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-039b5dc5-7313-4123-80e1-69d1d371c682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:05.613362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c28b4-e7ab-46f7-992e-f738ad56bad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:05.614466 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c28b4-e7ab-46f7-992e-f738ad56bad8 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:05.615135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c28b4-e7ab-46f7-992e-f738ad56bad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:05.615603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c28b4-e7ab-46f7-992e-f738ad56bad8 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:05.616711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c28b4-e7ab-46f7-992e-f738ad56bad8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:05.617124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c28b4-e7ab-46f7-992e-f738ad56bad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:05.620481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c28b4-e7ab-46f7-992e-f738ad56bad8 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:05.641991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 382/753] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:19:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:05.643671 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c28b4-e7ab-46f7-992e-f738ad56bad8 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:05.704423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 372/754] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:05.706137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b5dc5-7313-4123-80e1-69d1d371c682 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:05.709162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:05.798838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:05.949348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c28b4-e7ab-46f7-992e-f738ad56bad8 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:06.041244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4da5f-1bc4-4af4-bd60-0fbf8851d8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:06.043447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4da5f-1bc4-4af4-bd60-0fbf8851d8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:06.043929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4da5f-1bc4-4af4-bd60-0fbf8851d8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:06.044415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4da5f-1bc4-4af4-bd60-0fbf8851d8c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:06.094158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4da5f-1bc4-4af4-bd60-0fbf8851d8c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:06.096996 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f4da5f-1bc4-4af4-bd60-0fbf8851d8c5 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:06.133501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b5dc5-7313-4123-80e1-69d1d371c682 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-08f4da5f-1bc4-4af4-bd60-0fbf8851d8c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:06.140248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:06.142196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:06.143949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:06.143949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:06.143949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:06.143949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 383/755] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 500 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:06.153477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4da5f-1bc4-4af4-bd60-0fbf8851d8c5 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:06.238376 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c3f6-32e5-4421-b4a2-84fc552f7322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:06.239875 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c3f6-32e5-4421-b4a2-84fc552f7322 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:06.239875 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c3f6-32e5-4421-b4a2-84fc552f7322 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:06.240177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493c3f6-32e5-4421-b4a2-84fc552f7322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:06.254586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493c3f6-32e5-4421-b4a2-84fc552f7322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:06.257144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493c3f6-32e5-4421-b4a2-84fc552f7322 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-3493c3f6-32e5-4421-b4a2-84fc552f7322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:06.277805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:06.279652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:06.282584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:06.282584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:06.282584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:06.282584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 373/756] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 574 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:06.282584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c3f6-32e5-4421-b4a2-84fc552f7322 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:06.378690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:06.415601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f4da5f-1bc4-4af4-bd60-0fbf8851d8c5 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:06.440169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:06.473043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493c3f6-32e5-4421-b4a2-84fc552f7322 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:06.484478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734d9a-e02e-4775-b5d6-76d0652ab45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:06.485443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734d9a-e02e-4775-b5d6-76d0652ab45a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:06.485885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734d9a-e02e-4775-b5d6-76d0652ab45a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:06.486337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a734d9a-e02e-4775-b5d6-76d0652ab45a None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:06.487457 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734d9a-e02e-4775-b5d6-76d0652ab45a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:06.487988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734d9a-e02e-4775-b5d6-76d0652ab45a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:06.491010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a734d9a-e02e-4775-b5d6-76d0652ab45a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:06.511119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 384/757] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:06.519227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734d9a-e02e-4775-b5d6-76d0652ab45a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:06.528509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a6f2e-856b-445c-b745-525e0b90a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:06.530283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6f2e-856b-445c-b745-525e0b90a8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:06.531049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6f2e-856b-445c-b745-525e0b90a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:06.531939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6f2e-856b-445c-b745-525e0b90a8d3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:06.533043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a6f2e-856b-445c-b745-525e0b90a8d3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:06.536255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a6f2e-856b-445c-b745-525e0b90a8d3 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-8f3a6f2e-856b-445c-b745-525e0b90a8d3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:06.556014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:06.558061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:06.559804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 374/758] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Sep 1 05:19:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:06.562838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e55d56-af89-4aef-8f17-96a5def1e938 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:06.562838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e55d56-af89-4aef-8f17-96a5def1e938 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:06.562838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e55d56-af89-4aef-8f17-96a5def1e938 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:06.564452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 375/759] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:06.573024 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e55d56-af89-4aef-8f17-96a5def1e938 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:06.696101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a734d9a-e02e-4775-b5d6-76d0652ab45a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:06.725597 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e55d56-af89-4aef-8f17-96a5def1e938 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:06.748087 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db21af7-07f3-4cba-aba8-d7093fdfbdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:06.749145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db21af7-07f3-4cba-aba8-d7093fdfbdbc None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:06.749716 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db21af7-07f3-4cba-aba8-d7093fdfbdbc None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:06.750197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db21af7-07f3-4cba-aba8-d7093fdfbdbc None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:06.751605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db21af7-07f3-4cba-aba8-d7093fdfbdbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:06.752133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db21af7-07f3-4cba-aba8-d7093fdfbdbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:06.754902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db21af7-07f3-4cba-aba8-d7093fdfbdbc None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:06.767313 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a38ce0-6bc4-4b53-9a63-b082f587aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:06.767858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:06.768655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a38ce0-6bc4-4b53-9a63-b082f587aa19 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:06.768904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a38ce0-6bc4-4b53-9a63-b082f587aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:06.769178 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a38ce0-6bc4-4b53-9a63-b082f587aa19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:06.776346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 385/760] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:06.792005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db21af7-07f3-4cba-aba8-d7093fdfbdbc None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:06.792286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a38ce0-6bc4-4b53-9a63-b082f587aa19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:06.792286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a38ce0-6bc4-4b53-9a63-b082f587aa19 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:06.792286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-c4a38ce0-6bc4-4b53-9a63-b082f587aa19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:06.794892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:06.796780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:06.798443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:06.798443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:06.798443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:06.798443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:06.798443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:06.798443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:06.798443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:06.798443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:06.798443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 376/761] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:06.798443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc19d9a-7d31-45fe-8777-573efb50b89d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:06.798443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc19d9a-7d31-45fe-8777-573efb50b89d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:06.799551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc19d9a-7d31-45fe-8777-573efb50b89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:06.830625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-6bc19d9a-7d31-45fe-8777-573efb50b89d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:06.833643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6bc19d9a-7d31-45fe-8777-573efb50b89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:06.916246 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db21af7-07f3-4cba-aba8-d7093fdfbdbc None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:06.933107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 377/762] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:06.934770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0787c7f-2896-4715-aa7b-5533097d808a None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:06.935248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0787c7f-2896-4715-aa7b-5533097d808a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:06.935704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0787c7f-2896-4715-aa7b-5533097d808a None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:06.937351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 378/763] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:06.938169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0787c7f-2896-4715-aa7b-5533097d808a None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:06.984771 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc57be-617f-4276-8228-c6737a8d2cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:06.985963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc57be-617f-4276-8228-c6737a8d2cae None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:06.986477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc57be-617f-4276-8228-c6737a8d2cae None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:06.986917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc57be-617f-4276-8228-c6737a8d2cae None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:06.988111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc57be-617f-4276-8228-c6737a8d2cae None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:06.989103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc57be-617f-4276-8228-c6737a8d2cae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:06.991553 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc57be-617f-4276-8228-c6737a8d2cae None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:07.007435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 386/764] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Sep 1 05:19:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:07.007435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc57be-617f-4276-8228-c6737a8d2cae None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:07.115575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:07.122425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0787c7f-2896-4715-aa7b-5533097d808a None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:07.160826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:07.177165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7a595-ca3d-497a-b09e-c0b7c3a7aaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:07.177854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7a595-ca3d-497a-b09e-c0b7c3a7aaf7 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:07.178141 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7a595-ca3d-497a-b09e-c0b7c3a7aaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:07.178378 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7a595-ca3d-497a-b09e-c0b7c3a7aaf7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:07.188603 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7a595-ca3d-497a-b09e-c0b7c3a7aaf7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:07.190602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7a595-ca3d-497a-b09e-c0b7c3a7aaf7 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-23e7a595-ca3d-497a-b09e-c0b7c3a7aaf7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:07.207018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:07.209889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:07.212457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:07.212457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:07.212457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:07.212457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:07.212457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:07.212457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:07.212457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:07.212457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:07.212457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:19:07.212457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:07.215120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 379/765] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Sep 1 05:19:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:07.216765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99409f3-3242-4e7a-acc8-b6c9356fb52e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:07.221968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99409f3-3242-4e7a-acc8-b6c9356fb52e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:07.221968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99409f3-3242-4e7a-acc8-b6c9356fb52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:07.223863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc57be-617f-4276-8228-c6737a8d2cae None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:07.248540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a99409f3-3242-4e7a-acc8-b6c9356fb52e None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:07.249887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a99409f3-3242-4e7a-acc8-b6c9356fb52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:07.275519 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4d4c4-a043-49fb-9a32-54da97bb9944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:07.276461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4d4c4-a043-49fb-9a32-54da97bb9944 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:07.276908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4d4c4-a043-49fb-9a32-54da97bb9944 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:07.277361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4d4c4-a043-49fb-9a32-54da97bb9944 None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:07.278601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4d4c4-a043-49fb-9a32-54da97bb9944 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:07.279096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4d4c4-a043-49fb-9a32-54da97bb9944 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:07.281145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4d4c4-a043-49fb-9a32-54da97bb9944 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:07.296952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 387/766] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:07.298119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4d4c4-a043-49fb-9a32-54da97bb9944 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:07.346683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 380/767] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:07.348515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99409f3-3242-4e7a-acc8-b6c9356fb52e None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:07.435899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4d4c4-a043-49fb-9a32-54da97bb9944 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:07.467978 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:07.484236 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0e631-5ccf-4da6-8c5e-b0598f11c373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:07.484861 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0e631-5ccf-4da6-8c5e-b0598f11c373 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:07.485140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0e631-5ccf-4da6-8c5e-b0598f11c373 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:07.485451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0e631-5ccf-4da6-8c5e-b0598f11c373 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:07.486092 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0e631-5ccf-4da6-8c5e-b0598f11c373 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:07.486516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0e631-5ccf-4da6-8c5e-b0598f11c373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:07.487900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db0e631-5ccf-4da6-8c5e-b0598f11c373 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:07.496896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 388/768] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Sep 1 05:19:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:07.499328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0e631-5ccf-4da6-8c5e-b0598f11c373 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:07.541515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99409f3-3242-4e7a-acc8-b6c9356fb52e None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:07.571251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:07.604091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea9fb2-8472-4e01-a38f-65619db7350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:07.605589 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea9fb2-8472-4e01-a38f-65619db7350d None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:07.606235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea9fb2-8472-4e01-a38f-65619db7350d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:07.606892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea9fb2-8472-4e01-a38f-65619db7350d None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:07.607882 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea9fb2-8472-4e01-a38f-65619db7350d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:07.608398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea9fb2-8472-4e01-a38f-65619db7350d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:07.610315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea9fb2-8472-4e01-a38f-65619db7350d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:07.639489 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 381/769] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Sep 1 05:19:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:07.640390 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea9fb2-8472-4e01-a38f-65619db7350d None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:07.704494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0e631-5ccf-4da6-8c5e-b0598f11c373 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:07.752269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a24500-0d61-4274-9142-1823b756ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:07.752854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a24500-0d61-4274-9142-1823b756ee6f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:07.753146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a24500-0d61-4274-9142-1823b756ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:07.753448 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a24500-0d61-4274-9142-1823b756ee6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:07.768567 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a24500-0d61-4274-9142-1823b756ee6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-d0a24500-0d61-4274-9142-1823b756ee6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:19:07.774159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:07.776127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 389/770] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:19:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:07.778306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a24500-0d61-4274-9142-1823b756ee6f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:07.842596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea9fb2-8472-4e01-a38f-65619db7350d None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:07.846000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:07.894389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4607a6b-de56-42a0-b18b-eb473120a074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:07.895468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4607a6b-de56-42a0-b18b-eb473120a074 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:07.896028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4607a6b-de56-42a0-b18b-eb473120a074 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:07.896460 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4607a6b-de56-42a0-b18b-eb473120a074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:07.897740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4607a6b-de56-42a0-b18b-eb473120a074 None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=8a0d07b79212443480c87f4a4ff3ca00) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:07.898100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4607a6b-de56-42a0-b18b-eb473120a074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:07.899630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4607a6b-de56-42a0-b18b-eb473120a074 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:07.906687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 382/771] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:19:07 2022] GET /identity/v3/role_assignments?user.id=8a0d07b79212443480c87f4a4ff3ca00&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:07.907767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4607a6b-de56-42a0-b18b-eb473120a074 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:07.955804 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a24500-0d61-4274-9142-1823b756ee6f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:07.997913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:08.023972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb038c4e-70d8-4ffb-ae1a-2f4ec14ef700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:08.024790 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb038c4e-70d8-4ffb-ae1a-2f4ec14ef700 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:08.025225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb038c4e-70d8-4ffb-ae1a-2f4ec14ef700 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:08.025679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb038c4e-70d8-4ffb-ae1a-2f4ec14ef700 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:08.027004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb038c4e-70d8-4ffb-ae1a-2f4ec14ef700 None admin] RBAC: Adding query filter params (interface=public, service_id=b341c54cb473421291b4f77a224d2005, region_id=RegionOne) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:08.027466 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb038c4e-70d8-4ffb-ae1a-2f4ec14ef700 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:08.029832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb038c4e-70d8-4ffb-ae1a-2f4ec14ef700 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:08.045425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 390/772] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Sep 1 05:19:07 2022] GET /identity/v3/endpoints?service_id=b341c54cb473421291b4f77a224d2005&interface=public®ion_id=RegionOne => generated 194 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:08.046738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb038c4e-70d8-4ffb-ae1a-2f4ec14ef700 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:08.115390 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4607a6b-de56-42a0-b18b-eb473120a074 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:08.190187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfed8f-d408-4fd6-b504-ce70b6006de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:08.191229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfed8f-d408-4fd6-b504-ce70b6006de5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:08.193334 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfed8f-d408-4fd6-b504-ce70b6006de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:08.193334 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfed8f-d408-4fd6-b504-ce70b6006de5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:08.216527 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb038c4e-70d8-4ffb-ae1a-2f4ec14ef700 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:08.217069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfed8f-d408-4fd6-b504-ce70b6006de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:08.219871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfed8f-d408-4fd6-b504-ce70b6006de5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:08.235247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-c1bfed8f-d408-4fd6-b504-ce70b6006de5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:08.251355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:08.259902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:08.262089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:08.262089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:08.262089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:08.262089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 383/773] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:08.262089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfed8f-d408-4fd6-b504-ce70b6006de5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:08.290348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c257f64-32c1-4df1-82d1-fa104264451d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:08.290976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c257f64-32c1-4df1-82d1-fa104264451d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:08.291320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c257f64-32c1-4df1-82d1-fa104264451d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:08.291682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c257f64-32c1-4df1-82d1-fa104264451d None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:08.292432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c257f64-32c1-4df1-82d1-fa104264451d None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:08.292805 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c257f64-32c1-4df1-82d1-fa104264451d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:08.294345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c257f64-32c1-4df1-82d1-fa104264451d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:08.307046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 391/774] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:19:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:08.308724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c257f64-32c1-4df1-82d1-fa104264451d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:08.459630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:08.471886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfed8f-d408-4fd6-b504-ce70b6006de5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:08.481623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c257f64-32c1-4df1-82d1-fa104264451d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:08.531243 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c42ad-7dee-4e9c-9280-e09c51333d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:08.532424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c42ad-7dee-4e9c-9280-e09c51333d8f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:08.532960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c42ad-7dee-4e9c-9280-e09c51333d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:08.533515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c42ad-7dee-4e9c-9280-e09c51333d8f None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:08.534368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c42ad-7dee-4e9c-9280-e09c51333d8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:08.537190 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c42ad-7dee-4e9c-9280-e09c51333d8f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:08.545062 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 392/775] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Sep 1 05:19:08 2022] GET /identity/v3/services => generated 772 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:08.546558 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c42ad-7dee-4e9c-9280-e09c51333d8f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:08.551744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e275a6-8aad-4501-a6ce-62d2ad57c610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:08.553320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e275a6-8aad-4501-a6ce-62d2ad57c610 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:08.554195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e275a6-8aad-4501-a6ce-62d2ad57c610 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:08.554961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e275a6-8aad-4501-a6ce-62d2ad57c610 None admin] PATH_INFO: `/v3/services/network` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:08.556393 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e275a6-8aad-4501-a6ce-62d2ad57c610 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:08.559482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e275a6-8aad-4501-a6ce-62d2ad57c610 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-f0e275a6-8aad-4501-a6ce-62d2ad57c610 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:08.578746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:08.580651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:08.582357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 384/776] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:08 2022] GET /identity/v3/services/network => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:08.583787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e275a6-8aad-4501-a6ce-62d2ad57c610 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:08.671332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:08.777335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c42ad-7dee-4e9c-9280-e09c51333d8f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:08.844686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c087d7d-5708-4fa7-a8f5-9f2e3942112d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:08.845314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c087d7d-5708-4fa7-a8f5-9f2e3942112d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:08.845649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c087d7d-5708-4fa7-a8f5-9f2e3942112d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:08.845930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c087d7d-5708-4fa7-a8f5-9f2e3942112d None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:08.846612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c087d7d-5708-4fa7-a8f5-9f2e3942112d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:08.846912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c087d7d-5708-4fa7-a8f5-9f2e3942112d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:08.848440 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c087d7d-5708-4fa7-a8f5-9f2e3942112d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:08.867047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 393/777] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:08.869600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c087d7d-5708-4fa7-a8f5-9f2e3942112d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:08.975438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e275a6-8aad-4501-a6ce-62d2ad57c610 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:09.045862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6464e4-d6a5-4dba-894f-4397a98f099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:09.047343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6464e4-d6a5-4dba-894f-4397a98f099f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:09.048048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6464e4-d6a5-4dba-894f-4397a98f099f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:09.048882 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6464e4-d6a5-4dba-894f-4397a98f099f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:09.057340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:09.069769 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c087d7d-5708-4fa7-a8f5-9f2e3942112d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:09.073286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6464e4-d6a5-4dba-894f-4397a98f099f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:09.076282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6464e4-d6a5-4dba-894f-4397a98f099f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-1f6464e4-d6a5-4dba-894f-4397a98f099f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:09.105813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:09.107808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:09.109616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:09.109616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:09.109616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:09.113182 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 385/778] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 531 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:09.115366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6464e4-d6a5-4dba-894f-4397a98f099f None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:09.139330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78a8a3-1bd4-40f4-a5fb-2e93d48850a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:09.140920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a8a3-1bd4-40f4-a5fb-2e93d48850a0 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:09.140920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a8a3-1bd4-40f4-a5fb-2e93d48850a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:09.141333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78a8a3-1bd4-40f4-a5fb-2e93d48850a0 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:09.142427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78a8a3-1bd4-40f4-a5fb-2e93d48850a0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:09.142938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78a8a3-1bd4-40f4-a5fb-2e93d48850a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:09.145214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:09.145578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78a8a3-1bd4-40f4-a5fb-2e93d48850a0 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:09.154218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 394/779] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:19:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:09.155897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78a8a3-1bd4-40f4-a5fb-2e93d48850a0 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:09.307163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78a8a3-1bd4-40f4-a5fb-2e93d48850a0 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:09.343067 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6464e4-d6a5-4dba-894f-4397a98f099f None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:09.364396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdec679-39ad-4b8b-a4e9-9717effb8854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:09.364902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdec679-39ad-4b8b-a4e9-9717effb8854 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:09.365186 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdec679-39ad-4b8b-a4e9-9717effb8854 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:09.365496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdec679-39ad-4b8b-a4e9-9717effb8854 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:09.366171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdec679-39ad-4b8b-a4e9-9717effb8854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:09.366484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdec679-39ad-4b8b-a4e9-9717effb8854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:09.367991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdec679-39ad-4b8b-a4e9-9717effb8854 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:09.382545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 395/780] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:09.383272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdec679-39ad-4b8b-a4e9-9717effb8854 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:09.410778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:09.427538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de98af1-e9d8-4a18-a534-474c474111db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:09.429213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de98af1-e9d8-4a18-a534-474c474111db None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:09.430002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de98af1-e9d8-4a18-a534-474c474111db None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:09.430758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de98af1-e9d8-4a18-a534-474c474111db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:09.446188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de98af1-e9d8-4a18-a534-474c474111db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:09.449587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de98af1-e9d8-4a18-a534-474c474111db None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-6de98af1-e9d8-4a18-a534-474c474111db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:09.478361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:09.480180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:09.481959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:09.481959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:09.481959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:09.481959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:09.481959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:09.481959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:09.481959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:09.481959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:09.487009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 386/781] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:09.490827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de98af1-e9d8-4a18-a534-474c474111db None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:09.511980 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdec679-39ad-4b8b-a4e9-9717effb8854 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:09.555988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a0cd3-6e95-49b2-bcfb-cf749dd8646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:09.556638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a0cd3-6e95-49b2-bcfb-cf749dd8646c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:09.556924 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a0cd3-6e95-49b2-bcfb-cf749dd8646c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:09.557202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a0cd3-6e95-49b2-bcfb-cf749dd8646c None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:09.557895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a0cd3-6e95-49b2-bcfb-cf749dd8646c None admin] RBAC: Adding query filter params (type=network) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:09.558200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a0cd3-6e95-49b2-bcfb-cf749dd8646c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:09.560005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a0cd3-6e95-49b2-bcfb-cf749dd8646c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:09.566090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 396/782] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:19:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:09.567621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a0cd3-6e95-49b2-bcfb-cf749dd8646c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:09.666439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:09.731710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de98af1-e9d8-4a18-a534-474c474111db None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:09.733815 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:09.766490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a0cd3-6e95-49b2-bcfb-cf749dd8646c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:09.784153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c374ed4-e5f9-48f5-9b00-a926ead4d223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:09.785419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c374ed4-e5f9-48f5-9b00-a926ead4d223 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:09.785995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c374ed4-e5f9-48f5-9b00-a926ead4d223 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:09.786597 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c374ed4-e5f9-48f5-9b00-a926ead4d223 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:09.806650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c374ed4-e5f9-48f5-9b00-a926ead4d223 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:09.809213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c374ed4-e5f9-48f5-9b00-a926ead4d223 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-3c374ed4-e5f9-48f5-9b00-a926ead4d223 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:09.831019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:09.832286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:09.833435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:09.833435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:09.833435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:09.833435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:09.833435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:09.833435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:09.833435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:09.833435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:09.833435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:19:09.833435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:09.836482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 387/783] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Sep 1 05:19:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:09.838057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c374ed4-e5f9-48f5-9b00-a926ead4d223 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:09.852943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef95c0-7942-4945-a003-ec21d4c2589d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:09.854068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef95c0-7942-4945-a003-ec21d4c2589d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:09.854607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef95c0-7942-4945-a003-ec21d4c2589d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:09.855168 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef95c0-7942-4945-a003-ec21d4c2589d None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:09.856683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef95c0-7942-4945-a003-ec21d4c2589d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:09.857309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef95c0-7942-4945-a003-ec21d4c2589d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:09.861131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef95c0-7942-4945-a003-ec21d4c2589d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:09.894187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 397/784] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:09.895593 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef95c0-7942-4945-a003-ec21d4c2589d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:10.086227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef95c0-7942-4945-a003-ec21d4c2589d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:10.107533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c374ed4-e5f9-48f5-9b00-a926ead4d223 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:10.163075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:10.167142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5748d08-48c1-4938-b4ae-faee9b4776ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:10.168150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5748d08-48c1-4938-b4ae-faee9b4776ee None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:10.168628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5748d08-48c1-4938-b4ae-faee9b4776ee None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:10.169091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5748d08-48c1-4938-b4ae-faee9b4776ee None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:10.170442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5748d08-48c1-4938-b4ae-faee9b4776ee None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:10.170959 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5748d08-48c1-4938-b4ae-faee9b4776ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:10.173957 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5748d08-48c1-4938-b4ae-faee9b4776ee None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:10.178184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa8947-1a08-46e6-90f8-ae23a48adcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:10.180528 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa8947-1a08-46e6-90f8-ae23a48adcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:10.181681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa8947-1a08-46e6-90f8-ae23a48adcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:10.182434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa8947-1a08-46e6-90f8-ae23a48adcb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:10.184132 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa8947-1a08-46e6-90f8-ae23a48adcb2 None admin] RBAC: Adding query filter params (interface=public, service_id=8fea27516a79450cb1a13e325c61d610, region_id=RegionOne) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:10.184943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa8947-1a08-46e6-90f8-ae23a48adcb2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:10.188301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa8947-1a08-46e6-90f8-ae23a48adcb2 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:10.207549 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 388/785] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Sep 1 05:19:09 2022] GET /identity/v3/endpoints?service_id=8fea27516a79450cb1a13e325c61d610&interface=public®ion_id=RegionOne => generated 194 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:10.209520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa8947-1a08-46e6-90f8-ae23a48adcb2 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:10.217562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 398/786] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Sep 1 05:19:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:10.217562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5748d08-48c1-4938-b4ae-faee9b4776ee None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:10.223465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:10.406733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa8947-1a08-46e6-90f8-ae23a48adcb2 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:10.469106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bdf02-a825-4fe2-810a-8f806f983654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:10.470235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bdf02-a825-4fe2-810a-8f806f983654 None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:10.470710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bdf02-a825-4fe2-810a-8f806f983654 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:10.471182 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bdf02-a825-4fe2-810a-8f806f983654 None admin] PATH_INFO: `/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/b7e84a5652df4d64aa1fd28f3d5383fe/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:10.472616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5748d08-48c1-4938-b4ae-faee9b4776ee None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:10.474586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bdf02-a825-4fe2-810a-8f806f983654 None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c3fe9229c45f1bfd295115ef94cd7, user_id=b7e84a5652df4d64aa1fd28f3d5383fe, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:10.477231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bdf02-a825-4fe2-810a-8f806f983654 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:10.547694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cb6ad-9cd2-4f31-b64c-17560ad71014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:10.548757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cb6ad-9cd2-4f31-b64c-17560ad71014 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:10.549256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cb6ad-9cd2-4f31-b64c-17560ad71014 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:10.549805 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cb6ad-9cd2-4f31-b64c-17560ad71014 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:10.551270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cb6ad-9cd2-4f31-b64c-17560ad71014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:10.554068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cb6ad-9cd2-4f31-b64c-17560ad71014 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:10.573423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 399/787] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Sep 1 05:19:10 2022] GET /identity/v3/services => generated 772 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:10.573423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cb6ad-9cd2-4f31-b64c-17560ad71014 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:10.654871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 389/788] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:19:10 2022] PUT /identity/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/b7e84a5652df4d64aa1fd28f3d5383fe/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:19:10.747500 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:10.848478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cb6ad-9cd2-4f31-b64c-17560ad71014 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:10.918759 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606841b7-a43e-4a99-be28-ae98de0edee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:10.919862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606841b7-a43e-4a99-be28-ae98de0edee4 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:10.920340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606841b7-a43e-4a99-be28-ae98de0edee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:10.920740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606841b7-a43e-4a99-be28-ae98de0edee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:10.938694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606841b7-a43e-4a99-be28-ae98de0edee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:10.940654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606841b7-a43e-4a99-be28-ae98de0edee4 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-606841b7-a43e-4a99-be28-ae98de0edee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:10.961670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:10.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:10.963726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:10.963726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:10.963726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:10.966219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 400/789] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:10.973648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bdf02-a825-4fe2-810a-8f806f983654 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:11.060640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:11.159671 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904c63f-f15d-4dc2-98f7-8eda4b128a20 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:11.160189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904c63f-f15d-4dc2-98f7-8eda4b128a20 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:11.160544 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904c63f-f15d-4dc2-98f7-8eda4b128a20 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:11.162347 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 401/790] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:11.167690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09ee18-359e-44ad-bc80-570c0ce1b3c2 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:11.168000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09ee18-359e-44ad-bc80-570c0ce1b3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:11.168498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09ee18-359e-44ad-bc80-570c0ce1b3c2 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:11.170422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 402/791] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:11.180568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be1f94-2a43-4f46-8ccb-8855d6b731bc None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:11.180983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be1f94-2a43-4f46-8ccb-8855d6b731bc None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:11.181164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be1f94-2a43-4f46-8ccb-8855d6b731bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:11.182420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bdf02-a825-4fe2-810a-8f806f983654 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:11.215083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-02be1f94-2a43-4f46-8ccb-8855d6b731bc None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:11.218906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-02be1f94-2a43-4f46-8ccb-8855d6b731bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:11.248353 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587fe48-b847-4f2a-b2bb-ba628034c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:11.249568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587fe48-b847-4f2a-b2bb-ba628034c194 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:11.249568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587fe48-b847-4f2a-b2bb-ba628034c194 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:11.249826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587fe48-b847-4f2a-b2bb-ba628034c194 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:11.250299 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587fe48-b847-4f2a-b2bb-ba628034c194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:11.250604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587fe48-b847-4f2a-b2bb-ba628034c194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:11.252055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587fe48-b847-4f2a-b2bb-ba628034c194 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:11.266314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 390/792] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:11.267500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e39a9-8810-40e0-8e31-c5f7624cbd51 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:11.267787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e39a9-8810-40e0-8e31-c5f7624cbd51 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:11.268061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e39a9-8810-40e0-8e31-c5f7624cbd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:11.289169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-f34e39a9-8810-40e0-8e31-c5f7624cbd51 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:11.290863 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f34e39a9-8810-40e0-8e31-c5f7624cbd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:11.372879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 391/793] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:11.373910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e39a9-8810-40e0-8e31-c5f7624cbd51 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:11.396014 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 403/794] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:11.457285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:11.542537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e39a9-8810-40e0-8e31-c5f7624cbd51 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:11.584094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eed72f-95ed-4b95-9c93-bd94905ac949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:11.584760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eed72f-95ed-4b95-9c93-bd94905ac949 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:11.585290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eed72f-95ed-4b95-9c93-bd94905ac949 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:11.585700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eed72f-95ed-4b95-9c93-bd94905ac949 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:11.593890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eed72f-95ed-4b95-9c93-bd94905ac949 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:11.595384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eed72f-95ed-4b95-9c93-bd94905ac949 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-91eed72f-95ed-4b95-9c93-bd94905ac949 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:11.609104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:11.610115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:11.611006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:11.611006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:11.611006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:11.611006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:11.611006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:11.611006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:11.611006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:11.611006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:11.611006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 392/795] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:11.623239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be1f94-2a43-4f46-8ccb-8855d6b731bc None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:11.749000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:11.804783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eed72f-95ed-4b95-9c93-bd94905ac949 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:11.881770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be1f94-2a43-4f46-8ccb-8855d6b731bc None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:12.026366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22047e-2f39-4265-a9a0-65156619a95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:12.028074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22047e-2f39-4265-a9a0-65156619a95c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:12.028569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22047e-2f39-4265-a9a0-65156619a95c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:12.029068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22047e-2f39-4265-a9a0-65156619a95c None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:12.030686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22047e-2f39-4265-a9a0-65156619a95c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:12.031135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22047e-2f39-4265-a9a0-65156619a95c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:12.035517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22047e-2f39-4265-a9a0-65156619a95c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:12.066717 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 404/796] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:12.068993 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22047e-2f39-4265-a9a0-65156619a95c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:12.097067 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eed72f-95ed-4b95-9c93-bd94905ac949 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:12.103472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:12.150705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aad08-38c7-480e-9b9f-1ae7e1df9737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:12.151451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aad08-38c7-480e-9b9f-1ae7e1df9737 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:12.151850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aad08-38c7-480e-9b9f-1ae7e1df9737 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:12.152230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4aad08-38c7-480e-9b9f-1ae7e1df9737 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:12.153340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4aad08-38c7-480e-9b9f-1ae7e1df9737 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:12.155061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4aad08-38c7-480e-9b9f-1ae7e1df9737 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-3d4aad08-38c7-480e-9b9f-1ae7e1df9737 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:12.169613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:12.172204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:12.173835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 393/797] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Sep 1 05:19:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:12.176434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aad08-38c7-480e-9b9f-1ae7e1df9737 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:12.308780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22047e-2f39-4265-a9a0-65156619a95c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:12.321425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:12.352609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c537b-39ff-40bc-836d-d0cfda876313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:12.353270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c537b-39ff-40bc-836d-d0cfda876313 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:12.353605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c537b-39ff-40bc-836d-d0cfda876313 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:12.353872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c537b-39ff-40bc-836d-d0cfda876313 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:12.359988 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4aad08-38c7-480e-9b9f-1ae7e1df9737 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:12.367121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c537b-39ff-40bc-836d-d0cfda876313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:19:12.438902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17821776-5548-48e1-b1b0-edf4323f6284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:12.440757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17821776-5548-48e1-b1b0-edf4323f6284 None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:12.441884 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17821776-5548-48e1-b1b0-edf4323f6284 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:12.442735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17821776-5548-48e1-b1b0-edf4323f6284 None admin] PATH_INFO: `/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/eb75c0fb10484f3d80813962a4283b02/roles/64f98692a39a4f16bab66cd26ad8f65e` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:12.477399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17821776-5548-48e1-b1b0-edf4323f6284 None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c3fe9229c45f1bfd295115ef94cd7, user_id=eb75c0fb10484f3d80813962a4283b02, role_id=64f98692a39a4f16bab66cd26ad8f65e)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:12.481683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17821776-5548-48e1-b1b0-edf4323f6284 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-6a7c537b-39ff-40bc-836d-d0cfda876313 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:19:12.496874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:12.507460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 405/798] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:19:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:12.509118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c537b-39ff-40bc-836d-d0cfda876313 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:12.632692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 394/799] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:19:12 2022] PUT /identity/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/eb75c0fb10484f3d80813962a4283b02/roles/64f98692a39a4f16bab66cd26ad8f65e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:19:12.635501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17821776-5548-48e1-b1b0-edf4323f6284 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:12.640132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c537b-39ff-40bc-836d-d0cfda876313 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:12.720276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:12.772414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13975894-4305-4fcf-b30b-1f1df1ee292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:12.773191 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13975894-4305-4fcf-b30b-1f1df1ee292b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:12.773772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13975894-4305-4fcf-b30b-1f1df1ee292b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:12.774254 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13975894-4305-4fcf-b30b-1f1df1ee292b None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:12.775432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13975894-4305-4fcf-b30b-1f1df1ee292b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:12.775969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13975894-4305-4fcf-b30b-1f1df1ee292b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:12.785422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13975894-4305-4fcf-b30b-1f1df1ee292b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:12.788781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 406/800] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Sep 1 05:19:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:12.799561 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13975894-4305-4fcf-b30b-1f1df1ee292b None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:12.869331 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17821776-5548-48e1-b1b0-edf4323f6284 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:12.886794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:12.927557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16669ba1-59db-45dc-b4ca-ece191ee753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:12.928630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16669ba1-59db-45dc-b4ca-ece191ee753e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:12.929174 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16669ba1-59db-45dc-b4ca-ece191ee753e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:12.929752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16669ba1-59db-45dc-b4ca-ece191ee753e None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:12.930744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16669ba1-59db-45dc-b4ca-ece191ee753e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:12.931264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16669ba1-59db-45dc-b4ca-ece191ee753e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:12.932923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16669ba1-59db-45dc-b4ca-ece191ee753e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:12.952874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 395/801] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:19:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:12.954611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16669ba1-59db-45dc-b4ca-ece191ee753e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:12.982582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13975894-4305-4fcf-b30b-1f1df1ee292b None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:13.027487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d8300-927c-4bb3-8a6b-3a3ca5239976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:13.028165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d8300-927c-4bb3-8a6b-3a3ca5239976 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:13.028450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d8300-927c-4bb3-8a6b-3a3ca5239976 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:13.028806 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d8300-927c-4bb3-8a6b-3a3ca5239976 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:13.029600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d8300-927c-4bb3-8a6b-3a3ca5239976 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:13.029968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d8300-927c-4bb3-8a6b-3a3ca5239976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:13.031955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d8300-927c-4bb3-8a6b-3a3ca5239976 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:13.038646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 407/802] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Sep 1 05:19:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:13.047322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d8300-927c-4bb3-8a6b-3a3ca5239976 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:13.064545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:13.107107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16669ba1-59db-45dc-b4ca-ece191ee753e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:13.194900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb149c8-0ccf-4a91-add2-ded488e99b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:13.195570 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb149c8-0ccf-4a91-add2-ded488e99b49 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:13.195878 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb149c8-0ccf-4a91-add2-ded488e99b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:13.196118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb149c8-0ccf-4a91-add2-ded488e99b49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:13.225294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb149c8-0ccf-4a91-add2-ded488e99b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:13.227755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb149c8-0ccf-4a91-add2-ded488e99b49 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:13.234154 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:13.246821 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d8300-927c-4bb3-8a6b-3a3ca5239976 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-bdb149c8-0ccf-4a91-add2-ded488e99b49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:13.268266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:13.270198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:13.272631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:13.272631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:13.272631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:13.274629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 396/803] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:13.278621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb149c8-0ccf-4a91-add2-ded488e99b49 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:13.321238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274fbb2-f47c-44db-b114-b5b9d5f80fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:13.322295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274fbb2-f47c-44db-b114-b5b9d5f80fa9 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:13.322911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274fbb2-f47c-44db-b114-b5b9d5f80fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:13.323395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274fbb2-f47c-44db-b114-b5b9d5f80fa9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:13.324621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274fbb2-f47c-44db-b114-b5b9d5f80fa9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:13.327995 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274fbb2-f47c-44db-b114-b5b9d5f80fa9 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:13.438233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb149c8-0ccf-4a91-add2-ded488e99b49 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:13.475943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:13.485175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 408/804] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:19:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:13.492580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e93f-20cb-47c6-bc97-d302de4878f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:13.493450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e93f-20cb-47c6-bc97-d302de4878f7 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:13.493587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e93f-20cb-47c6-bc97-d302de4878f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:13.493909 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e93f-20cb-47c6-bc97-d302de4878f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:13.494510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e93f-20cb-47c6-bc97-d302de4878f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:13.494814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e93f-20cb-47c6-bc97-d302de4878f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:13.496337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e93f-20cb-47c6-bc97-d302de4878f7 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:13.512097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 397/805] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:13.518729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274fbb2-f47c-44db-b114-b5b9d5f80fa9 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:13.676070 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ac1a-56d8-4ec5-a665-5ed41e461f7e None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:13.676780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ac1a-56d8-4ec5-a665-5ed41e461f7e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:13.677284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0ac1a-56d8-4ec5-a665-5ed41e461f7e None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:13.679985 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 398/806] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:19:13.686260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebabeb-645e-4917-ab40-5ccf14bd88dc None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:13.687092 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebabeb-645e-4917-ab40-5ccf14bd88dc None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:13.687814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebabeb-645e-4917-ab40-5ccf14bd88dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:13.736288 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b5ebabeb-645e-4917-ab40-5ccf14bd88dc None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:13.737527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b5ebabeb-645e-4917-ab40-5ccf14bd88dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:13.829597 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 399/807] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:13.840018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274fbb2-f47c-44db-b114-b5b9d5f80fa9 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:13.911862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0e8f7-ca16-4ad2-a125-7e1e77cfe441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:13.913014 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0e8f7-ca16-4ad2-a125-7e1e77cfe441 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:13.913565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0e8f7-ca16-4ad2-a125-7e1e77cfe441 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:13.914062 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0e8f7-ca16-4ad2-a125-7e1e77cfe441 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:13.930947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0e8f7-ca16-4ad2-a125-7e1e77cfe441 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:13.941530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0e8f7-ca16-4ad2-a125-7e1e77cfe441 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-4cb0e8f7-ca16-4ad2-a125-7e1e77cfe441 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:13.961710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:13.963162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:13.964334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:13.964334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:13.964334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:13.964334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:13.964334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:13.964334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:13.964334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:13.964334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:13.964334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:19:13.964334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:13.966440 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 409/808] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:19:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:13.974014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebabeb-645e-4917-ab40-5ccf14bd88dc None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:14.014387 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1681541-1e99-4670-ad4c-d78f1b6ade02 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:14.014578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1681541-1e99-4670-ad4c-d78f1b6ade02 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:14.014877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1681541-1e99-4670-ad4c-d78f1b6ade02 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:14.016513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 410/809] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:19:14.023777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c363d3-c468-45d3-8853-9b73416bb727 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:14.024182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c363d3-c468-45d3-8853-9b73416bb727 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:14.024453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c363d3-c468-45d3-8853-9b73416bb727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:14.056323 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-e1c363d3-c468-45d3-8853-9b73416bb727 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:14.058577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e1c363d3-c468-45d3-8853-9b73416bb727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:14.076405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:14.137698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebabeb-645e-4917-ab40-5ccf14bd88dc None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:14.172724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:14.195311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 411/810] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:14.203043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c02df9-4b61-49d0-ae82-932a55b6083d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:14.203734 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c02df9-4b61-49d0-ae82-932a55b6083d None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:14.204024 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c02df9-4b61-49d0-ae82-932a55b6083d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:14.204297 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c02df9-4b61-49d0-ae82-932a55b6083d None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:14.205039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c02df9-4b61-49d0-ae82-932a55b6083d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:14.205344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c02df9-4b61-49d0-ae82-932a55b6083d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:14.207514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c02df9-4b61-49d0-ae82-932a55b6083d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:14.236839 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 400/811] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Sep 1 05:19:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:14.244013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c363d3-c468-45d3-8853-9b73416bb727 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:14.374883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c02df9-4b61-49d0-ae82-932a55b6083d None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:14.504406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c363d3-c468-45d3-8853-9b73416bb727 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:14.556733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c02df9-4b61-49d0-ae82-932a55b6083d None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:14.579297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95a894-d215-4ae8-b0af-74009f6d571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:14.579967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95a894-d215-4ae8-b0af-74009f6d571e None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:14.580247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95a894-d215-4ae8-b0af-74009f6d571e None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:14.580515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95a894-d215-4ae8-b0af-74009f6d571e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:14.604332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95a894-d215-4ae8-b0af-74009f6d571e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:14.605886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95a894-d215-4ae8-b0af-74009f6d571e None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:14.611329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-5b95a894-d215-4ae8-b0af-74009f6d571e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:14.626299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:14.627947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:14.631714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:14.631714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:14.631714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:14.634988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 412/812] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:14.634988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95a894-d215-4ae8-b0af-74009f6d571e None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:14.638314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39102b-bb8a-40c8-aa47-60ae200c27d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:14.639769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39102b-bb8a-40c8-aa47-60ae200c27d9 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:14.639890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39102b-bb8a-40c8-aa47-60ae200c27d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:14.640229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39102b-bb8a-40c8-aa47-60ae200c27d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:14.674089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39102b-bb8a-40c8-aa47-60ae200c27d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-ef39102b-bb8a-40c8-aa47-60ae200c27d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:19:14.687783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:14.689103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:14.690387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 401/813] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:19:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:14.691850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39102b-bb8a-40c8-aa47-60ae200c27d9 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:14.748835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:14.861538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95a894-d215-4ae8-b0af-74009f6d571e None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:14.871160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39102b-bb8a-40c8-aa47-60ae200c27d9 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:14.943074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b026b4d-6b72-4954-acbb-fdd13c388b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:14.943616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa83b41-72f0-4c51-b00a-2af072176821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:14.944036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b026b4d-6b72-4954-acbb-fdd13c388b09 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:14.944527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b026b4d-6b72-4954-acbb-fdd13c388b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:14.944689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa83b41-72f0-4c51-b00a-2af072176821 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:14.945002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b026b4d-6b72-4954-acbb-fdd13c388b09 None admin] PATH_INFO: `/v3/services/network` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:14.945159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa83b41-72f0-4c51-b00a-2af072176821 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:14.949423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa83b41-72f0-4c51-b00a-2af072176821 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:14.949691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b026b4d-6b72-4954-acbb-fdd13c388b09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:14.949836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa83b41-72f0-4c51-b00a-2af072176821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:14.949836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa83b41-72f0-4c51-b00a-2af072176821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:14.950091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b026b4d-6b72-4954-acbb-fdd13c388b09 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:14.950237 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa83b41-72f0-4c51-b00a-2af072176821 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-6b026b4d-6b72-4954-acbb-fdd13c388b09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:14.969942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:14.971930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:14.976117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 402/814] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:14 2022] GET /identity/v3/services/network => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:14.981147 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b026b4d-6b72-4954-acbb-fdd13c388b09 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:14.989914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 413/815] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:14.991335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa83b41-72f0-4c51-b00a-2af072176821 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:15.110175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:15.173267 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:15.178626 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b026b4d-6b72-4954-acbb-fdd13c388b09 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:15.190544 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa83b41-72f0-4c51-b00a-2af072176821 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:15.236384 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2890a5-2e73-4acc-a0b7-4012a49c246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:15.237468 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2890a5-2e73-4acc-a0b7-4012a49c246d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:15.238537 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2890a5-2e73-4acc-a0b7-4012a49c246d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:15.239035 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2890a5-2e73-4acc-a0b7-4012a49c246d None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:15.239905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2890a5-2e73-4acc-a0b7-4012a49c246d None admin] RBAC: Adding query filter params (name=network) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:15.240433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2890a5-2e73-4acc-a0b7-4012a49c246d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:15.242287 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2890a5-2e73-4acc-a0b7-4012a49c246d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:15.252904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364868e-1471-4065-aabe-4f5254e02c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:15.253295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 414/816] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:19:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:15.253800 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364868e-1471-4065-aabe-4f5254e02c0d None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:15.253890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364868e-1471-4065-aabe-4f5254e02c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:15.254430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364868e-1471-4065-aabe-4f5254e02c0d None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:15.255429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2890a5-2e73-4acc-a0b7-4012a49c246d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:15.255858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364868e-1471-4065-aabe-4f5254e02c0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:15.256554 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364868e-1471-4065-aabe-4f5254e02c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:15.259269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364868e-1471-4065-aabe-4f5254e02c0d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:15.283790 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 403/817] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:19:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:15.285301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364868e-1471-4065-aabe-4f5254e02c0d None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:15.404785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364868e-1471-4065-aabe-4f5254e02c0d None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:15.444965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9233cc8-fd25-4cf9-83d7-2cf8aafd5350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:15.445625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9233cc8-fd25-4cf9-83d7-2cf8aafd5350 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:15.445903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9233cc8-fd25-4cf9-83d7-2cf8aafd5350 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:15.446468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9233cc8-fd25-4cf9-83d7-2cf8aafd5350 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:15.446859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9233cc8-fd25-4cf9-83d7-2cf8aafd5350 None admin] RBAC: Adding query filter params (type=network) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:15.447557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9233cc8-fd25-4cf9-83d7-2cf8aafd5350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:15.448628 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9233cc8-fd25-4cf9-83d7-2cf8aafd5350 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:15.450669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2890a5-2e73-4acc-a0b7-4012a49c246d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:15.454735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 404/818] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:19:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:15.455601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9233cc8-fd25-4cf9-83d7-2cf8aafd5350 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:15.483706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:15.492122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:15.506228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048d67c-2202-4f29-95e2-b62118bce161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:15.506878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048d67c-2202-4f29-95e2-b62118bce161 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:15.507142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048d67c-2202-4f29-95e2-b62118bce161 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:15.507419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048d67c-2202-4f29-95e2-b62118bce161 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:15.515580 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048d67c-2202-4f29-95e2-b62118bce161 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:15.517189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6048d67c-2202-4f29-95e2-b62118bce161 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-6048d67c-2202-4f29-95e2-b62118bce161 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:15.535708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:15.540174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:15.542075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:15.542075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:15.542075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:15.542075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:15.542075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:15.542075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:15.542075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:15.542075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:15.542075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 415/819] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:15.542075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570e22-0188-47f8-b98a-c6b48f459baa None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:15.542075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570e22-0188-47f8-b98a-c6b48f459baa None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:15.543241 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570e22-0188-47f8-b98a-c6b48f459baa None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:15.544701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 416/820] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:15.545713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c570e22-0188-47f8-b98a-c6b48f459baa None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:15.609903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9233cc8-fd25-4cf9-83d7-2cf8aafd5350 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:15.654156 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da413ec0-2286-4a7a-ad74-29cf892ad606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:15.654815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da413ec0-2286-4a7a-ad74-29cf892ad606 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:15.655101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da413ec0-2286-4a7a-ad74-29cf892ad606 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:15.655464 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da413ec0-2286-4a7a-ad74-29cf892ad606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:15.668185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da413ec0-2286-4a7a-ad74-29cf892ad606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:15.669816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da413ec0-2286-4a7a-ad74-29cf892ad606 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-da413ec0-2286-4a7a-ad74-29cf892ad606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:15.689396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:15.692386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:15.694810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:15.694810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:15.694810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:15.696752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 405/821] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:15.697784 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da413ec0-2286-4a7a-ad74-29cf892ad606 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:15.732295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c570e22-0188-47f8-b98a-c6b48f459baa None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:15.799802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0597751-0825-44ff-80d0-672b368e2bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:15.800765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0597751-0825-44ff-80d0-672b368e2bd2 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:15.801265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0597751-0825-44ff-80d0-672b368e2bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:15.801826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0597751-0825-44ff-80d0-672b368e2bd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:15.803122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0597751-0825-44ff-80d0-672b368e2bd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:15.805836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0597751-0825-44ff-80d0-672b368e2bd2 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:15.809245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:15.839153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da413ec0-2286-4a7a-ad74-29cf892ad606 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:15.891032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7b307-9447-4d62-a410-4fbd8a9d9d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:15.891895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7b307-9447-4d62-a410-4fbd8a9d9d9b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:15.892240 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7b307-9447-4d62-a410-4fbd8a9d9d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:15.892746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7b307-9447-4d62-a410-4fbd8a9d9d9b None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:15.894224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7b307-9447-4d62-a410-4fbd8a9d9d9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:15.894618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7b307-9447-4d62-a410-4fbd8a9d9d9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:15.896728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7b307-9447-4d62-a410-4fbd8a9d9d9b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:15.914437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 406/822] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:15.915736 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fa540-6266-490f-a682-26c90e1d620a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:15.916109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fa540-6266-490f-a682-26c90e1d620a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:15.916366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fa540-6266-490f-a682-26c90e1d620a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:15.944293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-560fa540-6266-490f-a682-26c90e1d620a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:15.946015 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-560fa540-6266-490f-a682-26c90e1d620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:16.059562 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 407/823] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:16.060423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fa540-6266-490f-a682-26c90e1d620a None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:16.105943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 417/824] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:19:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:16.107072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0597751-0825-44ff-80d0-672b368e2bd2 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:16.190763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:16.193810 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:16.268162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fa540-6266-490f-a682-26c90e1d620a None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:16.354813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0597751-0825-44ff-80d0-672b368e2bd2 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:16.368440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee49e00-a14c-472c-a9ae-a98ab1168504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:16.369109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49e00-a14c-472c-a9ae-a98ab1168504 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:16.369445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49e00-a14c-472c-a9ae-a98ab1168504 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:16.369724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee49e00-a14c-472c-a9ae-a98ab1168504 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:16.370429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee49e00-a14c-472c-a9ae-a98ab1168504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:16.370734 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee49e00-a14c-472c-a9ae-a98ab1168504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:16.372288 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee49e00-a14c-472c-a9ae-a98ab1168504 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:16.403187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 408/825] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:16.407212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee49e00-a14c-472c-a9ae-a98ab1168504 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:16.447935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e7b81-6203-4f87-b798-4d62c0b9ed64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:16.449251 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e7b81-6203-4f87-b798-4d62c0b9ed64 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:16.449793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e7b81-6203-4f87-b798-4d62c0b9ed64 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:16.450269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e7b81-6203-4f87-b798-4d62c0b9ed64 None admin] PATH_INFO: `/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/8a0d07b79212443480c87f4a4ff3ca00/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:16.454611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e7b81-6203-4f87-b798-4d62c0b9ed64 None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c3fe9229c45f1bfd295115ef94cd7, user_id=8a0d07b79212443480c87f4a4ff3ca00, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:16.458114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e7b81-6203-4f87-b798-4d62c0b9ed64 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:16.541596 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 418/826] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:19:16 2022] PUT /identity/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/8a0d07b79212443480c87f4a4ff3ca00/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:19:16.543354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e7b81-6203-4f87-b798-4d62c0b9ed64 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:16.632931 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee49e00-a14c-472c-a9ae-a98ab1168504 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:16.675069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:16.685553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275d762-e12b-4cdf-bd03-613c5b0d0ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:16.686379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275d762-e12b-4cdf-bd03-613c5b0d0ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:16.686809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275d762-e12b-4cdf-bd03-613c5b0d0ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:16.687130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1275d762-e12b-4cdf-bd03-613c5b0d0ed5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:16.697587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275d762-e12b-4cdf-bd03-613c5b0d0ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:16.699469 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1275d762-e12b-4cdf-bd03-613c5b0d0ed5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-1275d762-e12b-4cdf-bd03-613c5b0d0ed5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:16.713448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:16.714651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:16.715807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:16.715807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:16.715807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:16.715807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:16.715807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:16.715807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:16.715807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:16.715807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:16.715807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:19:16.715807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:16.718589 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 409/827] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Sep 1 05:19:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:16.726868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275d762-e12b-4cdf-bd03-613c5b0d0ed5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:16.729751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:16.744294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e7b81-6203-4f87-b798-4d62c0b9ed64 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:16.790784 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad554e08-92d2-4cff-a220-9ffe820ca095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:16.791066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad554e08-92d2-4cff-a220-9ffe820ca095 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:16.791205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad554e08-92d2-4cff-a220-9ffe820ca095 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:16.791456 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad554e08-92d2-4cff-a220-9ffe820ca095 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:16.805513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad554e08-92d2-4cff-a220-9ffe820ca095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-ad554e08-92d2-4cff-a220-9ffe820ca095 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:19:16.810761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:16.811758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:16.812602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 419/828] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:19:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:16.824160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad554e08-92d2-4cff-a220-9ffe820ca095 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:16.911368 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1275d762-e12b-4cdf-bd03-613c5b0d0ed5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:16.972434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad554e08-92d2-4cff-a220-9ffe820ca095 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:16.975989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3e2a9-b3b3-4ffb-a155-34794ce43df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:16.977241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3e2a9-b3b3-4ffb-a155-34794ce43df6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:16.977783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3e2a9-b3b3-4ffb-a155-34794ce43df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:16.978260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3e2a9-b3b3-4ffb-a155-34794ce43df6 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:16.979654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3e2a9-b3b3-4ffb-a155-34794ce43df6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:16.980334 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3e2a9-b3b3-4ffb-a155-34794ce43df6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:16.983125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3e2a9-b3b3-4ffb-a155-34794ce43df6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:17.017999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 410/829] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Sep 1 05:19:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:17.020835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973381fd-64e4-44f8-8439-35ea4014b7e8 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:17.021318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973381fd-64e4-44f8-8439-35ea4014b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:17.021816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973381fd-64e4-44f8-8439-35ea4014b7e8 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:17.024668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 411/830] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:17.026185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973381fd-64e4-44f8-8439-35ea4014b7e8 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:17.039196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2573eb4e-46e8-4c1a-a133-f09cbe11c96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:17.040355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573eb4e-46e8-4c1a-a133-f09cbe11c96f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:17.040899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573eb4e-46e8-4c1a-a133-f09cbe11c96f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:17.041471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2573eb4e-46e8-4c1a-a133-f09cbe11c96f None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:17.042597 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573eb4e-46e8-4c1a-a133-f09cbe11c96f None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:17.043162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573eb4e-46e8-4c1a-a133-f09cbe11c96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:17.044964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2573eb4e-46e8-4c1a-a133-f09cbe11c96f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:17.055708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 420/831] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:19:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:17.057889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f61b8-2f86-4e9a-81fa-184377bb4c15 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:17.058307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f61b8-2f86-4e9a-81fa-184377bb4c15 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:17.058675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f61b8-2f86-4e9a-81fa-184377bb4c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:17.079470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-372f61b8-2f86-4e9a-81fa-184377bb4c15 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:17.080953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-372f61b8-2f86-4e9a-81fa-184377bb4c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:17.091647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:17.127928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:17.180136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 421/832] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:17.181607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f61b8-2f86-4e9a-81fa-184377bb4c15 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:17.215800 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973381fd-64e4-44f8-8439-35ea4014b7e8 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:17.267815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5dd99-3f0f-46f2-b6a6-cd64a3c38321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:17.267815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5dd99-3f0f-46f2-b6a6-cd64a3c38321 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:17.267815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5dd99-3f0f-46f2-b6a6-cd64a3c38321 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:17.267815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d5dd99-3f0f-46f2-b6a6-cd64a3c38321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:17.408389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5dd99-3f0f-46f2-b6a6-cd64a3c38321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:17.411343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d5dd99-3f0f-46f2-b6a6-cd64a3c38321 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:17.413259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f61b8-2f86-4e9a-81fa-184377bb4c15 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:17.494066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:17.502156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f2a06-25b3-451c-9549-b292d0064546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:17.504400 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f2a06-25b3-451c-9549-b292d0064546 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:17.505173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f2a06-25b3-451c-9549-b292d0064546 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:17.506046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f2a06-25b3-451c-9549-b292d0064546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:17.533158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f2a06-25b3-451c-9549-b292d0064546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:17.537194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f2a06-25b3-451c-9549-b292d0064546 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:17.541251 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-4d8f2a06-25b3-451c-9549-b292d0064546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:17.571058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:17.572681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:17.574488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:17.574488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:17.574488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:17.577603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 422/833] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:17.579210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 412/834] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:19:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:17.584727 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f2a06-25b3-451c-9549-b292d0064546 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:17.585678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5dd99-3f0f-46f2-b6a6-cd64a3c38321 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:17.724325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d5dd99-3f0f-46f2-b6a6-cd64a3c38321 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:17.763665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f2a06-25b3-451c-9549-b292d0064546 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:17.777648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7c7b5-a564-4c03-93d1-e0e2a1cb86ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:17.778676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7c7b5-a564-4c03-93d1-e0e2a1cb86ed None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:17.779163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7c7b5-a564-4c03-93d1-e0e2a1cb86ed None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:17.779546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7c7b5-a564-4c03-93d1-e0e2a1cb86ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:17.807313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f7d43-f6c1-46b5-8c85-a00b8eb3abf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:17.807934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f7d43-f6c1-46b5-8c85-a00b8eb3abf6 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:17.808312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f7d43-f6c1-46b5-8c85-a00b8eb3abf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:17.808576 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f7d43-f6c1-46b5-8c85-a00b8eb3abf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:17.809256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f7d43-f6c1-46b5-8c85-a00b8eb3abf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:17.809600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f7d43-f6c1-46b5-8c85-a00b8eb3abf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:17.810226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7c7b5-a564-4c03-93d1-e0e2a1cb86ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:17.811035 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f7d43-f6c1-46b5-8c85-a00b8eb3abf6 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:17.813430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7c7b5-a564-4c03-93d1-e0e2a1cb86ed None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:17.832709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 423/835] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:17.832709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f7d43-f6c1-46b5-8c85-a00b8eb3abf6 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:17.833103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-13c7c7b5-a564-4c03-93d1-e0e2a1cb86ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:17.843890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:17.846013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:17.848967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:17.848967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:17.848967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:17.848967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 413/836] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:17.848967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7c7b5-a564-4c03-93d1-e0e2a1cb86ed None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:17.919570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:17.993176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f7d43-f6c1-46b5-8c85-a00b8eb3abf6 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:18.026723 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7c7b5-a564-4c03-93d1-e0e2a1cb86ed None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:18.062494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d0657-a3de-4bf3-bbe1-453894c30b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:18.063552 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0657-a3de-4bf3-bbe1-453894c30b11 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:18.064040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0657-a3de-4bf3-bbe1-453894c30b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:18.064528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d0657-a3de-4bf3-bbe1-453894c30b11 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:18.065667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d0657-a3de-4bf3-bbe1-453894c30b11 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:18.068803 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d0657-a3de-4bf3-bbe1-453894c30b11 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:18.076749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823cf9f-ee29-4a66-814b-fa99b074fb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:18.077634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823cf9f-ee29-4a66-814b-fa99b074fb19 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:18.078041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823cf9f-ee29-4a66-814b-fa99b074fb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:18.078442 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823cf9f-ee29-4a66-814b-fa99b074fb19 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-2a1d0657-a3de-4bf3-bbe1-453894c30b11 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:18.086562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:18.088064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:18.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 424/837] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:19:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:18.092362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d0657-a3de-4bf3-bbe1-453894c30b11 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:18.095796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823cf9f-ee29-4a66-814b-fa99b074fb19 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:18.099543 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823cf9f-ee29-4a66-814b-fa99b074fb19 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-f823cf9f-ee29-4a66-814b-fa99b074fb19 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:18.113973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:18.115848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:18.117762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:18.117762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:18.117762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:18.117762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:18.117762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:18.117762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:18.117762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:18.117762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:18.117762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:19:18.117762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:18.117762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 414/838] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Sep 1 05:19:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:18.117762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823cf9f-ee29-4a66-814b-fa99b074fb19 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:18.220427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:18.278512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823cf9f-ee29-4a66-814b-fa99b074fb19 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:18.299993 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d0657-a3de-4bf3-bbe1-453894c30b11 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:18.327526 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:18.342464 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c210c3-3b16-4fbe-ab7e-c071a169bd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:18.343753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c210c3-3b16-4fbe-ab7e-c071a169bd09 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:18.345600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c210c3-3b16-4fbe-ab7e-c071a169bd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:18.345600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c210c3-3b16-4fbe-ab7e-c071a169bd09 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:18.346404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c210c3-3b16-4fbe-ab7e-c071a169bd09 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:18.346920 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c210c3-3b16-4fbe-ab7e-c071a169bd09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:18.350703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c210c3-3b16-4fbe-ab7e-c071a169bd09 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:18.351426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cb487-ddb9-4745-b820-9b89eb6d2f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:18.352199 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cb487-ddb9-4745-b820-9b89eb6d2f5b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:18.352673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cb487-ddb9-4745-b820-9b89eb6d2f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:18.353139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cb487-ddb9-4745-b820-9b89eb6d2f5b None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:18.353998 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cb487-ddb9-4745-b820-9b89eb6d2f5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:18.354373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cb487-ddb9-4745-b820-9b89eb6d2f5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:18.356183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cb487-ddb9-4745-b820-9b89eb6d2f5b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:18.361989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 415/839] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:19:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:18.364425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c210c3-3b16-4fbe-ab7e-c071a169bd09 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:18.374427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 425/840] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:18.376482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cb487-ddb9-4745-b820-9b89eb6d2f5b None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:18.526782 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cb487-ddb9-4745-b820-9b89eb6d2f5b None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:18.577734 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51321540-afe9-4d7d-bb8b-175f6f73bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:18.578337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321540-afe9-4d7d-bb8b-175f6f73bd24 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:18.578699 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321540-afe9-4d7d-bb8b-175f6f73bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:18.579039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321540-afe9-4d7d-bb8b-175f6f73bd24 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:18.579765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51321540-afe9-4d7d-bb8b-175f6f73bd24 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:18.580128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51321540-afe9-4d7d-bb8b-175f6f73bd24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:18.582204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c210c3-3b16-4fbe-ab7e-c071a169bd09 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:18.582450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51321540-afe9-4d7d-bb8b-175f6f73bd24 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:18.588679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 426/841] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:19:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:18.589307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51321540-afe9-4d7d-bb8b-175f6f73bd24 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:18.635451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:18.662028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586402f-aed8-4ffb-ae73-8c29687e3096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:18.663458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586402f-aed8-4ffb-ae73-8c29687e3096 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:18.664584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586402f-aed8-4ffb-ae73-8c29687e3096 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:18.666601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c586402f-aed8-4ffb-ae73-8c29687e3096 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:18.668417 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586402f-aed8-4ffb-ae73-8c29687e3096 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:18.669212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586402f-aed8-4ffb-ae73-8c29687e3096 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:18.672246 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c586402f-aed8-4ffb-ae73-8c29687e3096 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:18.684205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:18.713835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 416/842] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Sep 1 05:19:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:18.723486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586402f-aed8-4ffb-ae73-8c29687e3096 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:18.825260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51321540-afe9-4d7d-bb8b-175f6f73bd24 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:18.916942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71415e06-64b9-4766-a333-4c48a1c6cc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:18.919135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71415e06-64b9-4766-a333-4c48a1c6cc1b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:18.920053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71415e06-64b9-4766-a333-4c48a1c6cc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:18.921103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71415e06-64b9-4766-a333-4c48a1c6cc1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:18.937261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71415e06-64b9-4766-a333-4c48a1c6cc1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:18.940137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71415e06-64b9-4766-a333-4c48a1c6cc1b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:18.961868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c586402f-aed8-4ffb-ae73-8c29687e3096 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-71415e06-64b9-4766-a333-4c48a1c6cc1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:18.963368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:18.964269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:18.965159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:18.965159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:18.965159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:18.965159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:18.965159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:18.965159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:18.965159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:18.965159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:18.969845 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 427/843] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:18.971687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ea3c8-1341-46e9-8a1d-c016b01c14f8 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:18.972915 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ea3c8-1341-46e9-8a1d-c016b01c14f8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:18.973462 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ea3c8-1341-46e9-8a1d-c016b01c14f8 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:18.975360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 428/844] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:18.976680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ea3c8-1341-46e9-8a1d-c016b01c14f8 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:19.037181 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196841f-9a1e-42a5-a890-4a638b60138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:19.038291 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196841f-9a1e-42a5-a890-4a638b60138f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:19.038759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196841f-9a1e-42a5-a890-4a638b60138f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:19.039230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196841f-9a1e-42a5-a890-4a638b60138f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:19.121455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ea3c8-1341-46e9-8a1d-c016b01c14f8 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:19.123841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:19.131963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:19.158505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196841f-9a1e-42a5-a890-4a638b60138f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:19.161440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196841f-9a1e-42a5-a890-4a638b60138f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:19.187555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c275a-154f-4ec7-8352-82cb02a38dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:19.188326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c275a-154f-4ec7-8352-82cb02a38dcb None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:19.188832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c275a-154f-4ec7-8352-82cb02a38dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:19.189197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c275a-154f-4ec7-8352-82cb02a38dcb None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:19.190122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c275a-154f-4ec7-8352-82cb02a38dcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:19.190382 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c275a-154f-4ec7-8352-82cb02a38dcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:19.191950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c275a-154f-4ec7-8352-82cb02a38dcb None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:19.218483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 429/845] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:19.218483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b60ac-5a38-4097-836c-5d268d1a070d None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:19.218483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b60ac-5a38-4097-836c-5d268d1a070d None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:19.218483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b60ac-5a38-4097-836c-5d268d1a070d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:19.252346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-912b60ac-5a38-4097-836c-5d268d1a070d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:19.254802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-912b60ac-5a38-4097-836c-5d268d1a070d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:19.364320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 417/846] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:19:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 643 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 05:19:19.364320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196841f-9a1e-42a5-a890-4a638b60138f None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:19.392865 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 430/847] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:19.392865 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b60ac-5a38-4097-836c-5d268d1a070d None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:19.524656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:19.549860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:19.562920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b60ac-5a38-4097-836c-5d268d1a070d None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:19.575631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196841f-9a1e-42a5-a890-4a638b60138f None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:19.618449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f945-5e62-4d58-b6e2-b64a4986acfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:19.619361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f945-5e62-4d58-b6e2-b64a4986acfb None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:19.619739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f945-5e62-4d58-b6e2-b64a4986acfb None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:19.620114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0f945-5e62-4d58-b6e2-b64a4986acfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:19.637425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0f945-5e62-4d58-b6e2-b64a4986acfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:19.639571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0f945-5e62-4d58-b6e2-b64a4986acfb None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:19.657930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68827b-2404-448e-8afd-819b6fe3c48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:19.658873 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68827b-2404-448e-8afd-819b6fe3c48c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:19.659365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68827b-2404-448e-8afd-819b6fe3c48c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-e6a0f945-5e62-4d58-b6e2-b64a4986acfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:19.660395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:19.662458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:19.664870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:19.664870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:19.664870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:19.665263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68827b-2404-448e-8afd-819b6fe3c48c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:19.665263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68827b-2404-448e-8afd-819b6fe3c48c None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=b7e84a5652df4d64aa1fd28f3d5383fe) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:19.665263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68827b-2404-448e-8afd-819b6fe3c48c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:19.665721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 431/848] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:19.665862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68827b-2404-448e-8afd-819b6fe3c48c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:19.674917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f945-5e62-4d58-b6e2-b64a4986acfb None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:19.678003 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 418/849] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:19:19 2022] GET /identity/v3/role_assignments?user.id=b7e84a5652df4d64aa1fd28f3d5383fe&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:19.829168 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68827b-2404-448e-8afd-819b6fe3c48c None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:19.909540 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0f945-5e62-4d58-b6e2-b64a4986acfb None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:19.980542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68827b-2404-448e-8afd-819b6fe3c48c None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:19.984127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d966ab-b343-4a51-8834-7c14935746b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:19.987067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d966ab-b343-4a51-8834-7c14935746b7 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:19.988523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d966ab-b343-4a51-8834-7c14935746b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:19.989194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d966ab-b343-4a51-8834-7c14935746b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:19.990825 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d966ab-b343-4a51-8834-7c14935746b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:19.991653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d966ab-b343-4a51-8834-7c14935746b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:19.994688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d966ab-b343-4a51-8834-7c14935746b7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:20.019721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 432/850] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:20.028308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d966ab-b343-4a51-8834-7c14935746b7 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:20.036332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:20.065244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32de3f-7208-48cc-8ec8-8a15489ea548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:20.067020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32de3f-7208-48cc-8ec8-8a15489ea548 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:20.067650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32de3f-7208-48cc-8ec8-8a15489ea548 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:20.068149 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32de3f-7208-48cc-8ec8-8a15489ea548 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:20.093482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32de3f-7208-48cc-8ec8-8a15489ea548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-9c32de3f-7208-48cc-8ec8-8a15489ea548 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:19:20.105185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:20.106635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:20.107617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:20.107617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:20.107617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:20.107617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:20.107617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:19:20.107617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:19:20.107617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:19:20.107617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:19:20.107617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:19:20.107617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:19:20.107617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:19:20.107617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:20.108320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 419/851] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:19:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:20.115751 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32de3f-7208-48cc-8ec8-8a15489ea548 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:20.122506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:20.250530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d966ab-b343-4a51-8834-7c14935746b7 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:20.300437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b86ec-5295-4794-9da1-c82ac3486002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:20.301766 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b86ec-5295-4794-9da1-c82ac3486002 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:20.302227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b86ec-5295-4794-9da1-c82ac3486002 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:20.302691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b86ec-5295-4794-9da1-c82ac3486002 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:20.313659 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b86ec-5295-4794-9da1-c82ac3486002 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:20.317141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b86ec-5295-4794-9da1-c82ac3486002 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-b78b86ec-5295-4794-9da1-c82ac3486002 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:20.331280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:20.341833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:20.343608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:20.343608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:20.343608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:20.343608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:20.343608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:20.343608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:20.343608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:20.343608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:20.343608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 433/852] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:20.344556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32de3f-7208-48cc-8ec8-8a15489ea548 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:20.349341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b86ec-5295-4794-9da1-c82ac3486002 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:20.417599 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97843b-0e5e-44c0-b296-d058cb8efe87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:20.419410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97843b-0e5e-44c0-b296-d058cb8efe87 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:20.420217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97843b-0e5e-44c0-b296-d058cb8efe87 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:20.421027 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97843b-0e5e-44c0-b296-d058cb8efe87 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:20.422810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97843b-0e5e-44c0-b296-d058cb8efe87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:20.423732 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97843b-0e5e-44c0-b296-d058cb8efe87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:20.427244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97843b-0e5e-44c0-b296-d058cb8efe87 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:20.430396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:20.451224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 420/853] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:19:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:20.458646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97843b-0e5e-44c0-b296-d058cb8efe87 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:20.494158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b86ec-5295-4794-9da1-c82ac3486002 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:20.545292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e761b-b782-4400-9d8b-8d2579cec7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:20.546248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e761b-b782-4400-9d8b-8d2579cec7df None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:20.546801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e761b-b782-4400-9d8b-8d2579cec7df None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:20.547273 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e761b-b782-4400-9d8b-8d2579cec7df None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:20.548497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e761b-b782-4400-9d8b-8d2579cec7df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:20.549020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e761b-b782-4400-9d8b-8d2579cec7df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:20.552234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e761b-b782-4400-9d8b-8d2579cec7df None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:20.573425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 434/854] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:20.583265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e761b-b782-4400-9d8b-8d2579cec7df None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:20.617883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:20.693000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97843b-0e5e-44c0-b296-d058cb8efe87 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:20.748946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e761b-b782-4400-9d8b-8d2579cec7df None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:20.768211 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3346154-4798-4dfe-bcc8-c6fd7f2e51a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:20.769359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3346154-4798-4dfe-bcc8-c6fd7f2e51a4 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:20.769878 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3346154-4798-4dfe-bcc8-c6fd7f2e51a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:20.770375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3346154-4798-4dfe-bcc8-c6fd7f2e51a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:20.786922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:20.792481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3346154-4798-4dfe-bcc8-c6fd7f2e51a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:20.794900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3346154-4798-4dfe-bcc8-c6fd7f2e51a4 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:20.811856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7c20e-867b-426a-ad01-537482d21d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:20.811856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7c20e-867b-426a-ad01-537482d21d83 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:20.811856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7c20e-867b-426a-ad01-537482d21d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:20.811856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7c20e-867b-426a-ad01-537482d21d83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:20.812473 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7c20e-867b-426a-ad01-537482d21d83 None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=eb75c0fb10484f3d80813962a4283b02) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:20.813022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7c20e-867b-426a-ad01-537482d21d83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:20.816456 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7c20e-867b-426a-ad01-537482d21d83 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-a3346154-4798-4dfe-bcc8-c6fd7f2e51a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:20.820086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:20.821116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:20.822100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:20.822100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:20.822100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:20.830026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 421/855] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:20.832920 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3346154-4798-4dfe-bcc8-c6fd7f2e51a4 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:20.833619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 435/856] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:19:20 2022] GET /identity/v3/role_assignments?user.id=eb75c0fb10484f3d80813962a4283b02&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:20.983500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3346154-4798-4dfe-bcc8-c6fd7f2e51a4 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:21.010214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:21.034268 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd436eb-ed7c-4af7-a388-8c8c4ef06ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:21.036593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd436eb-ed7c-4af7-a388-8c8c4ef06ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:21.037190 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd436eb-ed7c-4af7-a388-8c8c4ef06ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:21.037783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd436eb-ed7c-4af7-a388-8c8c4ef06ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:21.038754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd436eb-ed7c-4af7-a388-8c8c4ef06ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:21.039341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd436eb-ed7c-4af7-a388-8c8c4ef06ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:21.041064 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd436eb-ed7c-4af7-a388-8c8c4ef06ef3 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:21.062033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 422/857] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:21.065324 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7c20e-867b-426a-ad01-537482d21d83 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:21.078074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b187e-d444-4e9f-8663-334024a6ac24 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:21.078443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b187e-d444-4e9f-8663-334024a6ac24 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:21.079143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b187e-d444-4e9f-8663-334024a6ac24 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:21.089942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 423/858] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:21 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:21.100622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a034-41c8-4ad5-a426-af6781b14421 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:21.101115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a034-41c8-4ad5-a426-af6781b14421 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:21.101625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308a034-41c8-4ad5-a426-af6781b14421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:21.137870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-8308a034-41c8-4ad5-a426-af6781b14421 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:21.140181 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8308a034-41c8-4ad5-a426-af6781b14421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:21.267407 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 424/859] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:21.298453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7c20e-867b-426a-ad01-537482d21d83 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:21.379119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3fcbd-bee8-4f6c-915e-eae5e98ad3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:21.380142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3fcbd-bee8-4f6c-915e-eae5e98ad3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:21.380645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3fcbd-bee8-4f6c-915e-eae5e98ad3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:21.381136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3fcbd-bee8-4f6c-915e-eae5e98ad3d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:21.394886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3fcbd-bee8-4f6c-915e-eae5e98ad3d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:21.396884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3fcbd-bee8-4f6c-915e-eae5e98ad3d6 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-fdd3fcbd-bee8-4f6c-915e-eae5e98ad3d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:21.417213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:21.418373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:21.419418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:21.419418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:21.419418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:21.419418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:21.419418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:21.419418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:21.419418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:21.419418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:21.419418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 05:19:21.419418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:21.420012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 436/860] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:19:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:21.429419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308a034-41c8-4ad5-a426-af6781b14421 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:21.564835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308a034-41c8-4ad5-a426-af6781b14421 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:21.580134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:21.625621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c371cd-b0ae-46dd-b174-530a6ed6a3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:21.626667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c371cd-b0ae-46dd-b174-530a6ed6a3ec None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:21.627171 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c371cd-b0ae-46dd-b174-530a6ed6a3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:21.627668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c371cd-b0ae-46dd-b174-530a6ed6a3ec None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:21.629114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c371cd-b0ae-46dd-b174-530a6ed6a3ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:21.630010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c371cd-b0ae-46dd-b174-530a6ed6a3ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:21.631883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c371cd-b0ae-46dd-b174-530a6ed6a3ec None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:21.658099 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 425/861] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Sep 1 05:19:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:21.666676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3fcbd-bee8-4f6c-915e-eae5e98ad3d6 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:21.753981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:21.875082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c371cd-b0ae-46dd-b174-530a6ed6a3ec None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:21.875813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3fcbd-bee8-4f6c-915e-eae5e98ad3d6 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:21.905188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db4693-06a7-411f-bbe9-836340f40665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:21.906167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db4693-06a7-411f-bbe9-836340f40665 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:21.906627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db4693-06a7-411f-bbe9-836340f40665 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:21.907062 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db4693-06a7-411f-bbe9-836340f40665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:22.018978 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db4693-06a7-411f-bbe9-836340f40665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:22.021229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db4693-06a7-411f-bbe9-836340f40665 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:22.054681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c371cd-b0ae-46dd-b174-530a6ed6a3ec None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:22.091824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:22.129416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b8c7-96a7-4201-ae0b-f9ec577f6bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:22.130707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b8c7-96a7-4201-ae0b-f9ec577f6bd8 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:22.131258 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b8c7-96a7-4201-ae0b-f9ec577f6bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:22.131783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b8c7-96a7-4201-ae0b-f9ec577f6bd8 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:22.133762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6b8c7-96a7-4201-ae0b-f9ec577f6bd8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:22.136703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6b8c7-96a7-4201-ae0b-f9ec577f6bd8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:22.166256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 437/862] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:19:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:22.176092 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db4693-06a7-411f-bbe9-836340f40665 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:22.292910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 426/863] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:19:21 2022] POST /identity/v3/services => generated 251 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:19:22.320936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db4693-06a7-411f-bbe9-836340f40665 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:22.378005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306eccfa-9fcf-470c-ab4f-0a8db3f3e0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:22.379473 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eccfa-9fcf-470c-ab4f-0a8db3f3e0cb None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:22.380005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eccfa-9fcf-470c-ab4f-0a8db3f3e0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:22.380516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306eccfa-9fcf-470c-ab4f-0a8db3f3e0cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:22.398927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eccfa-9fcf-470c-ab4f-0a8db3f3e0cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:22.400481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306eccfa-9fcf-470c-ab4f-0a8db3f3e0cb None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:22.403914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-306eccfa-9fcf-470c-ab4f-0a8db3f3e0cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:22.420067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:22.421116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:22.422053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:22.422053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:22.422053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:22.422053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 438/864] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:22.431461 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b8c7-96a7-4201-ae0b-f9ec577f6bd8 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:22.493969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:22.642729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b8c7-96a7-4201-ae0b-f9ec577f6bd8 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:22.684538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9087a02-a3f0-481d-866d-18581e68275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:22.685093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9087a02-a3f0-481d-866d-18581e68275d None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:22.685396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9087a02-a3f0-481d-866d-18581e68275d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:22.685684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9087a02-a3f0-481d-866d-18581e68275d None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:22.686367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9087a02-a3f0-481d-866d-18581e68275d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:22.686674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9087a02-a3f0-481d-866d-18581e68275d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:22.688121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9087a02-a3f0-481d-866d-18581e68275d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:22.696189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f48dee-f5de-401d-943b-fbdf8e3600ea None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:22.696728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f48dee-f5de-401d-943b-fbdf8e3600ea None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:22.697124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f48dee-f5de-401d-943b-fbdf8e3600ea None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:22.703676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 427/866] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:22.703906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 439/866] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:22.709324 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cdf6b-b3f2-4efd-b57d-e61311091fff None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:22.710102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cdf6b-b3f2-4efd-b57d-e61311091fff None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:22.710573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cdf6b-b3f2-4efd-b57d-e61311091fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:22.711116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f48dee-f5de-401d-943b-fbdf8e3600ea None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:22.735095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-056cdf6b-b3f2-4efd-b57d-e61311091fff None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:22.736998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-056cdf6b-b3f2-4efd-b57d-e61311091fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:22.829636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 428/867] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:22.930828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f48dee-f5de-401d-943b-fbdf8e3600ea None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:22.985208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6414e8-cc93-4e26-b3db-590300b1e8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:22.985818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6414e8-cc93-4e26-b3db-590300b1e8e4 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:22.986104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6414e8-cc93-4e26-b3db-590300b1e8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:22.986382 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6414e8-cc93-4e26-b3db-590300b1e8e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:22.995699 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6414e8-cc93-4e26-b3db-590300b1e8e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:22.997414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6414e8-cc93-4e26-b3db-590300b1e8e4 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-9f6414e8-cc93-4e26-b3db-590300b1e8e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:23.012247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:23.013197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:23.014146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:23.014146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:23.014146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:23.014146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:23.014146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:23.014146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:23.014146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:23.014146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:23.014146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 440/868] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:23.020762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cdf6b-b3f2-4efd-b57d-e61311091fff None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:23.042695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:23.152895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cdf6b-b3f2-4efd-b57d-e61311091fff None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:23.195032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6ac47-1ea4-4ac4-94a2-1fe12ad5cdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:23.195680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6ac47-1ea4-4ac4-94a2-1fe12ad5cdd7 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:23.195959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6ac47-1ea4-4ac4-94a2-1fe12ad5cdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:23.196233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6ac47-1ea4-4ac4-94a2-1fe12ad5cdd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:23.196953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6ac47-1ea4-4ac4-94a2-1fe12ad5cdd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:23.197262 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6ac47-1ea4-4ac4-94a2-1fe12ad5cdd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:23.198826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6ac47-1ea4-4ac4-94a2-1fe12ad5cdd7 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:23.214077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 429/869] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:23.220177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6414e8-cc93-4e26-b3db-590300b1e8e4 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:23.295830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:23.321937 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6ac47-1ea4-4ac4-94a2-1fe12ad5cdd7 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:23.351878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6414e8-cc93-4e26-b3db-590300b1e8e4 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:23.402116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272940d5-4f3f-4f0a-b680-fbbd8b6da7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:23.403163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272940d5-4f3f-4f0a-b680-fbbd8b6da7ea None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:23.403683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272940d5-4f3f-4f0a-b680-fbbd8b6da7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:23.404091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272940d5-4f3f-4f0a-b680-fbbd8b6da7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:23.404867 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272940d5-4f3f-4f0a-b680-fbbd8b6da7ea None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=8a0d07b79212443480c87f4a4ff3ca00) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:23.405179 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272940d5-4f3f-4f0a-b680-fbbd8b6da7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:23.406718 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272940d5-4f3f-4f0a-b680-fbbd8b6da7ea None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:23.421415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 441/870] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:19:23 2022] GET /identity/v3/role_assignments?user.id=8a0d07b79212443480c87f4a4ff3ca00&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:23.421415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844506d2-c827-4c31-bbb3-236b1b20a8dc None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:23.421415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844506d2-c827-4c31-bbb3-236b1b20a8dc None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:23.421415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844506d2-c827-4c31-bbb3-236b1b20a8dc None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:23.421415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 442/871] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:23.424299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef3fbe-0858-4dab-b73b-b8a3d57ba045 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:23.424808 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef3fbe-0858-4dab-b73b-b8a3d57ba045 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:23.425336 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef3fbe-0858-4dab-b73b-b8a3d57ba045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:23.457948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-77ef3fbe-0858-4dab-b73b-b8a3d57ba045 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:23.460628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-77ef3fbe-0858-4dab-b73b-b8a3d57ba045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:23.472309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:23.506244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6ac47-1ea4-4ac4-94a2-1fe12ad5cdd7 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:23.554084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a46c9f-0019-4bd8-bad2-202329dac7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:23.554689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46c9f-0019-4bd8-bad2-202329dac7fa None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:23.554973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46c9f-0019-4bd8-bad2-202329dac7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:23.555249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46c9f-0019-4bd8-bad2-202329dac7fa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:23.555874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a46c9f-0019-4bd8-bad2-202329dac7fa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:23.557539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a46c9f-0019-4bd8-bad2-202329dac7fa None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-76a46c9f-0019-4bd8-bad2-202329dac7fa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:23.571008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:23.572020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:19:23.572987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:23.573769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 430/872] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Sep 1 05:19:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:23.583866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a46c9f-0019-4bd8-bad2-202329dac7fa None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:23.614011 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 443/873] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:23.726466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a46c9f-0019-4bd8-bad2-202329dac7fa None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:23.795221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8773268-1ca2-460a-9af7-b07aebc3c1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:23.796297 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773268-1ca2-460a-9af7-b07aebc3c1bf None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:23.796789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773268-1ca2-460a-9af7-b07aebc3c1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:23.797280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8773268-1ca2-460a-9af7-b07aebc3c1bf None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:23.798539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8773268-1ca2-460a-9af7-b07aebc3c1bf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:23.799167 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8773268-1ca2-460a-9af7-b07aebc3c1bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:23.801915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8773268-1ca2-460a-9af7-b07aebc3c1bf None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:23.817765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 431/874] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Sep 1 05:19:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:23.824312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef3fbe-0858-4dab-b73b-b8a3d57ba045 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:23.903360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8773268-1ca2-460a-9af7-b07aebc3c1bf None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:23.908987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:23.950857 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:24.033331 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8773268-1ca2-460a-9af7-b07aebc3c1bf None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:24.060635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef3fbe-0858-4dab-b73b-b8a3d57ba045 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:24.080949 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf9821-7c54-4cb9-9778-a4a51f5463ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:24.082073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf9821-7c54-4cb9-9778-a4a51f5463ad None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:24.083130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf9821-7c54-4cb9-9778-a4a51f5463ad None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:24.083992 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf9821-7c54-4cb9-9778-a4a51f5463ad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:24.109094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baf9821-7c54-4cb9-9778-a4a51f5463ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-0baf9821-7c54-4cb9-9778-a4a51f5463ad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:19:24.115028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:24.117183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:24.119420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:24.119420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:24.119420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:24.119420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:24.119420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:19:24.119420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:19:24.119420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:19:24.119420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:19:24.119420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:19:24.119420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:19:24.119420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:19:24.119420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:24.120976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ace65-a056-4c3e-bb6a-52b86cd06661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:24.121175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ace65-a056-4c3e-bb6a-52b86cd06661 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:24.129428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 432/875] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Sep 1 05:19:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:24.129858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ace65-a056-4c3e-bb6a-52b86cd06661 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:24.129858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ace65-a056-4c3e-bb6a-52b86cd06661 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:24.130199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf9821-7c54-4cb9-9778-a4a51f5463ad None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:24.130374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ace65-a056-4c3e-bb6a-52b86cd06661 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:24.130374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ace65-a056-4c3e-bb6a-52b86cd06661 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:24.130374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ace65-a056-4c3e-bb6a-52b86cd06661 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:24.142243 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 444/876] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Sep 1 05:19:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:24.210321 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:24.263386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf9821-7c54-4cb9-9778-a4a51f5463ad None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:24.319997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a113b9-d5d6-4ce7-8169-b2c695754fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:24.321123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a113b9-d5d6-4ce7-8169-b2c695754fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:24.321653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a113b9-d5d6-4ce7-8169-b2c695754fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:24.322151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a113b9-d5d6-4ce7-8169-b2c695754fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:24.323403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a113b9-d5d6-4ce7-8169-b2c695754fa2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:24.324052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a113b9-d5d6-4ce7-8169-b2c695754fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:24.327034 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a113b9-d5d6-4ce7-8169-b2c695754fa2 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:24.350012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 433/877] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Sep 1 05:19:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:24.355848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ace65-a056-4c3e-bb6a-52b86cd06661 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:24.558919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ace65-a056-4c3e-bb6a-52b86cd06661 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:24.580226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:24.609333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfed69b-bcd1-4cdd-a2e9-198b0224fe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:24.610250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfed69b-bcd1-4cdd-a2e9-198b0224fe58 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:24.610794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfed69b-bcd1-4cdd-a2e9-198b0224fe58 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:24.611251 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfed69b-bcd1-4cdd-a2e9-198b0224fe58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:24.629952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfed69b-bcd1-4cdd-a2e9-198b0224fe58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:24.632887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfed69b-bcd1-4cdd-a2e9-198b0224fe58 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:24.634099 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c467b-50ac-4a35-bcea-e6224809110f None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:24.634394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c467b-50ac-4a35-bcea-e6224809110f None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:24.634701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c467b-50ac-4a35-bcea-e6224809110f None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:24.636596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 434/878] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:19:24.642791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c617f11-6470-414f-919a-cf01f552f1b3 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:24.643147 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c617f11-6470-414f-919a-cf01f552f1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:24.644148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c617f11-6470-414f-919a-cf01f552f1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-1bfed69b-bcd1-4cdd-a2e9-198b0224fe58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:24.664094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:24.665141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:24.666140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:24.666140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:24.666140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:24.666640 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 445/879] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:24.673499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfed69b-bcd1-4cdd-a2e9-198b0224fe58 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:24.676959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-7c617f11-6470-414f-919a-cf01f552f1b3 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:24.681909 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7c617f11-6470-414f-919a-cf01f552f1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:24.808366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfed69b-bcd1-4cdd-a2e9-198b0224fe58 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:24.842431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 435/880] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:24.867221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a8376-f0a4-4aae-b802-6e1883058f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:24.868319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a8376-f0a4-4aae-b802-6e1883058f4f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:24.868831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a8376-f0a4-4aae-b802-6e1883058f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:24.869345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a8376-f0a4-4aae-b802-6e1883058f4f None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:24.870644 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a8376-f0a4-4aae-b802-6e1883058f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:24.871344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a8376-f0a4-4aae-b802-6e1883058f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:24.873688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a8376-f0a4-4aae-b802-6e1883058f4f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:24.901446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 446/881] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:24.907200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c617f11-6470-414f-919a-cf01f552f1b3 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:25.030323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:25.107981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c617f11-6470-414f-919a-cf01f552f1b3 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:25.152514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a8376-f0a4-4aae-b802-6e1883058f4f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:25.179984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763729-480f-47f7-a5b3-d457e6beef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:25.180654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763729-480f-47f7-a5b3-d457e6beef8d None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:25.180934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763729-480f-47f7-a5b3-d457e6beef8d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:25.182092 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763729-480f-47f7-a5b3-d457e6beef8d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:25.189509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:25.198310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763729-480f-47f7-a5b3-d457e6beef8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:25.201347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763729-480f-47f7-a5b3-d457e6beef8d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-95763729-480f-47f7-a5b3-d457e6beef8d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:25.226635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:25.228095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:25.229046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:25.229046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:25.229046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:25.229046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:25.229046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:25.229046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:25.229046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:25.229046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:25.229046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:19:25.229046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:25.235105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 436/882] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Sep 1 05:19:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:25.240700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763729-480f-47f7-a5b3-d457e6beef8d None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:25.294500 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a8376-f0a4-4aae-b802-6e1883058f4f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:25.338593 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664e8ae-a774-4261-9041-33cca4dbf2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:25.339623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664e8ae-a774-4261-9041-33cca4dbf2cc None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:25.340117 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664e8ae-a774-4261-9041-33cca4dbf2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:25.340701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664e8ae-a774-4261-9041-33cca4dbf2cc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:25.341673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664e8ae-a774-4261-9041-33cca4dbf2cc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:25.343471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664e8ae-a774-4261-9041-33cca4dbf2cc None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-5664e8ae-a774-4261-9041-33cca4dbf2cc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:25.354497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:25.355622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:19:25.356496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:25.365676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 447/883] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:19:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:25.367145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664e8ae-a774-4261-9041-33cca4dbf2cc None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:25.464961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763729-480f-47f7-a5b3-d457e6beef8d None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:25.489701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:25.501680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664e8ae-a774-4261-9041-33cca4dbf2cc None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:25.504278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:25.540529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3419e-0910-4918-a1f8-aa7b213c6473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:25.542099 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3419e-0910-4918-a1f8-aa7b213c6473 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:25.542894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3419e-0910-4918-a1f8-aa7b213c6473 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:25.543631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3419e-0910-4918-a1f8-aa7b213c6473 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:25.545389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e01e0-f767-4b69-bbb6-bf58969b913a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:25.545998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3419e-0910-4918-a1f8-aa7b213c6473 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:25.546146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e01e0-f767-4b69-bbb6-bf58969b913a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:25.546282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e01e0-f767-4b69-bbb6-bf58969b913a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:25.546628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e01e0-f767-4b69-bbb6-bf58969b913a None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:25.547223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e01e0-f767-4b69-bbb6-bf58969b913a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:25.547536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e01e0-f767-4b69-bbb6-bf58969b913a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:25.548031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3419e-0910-4918-a1f8-aa7b213c6473 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:25.548995 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e01e0-f767-4b69-bbb6-bf58969b913a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:25.551260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3419e-0910-4918-a1f8-aa7b213c6473 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:25.560454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 448/884] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:19:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:25.562082 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e01e0-f767-4b69-bbb6-bf58969b913a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:25.594107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 437/885] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Sep 1 05:19:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:25.602055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3419e-0910-4918-a1f8-aa7b213c6473 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:25.697483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e01e0-f767-4b69-bbb6-bf58969b913a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:25.745235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf2a3-75f6-4f03-98e7-dba1d6aa9b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:25.745954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf2a3-75f6-4f03-98e7-dba1d6aa9b85 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:25.746340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf2a3-75f6-4f03-98e7-dba1d6aa9b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:25.746722 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf2a3-75f6-4f03-98e7-dba1d6aa9b85 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:25.747484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bf2a3-75f6-4f03-98e7-dba1d6aa9b85 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:25.747899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bf2a3-75f6-4f03-98e7-dba1d6aa9b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:25.749664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bf2a3-75f6-4f03-98e7-dba1d6aa9b85 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:25.761337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 449/886] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:19:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:25.762583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf2a3-75f6-4f03-98e7-dba1d6aa9b85 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:25.786794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:25.807661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3419e-0910-4918-a1f8-aa7b213c6473 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:25.887025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864715a-9746-4f00-9e12-0badbdbfe3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:25.889524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864715a-9746-4f00-9e12-0badbdbfe3fc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:25.890590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864715a-9746-4f00-9e12-0badbdbfe3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:25.891337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864715a-9746-4f00-9e12-0badbdbfe3fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:25.896418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf2a3-75f6-4f03-98e7-dba1d6aa9b85 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:25.943952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c805b-f4c1-44fe-abaf-7519ca03b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:25.945002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c805b-f4c1-44fe-abaf-7519ca03b587 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:25.945160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c805b-f4c1-44fe-abaf-7519ca03b587 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:25.945330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c805b-f4c1-44fe-abaf-7519ca03b587 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:25.946178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c805b-f4c1-44fe-abaf-7519ca03b587 None admin] RBAC: Adding query filter params (interface=public, service_id=3f651eb8f8f94f8aa6ce1db6a364f359, region_id=RegionOne) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:25.946565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c805b-f4c1-44fe-abaf-7519ca03b587 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:25.948136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c805b-f4c1-44fe-abaf-7519ca03b587 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:25.960185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 450/887] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Sep 1 05:19:25 2022] GET /identity/v3/endpoints?service_id=3f651eb8f8f94f8aa6ce1db6a364f359&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:25.962887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c805b-f4c1-44fe-abaf-7519ca03b587 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:26.011995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:26.078088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:26.082864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864715a-9746-4f00-9e12-0badbdbfe3fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:26.086796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864715a-9746-4f00-9e12-0badbdbfe3fc None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:26.117828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c805b-f4c1-44fe-abaf-7519ca03b587 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:26.176132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f59d97-4dc0-4d8d-99e1-879b8df433ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:26.177626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f59d97-4dc0-4d8d-99e1-879b8df433ee None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:26.178321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f59d97-4dc0-4d8d-99e1-879b8df433ee None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:26.178889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f59d97-4dc0-4d8d-99e1-879b8df433ee None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:26.179879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f59d97-4dc0-4d8d-99e1-879b8df433ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:26.181757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f59d97-4dc0-4d8d-99e1-879b8df433ee None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:26.188777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 451/888] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Sep 1 05:19:25 2022] GET /identity/v3/services => generated 1011 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:19:26.230397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 438/889] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:19:25 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:26.236827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f59d97-4dc0-4d8d-99e1-879b8df433ee None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:26.379643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f59d97-4dc0-4d8d-99e1-879b8df433ee None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:26.421187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf71a2-7b93-4fa1-aad7-9b661828b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:26.421887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf71a2-7b93-4fa1-aad7-9b661828b141 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:26.422171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf71a2-7b93-4fa1-aad7-9b661828b141 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:26.422446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf71a2-7b93-4fa1-aad7-9b661828b141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:26.436295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf71a2-7b93-4fa1-aad7-9b661828b141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:26.437858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf71a2-7b93-4fa1-aad7-9b661828b141 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:26.449130 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-2eaf71a2-7b93-4fa1-aad7-9b661828b141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:26.464357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:26.468849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:26.470362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:26.470362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:26.470362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:26.470362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 452/890] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:26.476627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864715a-9746-4f00-9e12-0badbdbfe3fc None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:26.579092 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:26.610850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864715a-9746-4f00-9e12-0badbdbfe3fc None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:26.649765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb2abd-5142-4596-8afb-0723fab78373 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:26.650143 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb2abd-5142-4596-8afb-0723fab78373 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:26.650590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb2abd-5142-4596-8afb-0723fab78373 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:26.655744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038c6d0-129a-41dd-acf5-7772e599c9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:26.656410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038c6d0-129a-41dd-acf5-7772e599c9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:26.656699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038c6d0-129a-41dd-acf5-7772e599c9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:26.657000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038c6d0-129a-41dd-acf5-7772e599c9f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:26.657547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 453/891] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:26.657766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038c6d0-129a-41dd-acf5-7772e599c9f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:26.658123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038c6d0-129a-41dd-acf5-7772e599c9f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:26.659981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038c6d0-129a-41dd-acf5-7772e599c9f3 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:26.661928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee801f-449e-4326-aab8-88b2cea81808 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:26.662524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee801f-449e-4326-aab8-88b2cea81808 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:26.663003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee801f-449e-4326-aab8-88b2cea81808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:26.676952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 439/892] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:26.682655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038c6d0-129a-41dd-acf5-7772e599c9f3 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:26.690716 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-eeee801f-449e-4326-aab8-88b2cea81808 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:26.693313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-eeee801f-449e-4326-aab8-88b2cea81808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:26.793581 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 454/893] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:26 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:26.796167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9ec9b-57e3-43ac-a4ed-1c3585043d68 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:26.797556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9ec9b-57e3-43ac-a4ed-1c3585043d68 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:26.798077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9ec9b-57e3-43ac-a4ed-1c3585043d68 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:26.809249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 455/894] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:26 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:26.810753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926633c-1ca9-49b7-9c6a-e6fbd5257599 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:26.811055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926633c-1ca9-49b7-9c6a-e6fbd5257599 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:26.811322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926633c-1ca9-49b7-9c6a-e6fbd5257599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:26.834999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038c6d0-129a-41dd-acf5-7772e599c9f3 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:26.839731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-9926633c-1ca9-49b7-9c6a-e6fbd5257599 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:26.841004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9926633c-1ca9-49b7-9c6a-e6fbd5257599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:26.899588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042edb9-862f-45c6-a31a-c5405c595051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:26.900876 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042edb9-862f-45c6-a31a-c5405c595051 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:26.901481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042edb9-862f-45c6-a31a-c5405c595051 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:26.902164 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042edb9-862f-45c6-a31a-c5405c595051 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:26.907273 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:26.919104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042edb9-862f-45c6-a31a-c5405c595051 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:26.921531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042edb9-862f-45c6-a31a-c5405c595051 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:26.943864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 456/895] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:26 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-4042edb9-862f-45c6-a31a-c5405c595051 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:26.946704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:26.947858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:26.948924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:26.948924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:26.948924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:26.948924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:26.948924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:26.948924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:26.948924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:26.948924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:26.950975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 440/896] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:26.957199 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926633c-1ca9-49b7-9c6a-e6fbd5257599 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:27.033730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:27.086433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926633c-1ca9-49b7-9c6a-e6fbd5257599 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:27.130358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f08ef-c902-4e05-84d1-062ba9d0724f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:27.131003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f08ef-c902-4e05-84d1-062ba9d0724f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:27.131274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f08ef-c902-4e05-84d1-062ba9d0724f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:27.131620 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f08ef-c902-4e05-84d1-062ba9d0724f None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:27.132368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f08ef-c902-4e05-84d1-062ba9d0724f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:27.132720 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f08ef-c902-4e05-84d1-062ba9d0724f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:27.134266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f08ef-c902-4e05-84d1-062ba9d0724f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:27.149325 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 457/897] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:27.156581 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042edb9-862f-45c6-a31a-c5405c595051 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:27.294074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f08ef-c902-4e05-84d1-062ba9d0724f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:27.294384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042edb9-862f-45c6-a31a-c5405c595051 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:27.341672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda3c93-ae2c-4f13-8be6-52c672657a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:27.342297 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda3c93-ae2c-4f13-8be6-52c672657a93 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:27.342640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda3c93-ae2c-4f13-8be6-52c672657a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:27.342916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda3c93-ae2c-4f13-8be6-52c672657a93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:27.343662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda3c93-ae2c-4f13-8be6-52c672657a93 None admin] RBAC: Adding query filter params (role.id=72ab9b883acc46cf845fa8d599a2bd45, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=eb75c0fb10484f3d80813962a4283b02) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:27.343970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda3c93-ae2c-4f13-8be6-52c672657a93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:27.345489 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda3c93-ae2c-4f13-8be6-52c672657a93 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:27.357418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 441/898] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:19:27 2022] GET /identity/v3/role_assignments?user.id=eb75c0fb10484f3d80813962a4283b02&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=72ab9b883acc46cf845fa8d599a2bd45 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:27.357418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda3c93-ae2c-4f13-8be6-52c672657a93 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:27.448210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f08ef-c902-4e05-84d1-062ba9d0724f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:27.462317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:27.486737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:27.516318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d445da0-7253-49bd-bf88-e0e43aa0a656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:27.517429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d445da0-7253-49bd-bf88-e0e43aa0a656 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:27.517963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d445da0-7253-49bd-bf88-e0e43aa0a656 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:27.519402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d445da0-7253-49bd-bf88-e0e43aa0a656 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:27.520589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d445da0-7253-49bd-bf88-e0e43aa0a656 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:27.523221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d445da0-7253-49bd-bf88-e0e43aa0a656 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:27.570954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda3c93-ae2c-4f13-8be6-52c672657a93 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:27.641493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 458/899] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:19:27 2022] POST /identity/v3/services => generated 269 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:27.649365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af636f1-9d4b-4138-8afc-ec4f1971f40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:27.650205 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af636f1-9d4b-4138-8afc-ec4f1971f40c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:27.650487 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af636f1-9d4b-4138-8afc-ec4f1971f40c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:27.650762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af636f1-9d4b-4138-8afc-ec4f1971f40c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:27.651407 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af636f1-9d4b-4138-8afc-ec4f1971f40c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:27.652984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af636f1-9d4b-4138-8afc-ec4f1971f40c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-7af636f1-9d4b-4138-8afc-ec4f1971f40c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:27.664524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:27.666478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:27.668219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 442/900] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Sep 1 05:19:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:27.676901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d445da0-7253-49bd-bf88-e0e43aa0a656 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:27.866817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d445da0-7253-49bd-bf88-e0e43aa0a656 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:27.919518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808873c8-618a-428b-a918-2f2efbd13841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:27.920220 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808873c8-618a-428b-a918-2f2efbd13841 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:27.920507 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808873c8-618a-428b-a918-2f2efbd13841 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:27.920778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808873c8-618a-428b-a918-2f2efbd13841 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:27.921563 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808873c8-618a-428b-a918-2f2efbd13841 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:27.921870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808873c8-618a-428b-a918-2f2efbd13841 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:27.923378 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808873c8-618a-428b-a918-2f2efbd13841 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:27.930124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 459/901] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Sep 1 05:19:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:27.941229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af636f1-9d4b-4138-8afc-ec4f1971f40c None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:28.163969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af636f1-9d4b-4138-8afc-ec4f1971f40c None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:28.202444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:28.235242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15680358-f95d-4a6f-b754-7caadaec7342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:28.236228 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680358-f95d-4a6f-b754-7caadaec7342 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:28.245392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680358-f95d-4a6f-b754-7caadaec7342 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:28.245392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15680358-f95d-4a6f-b754-7caadaec7342 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:28.245392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680358-f95d-4a6f-b754-7caadaec7342 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:28.245392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680358-f95d-4a6f-b754-7caadaec7342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:28.245392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15680358-f95d-4a6f-b754-7caadaec7342 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:28.250600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 443/902] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Sep 1 05:19:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:29.480571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512824d-5694-433f-be78-99e7feb97d23 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:29.481274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512824d-5694-433f-be78-99e7feb97d23 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:29.481274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512824d-5694-433f-be78-99e7feb97d23 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:29.482640 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 460/903] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:19:29.489965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f0167-6e06-4b98-964a-b1d847d5a110 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:29.491025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f0167-6e06-4b98-964a-b1d847d5a110 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:29.491501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f0167-6e06-4b98-964a-b1d847d5a110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:29.516319 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b91f0167-6e06-4b98-964a-b1d847d5a110 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:29.518076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b91f0167-6e06-4b98-964a-b1d847d5a110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:29.599601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 444/904] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:29.610223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd107ecd-94be-4003-b643-4294ed41796b None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:29.610539 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd107ecd-94be-4003-b643-4294ed41796b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:29.610779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd107ecd-94be-4003-b643-4294ed41796b None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:29.612663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 461/905] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:29.618295 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd614d72-259d-4953-a75b-a6faad62930e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:29.618880 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd614d72-259d-4953-a75b-a6faad62930e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:29.619425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd614d72-259d-4953-a75b-a6faad62930e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:29.640707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-bd614d72-259d-4953-a75b-a6faad62930e None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:29.642323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bd614d72-259d-4953-a75b-a6faad62930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:29.722341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 445/906] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:29 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:29.897053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd107ecd-94be-4003-b643-4294ed41796b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:29.973513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:30.084960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd107ecd-94be-4003-b643-4294ed41796b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:30.149700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31b59e-6c07-4de8-b563-b9b967262537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:30.150755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31b59e-6c07-4de8-b563-b9b967262537 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:30.151219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31b59e-6c07-4de8-b563-b9b967262537 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:30.151656 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31b59e-6c07-4de8-b563-b9b967262537 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:30.152702 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31b59e-6c07-4de8-b563-b9b967262537 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:30.155395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31b59e-6c07-4de8-b563-b9b967262537 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-cd31b59e-6c07-4de8-b563-b9b967262537 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:30.173188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:30.175293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:30.176951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 462/907] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:19:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:30.190948 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd614d72-259d-4953-a75b-a6faad62930e None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:30.207533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31b59e-6c07-4de8-b563-b9b967262537 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:30.253121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:30.360684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd614d72-259d-4953-a75b-a6faad62930e None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:30.381437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31b59e-6c07-4de8-b563-b9b967262537 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:30.392566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:30.422982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311e7e4-76b0-4122-8351-2cf037389ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:30.423693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311e7e4-76b0-4122-8351-2cf037389ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:30.423980 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311e7e4-76b0-4122-8351-2cf037389ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:30.424258 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311e7e4-76b0-4122-8351-2cf037389ab5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:30.434151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3314e-9921-42df-8342-26f998d29989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:30.435175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3314e-9921-42df-8342-26f998d29989 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:30.435175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3314e-9921-42df-8342-26f998d29989 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:30.435452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3314e-9921-42df-8342-26f998d29989 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:30.435965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3314e-9921-42df-8342-26f998d29989 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:30.436269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3314e-9921-42df-8342-26f998d29989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:30.437795 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3314e-9921-42df-8342-26f998d29989 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:30.439180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311e7e4-76b0-4122-8351-2cf037389ab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:19:30.444435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 446/908] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:19:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-f311e7e4-76b0-4122-8351-2cf037389ab5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:19:30.444633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:30.445573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 463/909] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Sep 1 05:19:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:30.452866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6004e45-6136-4bd8-b1f7-bb5a62526363 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:30.453777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6004e45-6136-4bd8-b1f7-bb5a62526363 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:30.453777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6004e45-6136-4bd8-b1f7-bb5a62526363 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:30.453777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 464/910] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:30.453777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6004e45-6136-4bd8-b1f7-bb5a62526363 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:30.455109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3314e-9921-42df-8342-26f998d29989 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:30.600087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3314e-9921-42df-8342-26f998d29989 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:30.616564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:30.625732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6004e45-6136-4bd8-b1f7-bb5a62526363 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:30.660554 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0c4ff-5daa-463e-b5dd-79d118aac9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:30.661191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c4ff-5daa-463e-b5dd-79d118aac9bc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:30.661531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c4ff-5daa-463e-b5dd-79d118aac9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:30.661803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c4ff-5daa-463e-b5dd-79d118aac9bc None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:30.662433 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0c4ff-5daa-463e-b5dd-79d118aac9bc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:30.662735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0c4ff-5daa-463e-b5dd-79d118aac9bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:30.664168 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0c4ff-5daa-463e-b5dd-79d118aac9bc None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:30.683961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 447/911] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Sep 1 05:19:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:30.683961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad55175-6e35-4839-8c9c-1c0861e0efd5 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:30.683961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad55175-6e35-4839-8c9c-1c0861e0efd5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:30.683961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad55175-6e35-4839-8c9c-1c0861e0efd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:30.691542 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f85cb-e0a4-4a38-a02b-54be0cde4e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:30.693883 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f85cb-e0a4-4a38-a02b-54be0cde4e9c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:30.700329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f85cb-e0a4-4a38-a02b-54be0cde4e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:30.700329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f85cb-e0a4-4a38-a02b-54be0cde4e9c None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:30.700329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f85cb-e0a4-4a38-a02b-54be0cde4e9c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:30.700329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f85cb-e0a4-4a38-a02b-54be0cde4e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:30.700329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f85cb-e0a4-4a38-a02b-54be0cde4e9c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:30.708955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-bad55175-6e35-4839-8c9c-1c0861e0efd5 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:30.711275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bad55175-6e35-4839-8c9c-1c0861e0efd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:30.717425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 465/912] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Sep 1 05:19:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:30.718340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f85cb-e0a4-4a38-a02b-54be0cde4e9c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:30.787751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:30.831599 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 448/913] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:30.832112 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad55175-6e35-4839-8c9c-1c0861e0efd5 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:30.977326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f85cb-e0a4-4a38-a02b-54be0cde4e9c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:30.994553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:31.004019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad55175-6e35-4839-8c9c-1c0861e0efd5 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:31.025662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc714b5e-aaca-438f-a744-ccdf274ef6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:31.026277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc714b5e-aaca-438f-a744-ccdf274ef6ee None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:31.026559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc714b5e-aaca-438f-a744-ccdf274ef6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:31.027049 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc714b5e-aaca-438f-a744-ccdf274ef6ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:31.027788 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc714b5e-aaca-438f-a744-ccdf274ef6ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:31.029193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc714b5e-aaca-438f-a744-ccdf274ef6ee None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:31.081708 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097f042-492b-4b90-b303-db8f2464580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:31.082819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097f042-492b-4b90-b303-db8f2464580a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:31.083265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097f042-492b-4b90-b303-db8f2464580a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:31.083550 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097f042-492b-4b90-b303-db8f2464580a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:31.098347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097f042-492b-4b90-b303-db8f2464580a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:31.101130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097f042-492b-4b90-b303-db8f2464580a None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-4097f042-492b-4b90-b303-db8f2464580a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:31.131689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:31.134788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:31.137318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:31.137318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:31.137318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:31.137318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 449/914] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:31.141322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097f042-492b-4b90-b303-db8f2464580a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:31.228987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 466/915] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:19:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:31.231429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7094a-f084-4d66-8316-71433e930386 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:31.231814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7094a-f084-4d66-8316-71433e930386 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:31.232338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7094a-f084-4d66-8316-71433e930386 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:31.234934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 467/916] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:31.239974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7094a-f084-4d66-8316-71433e930386 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:31.294447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097f042-492b-4b90-b303-db8f2464580a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:31.359347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332246fa-a798-4754-a043-dccb7d2b8b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:31.360266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332246fa-a798-4754-a043-dccb7d2b8b81 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:31.360622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332246fa-a798-4754-a043-dccb7d2b8b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:31.360977 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332246fa-a798-4754-a043-dccb7d2b8b81 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:31.362443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332246fa-a798-4754-a043-dccb7d2b8b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:31.362789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332246fa-a798-4754-a043-dccb7d2b8b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:31.364527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332246fa-a798-4754-a043-dccb7d2b8b81 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:31.391972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 450/917] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:31.399792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b509ac-7c90-4e82-b73e-e240d3f3e367 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:31.400141 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b509ac-7c90-4e82-b73e-e240d3f3e367 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:31.400402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b509ac-7c90-4e82-b73e-e240d3f3e367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:31.401487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:31.418870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7094a-f084-4d66-8316-71433e930386 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:31.421488 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-11b509ac-7c90-4e82-b73e-e240d3f3e367 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:31.422720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-11b509ac-7c90-4e82-b73e-e240d3f3e367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:31.426369 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:31.488318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e910655-e281-40fa-a987-71a17790e924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:31.490010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e910655-e281-40fa-a987-71a17790e924 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:31.490791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e910655-e281-40fa-a987-71a17790e924 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:31.491611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e910655-e281-40fa-a987-71a17790e924 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:31.492437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e910655-e281-40fa-a987-71a17790e924 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:31.494485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e910655-e281-40fa-a987-71a17790e924 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-5e910655-e281-40fa-a987-71a17790e924 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:31.511891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:31.513081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:19:31.514178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:31.514921 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 468/918] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Sep 1 05:19:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:31.521419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e910655-e281-40fa-a987-71a17790e924 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:31.558633 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 451/919] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:31.560419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b509ac-7c90-4e82-b73e-e240d3f3e367 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:31.654395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e910655-e281-40fa-a987-71a17790e924 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:31.695854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67e4dc-04dc-455e-a845-bc42ff300eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:31.696520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67e4dc-04dc-455e-a845-bc42ff300eec None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:31.696800 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67e4dc-04dc-455e-a845-bc42ff300eec None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:31.697074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67e4dc-04dc-455e-a845-bc42ff300eec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:31.706999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67e4dc-04dc-455e-a845-bc42ff300eec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:31.708525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67e4dc-04dc-455e-a845-bc42ff300eec None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-1f67e4dc-04dc-455e-a845-bc42ff300eec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:31.723260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:31.724970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:31.726847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:31.726847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:31.726847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:31.726847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:31.726847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:31.726847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:31.726847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:31.726847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:31.726847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:19:31.726847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:31.729952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 469/920] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Sep 1 05:19:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:31.731286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67e4dc-04dc-455e-a845-bc42ff300eec None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:31.745910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:31.761397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b509ac-7c90-4e82-b73e-e240d3f3e367 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:31.842388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611615d4-b760-427a-b0a4-e7cc8ae74a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:31.844980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611615d4-b760-427a-b0a4-e7cc8ae74a86 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:31.845864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611615d4-b760-427a-b0a4-e7cc8ae74a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:31.847159 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611615d4-b760-427a-b0a4-e7cc8ae74a86 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:31.848682 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611615d4-b760-427a-b0a4-e7cc8ae74a86 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:31.849580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611615d4-b760-427a-b0a4-e7cc8ae74a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:31.852078 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611615d4-b760-427a-b0a4-e7cc8ae74a86 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:31.861859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 452/921] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Sep 1 05:19:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:31.862059 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67e4dc-04dc-455e-a845-bc42ff300eec None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:31.865778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611615d4-b760-427a-b0a4-e7cc8ae74a86 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:31.868246 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:31.925483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b32e5-dbc7-4ef6-98f2-8ebb62aa3ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:31.926202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b32e5-dbc7-4ef6-98f2-8ebb62aa3ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:31.926471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b32e5-dbc7-4ef6-98f2-8ebb62aa3ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:31.927474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b32e5-dbc7-4ef6-98f2-8ebb62aa3ff8 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:31.927474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b32e5-dbc7-4ef6-98f2-8ebb62aa3ff8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:31.927762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b32e5-dbc7-4ef6-98f2-8ebb62aa3ff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:31.929241 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b32e5-dbc7-4ef6-98f2-8ebb62aa3ff8 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:31.953121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 470/922] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Sep 1 05:19:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:31.954333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b32e5-dbc7-4ef6-98f2-8ebb62aa3ff8 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:32.026182 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611615d4-b760-427a-b0a4-e7cc8ae74a86 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:32.067045 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382196c-69fa-4bc1-8a5e-7ae8fa19a6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:32.068033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382196c-69fa-4bc1-8a5e-7ae8fa19a6f3 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:32.068498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382196c-69fa-4bc1-8a5e-7ae8fa19a6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:32.068953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382196c-69fa-4bc1-8a5e-7ae8fa19a6f3 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:32.070014 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:32.070516 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382196c-69fa-4bc1-8a5e-7ae8fa19a6f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:32.072980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382196c-69fa-4bc1-8a5e-7ae8fa19a6f3 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:32.137176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b32e5-dbc7-4ef6-98f2-8ebb62aa3ff8 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:32.169464 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 453/923] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:19:31 2022] POST /identity/v3/services => generated 241 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:32.169464 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382196c-69fa-4bc1-8a5e-7ae8fa19a6f3 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:32.235854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651de90-d267-4b9c-979f-5a9dd4b07cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:32.237848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651de90-d267-4b9c-979f-5a9dd4b07cab None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:32.238347 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651de90-d267-4b9c-979f-5a9dd4b07cab None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:32.238801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651de90-d267-4b9c-979f-5a9dd4b07cab None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:32.240024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651de90-d267-4b9c-979f-5a9dd4b07cab None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:32.240515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651de90-d267-4b9c-979f-5a9dd4b07cab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:32.243802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651de90-d267-4b9c-979f-5a9dd4b07cab None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:32.252063 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 471/924] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Sep 1 05:19:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:32.263235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651de90-d267-4b9c-979f-5a9dd4b07cab None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:32.345893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:32.395575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382196c-69fa-4bc1-8a5e-7ae8fa19a6f3 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:32.423483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651de90-d267-4b9c-979f-5a9dd4b07cab None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:32.467236 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:32.477573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a8b9c-1f9d-4972-8da7-db8a5ea7fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:32.478642 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a8b9c-1f9d-4972-8da7-db8a5ea7fecf None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:32.479111 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a8b9c-1f9d-4972-8da7-db8a5ea7fecf None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:32.479561 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a8b9c-1f9d-4972-8da7-db8a5ea7fecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:32.482660 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e7085-a178-4462-8354-f0b2bdda968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:32.483855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e7085-a178-4462-8354-f0b2bdda968b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:32.484381 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e7085-a178-4462-8354-f0b2bdda968b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:32.485324 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e7085-a178-4462-8354-f0b2bdda968b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:32.486496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e7085-a178-4462-8354-f0b2bdda968b None admin] RBAC: Adding query filter params (interface=public, service_id=e8cece1c32ce4d33adbd239492f182ad, region_id=RegionOne) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:32.487089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e7085-a178-4462-8354-f0b2bdda968b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:32.489346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e7085-a178-4462-8354-f0b2bdda968b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:32.497303 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 472/925] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Sep 1 05:19:32 2022] GET /identity/v3/endpoints?service_id=e8cece1c32ce4d33adbd239492f182ad&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:32.507158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e7085-a178-4462-8354-f0b2bdda968b None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:32.508493 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a8b9c-1f9d-4972-8da7-db8a5ea7fecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:32.510153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a8b9c-1f9d-4972-8da7-db8a5ea7fecf None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-fd8a8b9c-1f9d-4972-8da7-db8a5ea7fecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:32.532245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:32.534669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:32.536435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:32.536435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:32.536435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:32.536435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 454/926] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:32.540702 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a8b9c-1f9d-4972-8da7-db8a5ea7fecf None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:32.667966 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a8b9c-1f9d-4972-8da7-db8a5ea7fecf None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:32.687727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:32.724037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e7085-a178-4462-8354-f0b2bdda968b None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:32.739950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da721b-0e86-41c7-a693-6d3adfd4f869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:32.740844 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da721b-0e86-41c7-a693-6d3adfd4f869 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:32.741323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da721b-0e86-41c7-a693-6d3adfd4f869 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:32.741855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da721b-0e86-41c7-a693-6d3adfd4f869 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:32.742692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da721b-0e86-41c7-a693-6d3adfd4f869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:32.743155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da721b-0e86-41c7-a693-6d3adfd4f869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:32.744728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da721b-0e86-41c7-a693-6d3adfd4f869 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:32.771953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 455/927] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:32.774636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da721b-0e86-41c7-a693-6d3adfd4f869 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:32.795344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16397f04-3c57-4481-9469-68e761af07a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:32.796232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16397f04-3c57-4481-9469-68e761af07a8 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:32.796667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16397f04-3c57-4481-9469-68e761af07a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:32.797122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16397f04-3c57-4481-9469-68e761af07a8 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:32.797934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16397f04-3c57-4481-9469-68e761af07a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:32.801245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16397f04-3c57-4481-9469-68e761af07a8 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:32.810550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 473/928] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Sep 1 05:19:32 2022] GET /identity/v3/services => generated 1497 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:19:33.003604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da721b-0e86-41c7-a693-6d3adfd4f869 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:33.070899 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d36e4e-d190-4228-ab7d-b465b1c5b4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:33.071994 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d36e4e-d190-4228-ab7d-b465b1c5b4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:33.072483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d36e4e-d190-4228-ab7d-b465b1c5b4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:33.072980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d36e4e-d190-4228-ab7d-b465b1c5b4b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:33.088854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d36e4e-d190-4228-ab7d-b465b1c5b4b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:33.091710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d36e4e-d190-4228-ab7d-b465b1c5b4b4 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-e6d36e4e-d190-4228-ab7d-b465b1c5b4b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:33.108432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:33.109468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:33.110379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:33.110379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:33.110379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:33.110379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:33.110379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:33.110379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:33.110379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:33.110379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:33.110379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 456/929] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:33.117946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16397f04-3c57-4481-9469-68e761af07a8 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:33.192308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:33.258226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16397f04-3c57-4481-9469-68e761af07a8 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:33.328182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcff7d-1f17-4402-9c66-b0032254942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:33.329206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcff7d-1f17-4402-9c66-b0032254942b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:33.329693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcff7d-1f17-4402-9c66-b0032254942b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:33.330131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcff7d-1f17-4402-9c66-b0032254942b None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:33.331521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcff7d-1f17-4402-9c66-b0032254942b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:33.332046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcff7d-1f17-4402-9c66-b0032254942b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:33.335100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcff7d-1f17-4402-9c66-b0032254942b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:33.360139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 474/930] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:33.366788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d36e4e-d190-4228-ab7d-b465b1c5b4b4 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:33.410982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:33.499486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d36e4e-d190-4228-ab7d-b465b1c5b4b4 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:33.511452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd30ef-7eb0-48cc-9602-24fefc7dc387 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:33.511829 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd30ef-7eb0-48cc-9602-24fefc7dc387 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:33.512311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecd30ef-7eb0-48cc-9602-24fefc7dc387 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:33.521900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 475/931] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:33.524692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a42b5-dde9-4626-b805-3da911180ca3 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:33.525167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a42b5-dde9-4626-b805-3da911180ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:33.525738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a42b5-dde9-4626-b805-3da911180ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:33.547753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b7a0b-c382-45b0-87f6-1b40bce75972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:33.548457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b7a0b-c382-45b0-87f6-1b40bce75972 None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:33.548800 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b7a0b-c382-45b0-87f6-1b40bce75972 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:33.549086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b7a0b-c382-45b0-87f6-1b40bce75972 None admin] PATH_INFO: `/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/eb75c0fb10484f3d80813962a4283b02/roles/72ab9b883acc46cf845fa8d599a2bd45` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:33.552600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b7a0b-c382-45b0-87f6-1b40bce75972 None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c3fe9229c45f1bfd295115ef94cd7, user_id=eb75c0fb10484f3d80813962a4283b02, role_id=72ab9b883acc46cf845fa8d599a2bd45)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:33.555237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b7a0b-c382-45b0-87f6-1b40bce75972 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:33.567395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-1d4a42b5-dde9-4626-b805-3da911180ca3 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:33.569000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1d4a42b5-dde9-4626-b805-3da911180ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:33.660296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 476/932] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:33.709565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 457/933] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:19:33 2022] PUT /identity/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/eb75c0fb10484f3d80813962a4283b02/roles/72ab9b883acc46cf845fa8d599a2bd45 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:19:34.132717 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a42b5-dde9-4626-b805-3da911180ca3 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:34.230076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:34.346986 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a42b5-dde9-4626-b805-3da911180ca3 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:34.412489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228afdd5-2bdf-4952-962d-2ae47452a28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:34.413286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228afdd5-2bdf-4952-962d-2ae47452a28d None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:34.413737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228afdd5-2bdf-4952-962d-2ae47452a28d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:34.414187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228afdd5-2bdf-4952-962d-2ae47452a28d None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:34.415212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228afdd5-2bdf-4952-962d-2ae47452a28d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:34.417867 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228afdd5-2bdf-4952-962d-2ae47452a28d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:34.422419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: WARNING keystone.server.flask.common [None req-228afdd5-2bdf-4952-962d-2ae47452a28d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 05:19:34.495543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.sql.core [None req-228afdd5-2bdf-4952-962d-2ae47452a28d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 05:19:34.495543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 05:19:34.495543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [parameters: {'id': 'ef2d123c5ca14e4281b1249a7455b9a7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 05:19:34.495543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81757) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-228afdd5-2bdf-4952-962d-2ae47452a28d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ef2d123c5ca14e4281b1249a7455b9a7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ef2d123c5ca14e4281b1249a7455b9a7. Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application conn.query(q) Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 05:19:34.506860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result.read() Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 05:19:34.515158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application next(self.gen) Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application yield resource Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application next(self.gen) Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise self.value Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application session.commit() Sep 01 05:19:34.519181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.session.flush() Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application compat.raise_( Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 05:19:34.522181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 05:19:34.525214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application conn.query(q) Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result.read() Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 05:19:34.533288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [parameters: {'id': 'ef2d123c5ca14e4281b1249a7455b9a7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:34.535582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:34.537460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:34.539670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:34.539670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 05:19:34.539670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 05:19:34.539670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:34.539670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:34.539670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 05:19:34.539670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 05:19:34.539670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ef2d123c5ca14e4281b1249a7455b9a7. Sep 01 05:19:34.539670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:34.539670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 477/934] 10.222.0.48 () {60 vars in 1140 bytes} [Thu Sep 1 05:19:34 2022] POST /identity/v3/projects => generated 262 bytes in 380 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:34.540928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b7a0b-c382-45b0-87f6-1b40bce75972 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:34.718053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:34.721658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b7a0b-c382-45b0-87f6-1b40bce75972 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:34.766396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0968786-bb7c-4a31-9f62-20c51a4cd291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:34.767063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0968786-bb7c-4a31-9f62-20c51a4cd291 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:34.767352 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0968786-bb7c-4a31-9f62-20c51a4cd291 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:34.767629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0968786-bb7c-4a31-9f62-20c51a4cd291 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:34.776137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0968786-bb7c-4a31-9f62-20c51a4cd291 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:34.777823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0968786-bb7c-4a31-9f62-20c51a4cd291 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-c0968786-bb7c-4a31-9f62-20c51a4cd291 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:34.792394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:34.794229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:34.796123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:34.796123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:34.796123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:34.796123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:34.796123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:34.796123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:34.796123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:34.796123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:34.796123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 458/935] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:34.804644 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228afdd5-2bdf-4952-962d-2ae47452a28d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:34.871325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70743404-284e-4b4b-b6f0-862dbe780cb0 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:34.871781 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70743404-284e-4b4b-b6f0-862dbe780cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:34.872271 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70743404-284e-4b4b-b6f0-862dbe780cb0 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:34.875757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 459/936] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:34.881904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a55a-871b-4fe6-9f25-c3faaec08c1f None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:34.882309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a55a-871b-4fe6-9f25-c3faaec08c1f None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:34.882582 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36a55a-871b-4fe6-9f25-c3faaec08c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:34.902986 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ea36a55a-871b-4fe6-9f25-c3faaec08c1f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:34.904087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ea36a55a-871b-4fe6-9f25-c3faaec08c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:34.976588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:34.980722 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228afdd5-2bdf-4952-962d-2ae47452a28d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:35.009917 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 460/937] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:35.013172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d890cd-1bc5-4ede-b89e-0eae7892fc56 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:35.013710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d890cd-1bc5-4ede-b89e-0eae7892fc56 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:35.014288 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d890cd-1bc5-4ede-b89e-0eae7892fc56 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:35.017318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 461/938] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:35.023528 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85885bb-d1ae-4004-92da-1636574488ce None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:35.023797 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85885bb-d1ae-4004-92da-1636574488ce None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:35.024109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85885bb-d1ae-4004-92da-1636574488ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:35.043911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b3bf1-afb5-455d-847c-b05c145c06f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:35.045187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a85885bb-d1ae-4004-92da-1636574488ce None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:35.056784 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b3bf1-afb5-455d-847c-b05c145c06f3 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:35.056784 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b3bf1-afb5-455d-847c-b05c145c06f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:35.057142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a85885bb-d1ae-4004-92da-1636574488ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:35.057491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b3bf1-afb5-455d-847c-b05c145c06f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:35.057491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b3bf1-afb5-455d-847c-b05c145c06f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:35.057491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b3bf1-afb5-455d-847c-b05c145c06f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:35.057491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b3bf1-afb5-455d-847c-b05c145c06f3 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:35.085416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 478/939] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:19:34 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:35.148740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 462/940] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:35.288509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b3bf1-afb5-455d-847c-b05c145c06f3 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:35.458956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85885bb-d1ae-4004-92da-1636574488ce None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:35.462480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b3bf1-afb5-455d-847c-b05c145c06f3 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:35.484416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:35.527843 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751ea4-e1d6-44b9-8d98-abedfa4f2d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:35.528884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751ea4-e1d6-44b9-8d98-abedfa4f2d2a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:35.529453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751ea4-e1d6-44b9-8d98-abedfa4f2d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:35.530617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751ea4-e1d6-44b9-8d98-abedfa4f2d2a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:35.531774 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751ea4-e1d6-44b9-8d98-abedfa4f2d2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:35.535279 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751ea4-e1d6-44b9-8d98-abedfa4f2d2a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-73751ea4-e1d6-44b9-8d98-abedfa4f2d2a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:35.548006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:35.549149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 05:19:35.550210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:35.554553 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 479/941] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Sep 1 05:19:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:35.556126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751ea4-e1d6-44b9-8d98-abedfa4f2d2a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:35.597340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:35.615972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85885bb-d1ae-4004-92da-1636574488ce None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:35.661865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772053d-8cf7-4844-ba02-7839c985c026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:35.662552 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772053d-8cf7-4844-ba02-7839c985c026 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:35.662832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772053d-8cf7-4844-ba02-7839c985c026 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:35.663085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772053d-8cf7-4844-ba02-7839c985c026 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:35.663687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772053d-8cf7-4844-ba02-7839c985c026 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:35.665364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772053d-8cf7-4844-ba02-7839c985c026 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-9772053d-8cf7-4844-ba02-7839c985c026 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:35.677704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:35.679659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:35.681344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:35.684341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 463/942] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Sep 1 05:19:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:35.685556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772053d-8cf7-4844-ba02-7839c985c026 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:35.769778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751ea4-e1d6-44b9-8d98-abedfa4f2d2a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:35.796374 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:35.826923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772053d-8cf7-4844-ba02-7839c985c026 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:35.843377 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2eff1-8921-4be2-9270-3557d2f74730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:35.844761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2eff1-8921-4be2-9270-3557d2f74730 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:35.845490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2eff1-8921-4be2-9270-3557d2f74730 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:35.846806 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2eff1-8921-4be2-9270-3557d2f74730 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:35.850192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2eff1-8921-4be2-9270-3557d2f74730 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:35.850738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2eff1-8921-4be2-9270-3557d2f74730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:35.853647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2eff1-8921-4be2-9270-3557d2f74730 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:35.869464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 480/943] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Sep 1 05:19:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:35.872779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2eff1-8921-4be2-9270-3557d2f74730 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:35.886352 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51694-5f3c-4ba9-a953-71bef5fcc360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:35.887939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51694-5f3c-4ba9-a953-71bef5fcc360 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:35.888693 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51694-5f3c-4ba9-a953-71bef5fcc360 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:35.889490 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a51694-5f3c-4ba9-a953-71bef5fcc360 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:35.891020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a51694-5f3c-4ba9-a953-71bef5fcc360 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:35.891854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a51694-5f3c-4ba9-a953-71bef5fcc360 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:35.895522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a51694-5f3c-4ba9-a953-71bef5fcc360 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:35.905972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 464/944] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Sep 1 05:19:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:35.912008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51694-5f3c-4ba9-a953-71bef5fcc360 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:36.060085 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:36.067332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a51694-5f3c-4ba9-a953-71bef5fcc360 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:36.089753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2eff1-8921-4be2-9270-3557d2f74730 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:36.112983 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d57e94-f118-4595-b631-9c5af21198b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:36.113312 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d57e94-f118-4595-b631-9c5af21198b6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:36.113635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d57e94-f118-4595-b631-9c5af21198b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:36.113798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d57e94-f118-4595-b631-9c5af21198b6 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:36.114392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d57e94-f118-4595-b631-9c5af21198b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:36.114698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d57e94-f118-4595-b631-9c5af21198b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:36.116646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d57e94-f118-4595-b631-9c5af21198b6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:36.123017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 465/945] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Sep 1 05:19:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:36.135282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d57e94-f118-4595-b631-9c5af21198b6 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:36.150265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:36.161432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48d841-ed5f-4d7b-8dfd-1c8e368c6f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:36.163103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48d841-ed5f-4d7b-8dfd-1c8e368c6f16 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:36.163103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48d841-ed5f-4d7b-8dfd-1c8e368c6f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:36.163103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48d841-ed5f-4d7b-8dfd-1c8e368c6f16 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:36.163512 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48d841-ed5f-4d7b-8dfd-1c8e368c6f16 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:36.163512 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48d841-ed5f-4d7b-8dfd-1c8e368c6f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:36.164973 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c48d841-ed5f-4d7b-8dfd-1c8e368c6f16 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:36.177744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 481/946] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Sep 1 05:19:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:36.179201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48d841-ed5f-4d7b-8dfd-1c8e368c6f16 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:36.298351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48d841-ed5f-4d7b-8dfd-1c8e368c6f16 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:36.339120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed6495-255d-4d74-94d9-e156c2eeaa36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:36.339932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed6495-255d-4d74-94d9-e156c2eeaa36 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:36.340173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed6495-255d-4d74-94d9-e156c2eeaa36 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:36.340516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed6495-255d-4d74-94d9-e156c2eeaa36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:36.341266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed6495-255d-4d74-94d9-e156c2eeaa36 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:36.342804 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed6495-255d-4d74-94d9-e156c2eeaa36 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:36.367513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d57e94-f118-4595-b631-9c5af21198b6 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:36.408503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd5608-137f-48cb-ac9e-c82198d86add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:36.409669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd5608-137f-48cb-ac9e-c82198d86add None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:36.409951 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd5608-137f-48cb-ac9e-c82198d86add None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:36.410224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd5608-137f-48cb-ac9e-c82198d86add None admin] PATH_INFO: `/v3/endpoints` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:36.411150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd5608-137f-48cb-ac9e-c82198d86add None admin] RBAC: Adding query filter params (interface=public, service_id=43777cca3d41473cb22267d340caa205, region_id=RegionOne) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:36.411507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd5608-137f-48cb-ac9e-c82198d86add None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:36.412959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd5608-137f-48cb-ac9e-c82198d86add None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:36.419204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 466/947] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Sep 1 05:19:36 2022] GET /identity/v3/endpoints?service_id=43777cca3d41473cb22267d340caa205&interface=public®ion_id=RegionOne => generated 194 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:36.425073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd5608-137f-48cb-ac9e-c82198d86add None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:36.507675 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:36.543360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd5608-137f-48cb-ac9e-c82198d86add None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:36.581548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 482/948] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:19:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:36.601080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f8b04-c506-46ec-82df-a5812dfd0472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:36.602320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f8b04-c506-46ec-82df-a5812dfd0472 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:36.606107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f8b04-c506-46ec-82df-a5812dfd0472 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:36.606107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f8b04-c506-46ec-82df-a5812dfd0472 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:36.606107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f8b04-c506-46ec-82df-a5812dfd0472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:36.607075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f8b04-c506-46ec-82df-a5812dfd0472 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:36.620661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 467/949] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Sep 1 05:19:36 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:19:36.655741 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac878ec-6e3a-4f08-92bf-1133b508b0c4 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:36.656187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac878ec-6e3a-4f08-92bf-1133b508b0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:36.656667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac878ec-6e3a-4f08-92bf-1133b508b0c4 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:36.659960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 483/950] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:36.668664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad8d09-665b-4a03-8d60-c05f20ea6d4c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:36.669028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad8d09-665b-4a03-8d60-c05f20ea6d4c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:36.669232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad8d09-665b-4a03-8d60-c05f20ea6d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:36.692867 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-c4ad8d09-665b-4a03-8d60-c05f20ea6d4c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:36.694219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c4ad8d09-665b-4a03-8d60-c05f20ea6d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:36.785363 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 468/951] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:37.089068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac878ec-6e3a-4f08-92bf-1133b508b0c4 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:37.104228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:37.233211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac878ec-6e3a-4f08-92bf-1133b508b0c4 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:37.275621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebabd7-3ae9-4bd2-aa76-b5c5ebd6ece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:37.276396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebabd7-3ae9-4bd2-aa76-b5c5ebd6ece9 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:37.276683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebabd7-3ae9-4bd2-aa76-b5c5ebd6ece9 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:37.277037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebabd7-3ae9-4bd2-aa76-b5c5ebd6ece9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:37.290686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebabd7-3ae9-4bd2-aa76-b5c5ebd6ece9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-e9ebabd7-3ae9-4bd2-aa76-b5c5ebd6ece9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:19:37.298602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:37.300700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:37.301638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:37.301638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:37.301638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:37.301638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:37.301638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:19:37.301638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:19:37.301638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:19:37.301638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:19:37.301638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:19:37.301638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:19:37.301638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:19:37.301638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:37.302333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 484/952] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Sep 1 05:19:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:37.309261 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad8d09-665b-4a03-8d60-c05f20ea6d4c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:37.420331 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:37.509818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad8d09-665b-4a03-8d60-c05f20ea6d4c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:37.591603 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada08823-df64-4741-ac71-5ff08018a9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:37.592707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08823-df64-4741-ac71-5ff08018a9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:37.593533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08823-df64-4741-ac71-5ff08018a9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:37.594023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada08823-df64-4741-ac71-5ff08018a9e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:37.595240 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada08823-df64-4741-ac71-5ff08018a9e9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:37.596343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada08823-df64-4741-ac71-5ff08018a9e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:37.600397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada08823-df64-4741-ac71-5ff08018a9e9 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:37.615427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 469/953] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Sep 1 05:19:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:37.625085 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebabd7-3ae9-4bd2-aa76-b5c5ebd6ece9 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:37.636674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c878445-ed08-474c-9df6-a1ce7de0e1f1 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:37.637594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c878445-ed08-474c-9df6-a1ce7de0e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:37.637594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c878445-ed08-474c-9df6-a1ce7de0e1f1 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:37.644409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 470/954] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:19:37.647911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920fc7a-a204-4a88-a876-02c51adef531 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:37.648177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920fc7a-a204-4a88-a876-02c51adef531 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:37.648525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920fc7a-a204-4a88-a876-02c51adef531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:37.672455 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-3920fc7a-a204-4a88-a876-02c51adef531 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:37.673304 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3920fc7a-a204-4a88-a876-02c51adef531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:37.758682 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 471/955] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:37.780160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:37.826204 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebabd7-3ae9-4bd2-aa76-b5c5ebd6ece9 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:37.878121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e84a2-f57a-4f27-b272-ed441edf3cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:37.879240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e84a2-f57a-4f27-b272-ed441edf3cd5 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:37.879726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e84a2-f57a-4f27-b272-ed441edf3cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:37.880231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e84a2-f57a-4f27-b272-ed441edf3cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:37.904607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e84a2-f57a-4f27-b272-ed441edf3cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:37.907428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e84a2-f57a-4f27-b272-ed441edf3cd5 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-a01e84a2-f57a-4f27-b272-ed441edf3cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:37.938432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:37.939442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:37.940692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:37.940692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:37.940692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:37.940935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 485/956] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:37.950789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920fc7a-a204-4a88-a876-02c51adef531 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:38.029519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:38.050605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e84a2-f57a-4f27-b272-ed441edf3cd5 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:38.092209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920fc7a-a204-4a88-a876-02c51adef531 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:38.169413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78e384-251c-44a1-9594-226313b583ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:38.170491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78e384-251c-44a1-9594-226313b583ed None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:38.170976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78e384-251c-44a1-9594-226313b583ed None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:38.171457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78e384-251c-44a1-9594-226313b583ed None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:38.172711 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78e384-251c-44a1-9594-226313b583ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:38.173444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78e384-251c-44a1-9594-226313b583ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:38.177245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78e384-251c-44a1-9594-226313b583ed None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:38.200772 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 472/957] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:38.202007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78e384-251c-44a1-9594-226313b583ed None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:38.222576 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e84a2-f57a-4f27-b272-ed441edf3cd5 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:38.256648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:38.279464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d08ec-1631-4446-9838-7dc0d0fbdee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:38.281038 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d08ec-1631-4446-9838-7dc0d0fbdee3 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:38.281578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d08ec-1631-4446-9838-7dc0d0fbdee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:38.282320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d08ec-1631-4446-9838-7dc0d0fbdee3 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:38.283196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d08ec-1631-4446-9838-7dc0d0fbdee3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:38.285133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d08ec-1631-4446-9838-7dc0d0fbdee3 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:38.341175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78e384-251c-44a1-9594-226313b583ed None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:38.357837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:38.364875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.sql.core [None req-dd0d08ec-1631-4446-9838-7dc0d0fbdee3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 05:19:38.364875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 05:19:38.364875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [parameters: {'user_id': '2fb13f4b83ae48c198cfcb2f0e97e35b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 05:19:38.364875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81757) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-dd0d08ec-1631-4446-9838-7dc0d0fbdee3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application conn.query(q) Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result.read() Sep 01 05:19:38.377731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 05:19:38.378971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application next(self.gen) Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application yield resource Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application next(self.gen) Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise self.value Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application session.commit() Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 05:19:38.380135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.session.flush() Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application compat.raise_( Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 05:19:38.381131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 05:19:38.383545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application conn.query(q) Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application result.read() Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 05:19:38.386736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [parameters: {'user_id': '2fb13f4b83ae48c198cfcb2f0e97e35b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:38.389145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 05:19:38.391577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 05:19:38.394848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 05:19:38.394848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 05:19:38.394848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 05:19:38.394848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 05:19:38.394848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 05:19:38.394848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:38.394848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 486/958] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Sep 1 05:19:38 2022] POST /identity/v3/users => generated 160 bytes in 336 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:38.396254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10b1ac-1012-4728-af9d-628e564eef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:38.396254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10b1ac-1012-4728-af9d-628e564eef37 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:38.396254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10b1ac-1012-4728-af9d-628e564eef37 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:38.396254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10b1ac-1012-4728-af9d-628e564eef37 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:38.396869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d08ec-1631-4446-9838-7dc0d0fbdee3 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:38.405850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10b1ac-1012-4728-af9d-628e564eef37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:38.409297 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10b1ac-1012-4728-af9d-628e564eef37 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-9e10b1ac-1012-4728-af9d-628e564eef37 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:38.428450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:38.429700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:38.430637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:38.430637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:38.430637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:38.430637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:38.430637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:38.430637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:38.430637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:38.430637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:38.430637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 05:19:38.430637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:38.431209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 473/959] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Sep 1 05:19:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:38.438354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10b1ac-1012-4728-af9d-628e564eef37 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:38.531290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d08ec-1631-4446-9838-7dc0d0fbdee3 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:38.565089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10b1ac-1012-4728-af9d-628e564eef37 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:38.574536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034377af-801e-46c6-aabb-970f40d70c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:38.575558 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034377af-801e-46c6-aabb-970f40d70c23 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:38.576087 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034377af-801e-46c6-aabb-970f40d70c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:38.576582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034377af-801e-46c6-aabb-970f40d70c23 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:38.586644 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034377af-801e-46c6-aabb-970f40d70c23 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:38.588846 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034377af-801e-46c6-aabb-970f40d70c23 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-034377af-801e-46c6-aabb-970f40d70c23 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:38.603139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:38.604183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:38.605140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:38.605140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:38.605140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:38.605140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:38.605140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:38.605140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:38.605140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:38.605140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:38.605140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 05:19:38.605140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:38.608265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 487/960] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:19:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:38.609925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abfc2b-b32b-4ede-a742-d60a2a2282e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:38.610568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abfc2b-b32b-4ede-a742-d60a2a2282e5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:38.610852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abfc2b-b32b-4ede-a742-d60a2a2282e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:38.611129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86abfc2b-b32b-4ede-a742-d60a2a2282e5 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:38.612420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abfc2b-b32b-4ede-a742-d60a2a2282e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:38.612675 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abfc2b-b32b-4ede-a742-d60a2a2282e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:38.614307 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86abfc2b-b32b-4ede-a742-d60a2a2282e5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:38.614778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034377af-801e-46c6-aabb-970f40d70c23 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:38.641427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 474/961] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Sep 1 05:19:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:38.643355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abfc2b-b32b-4ede-a742-d60a2a2282e5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:38.684213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:38.695432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:38.776445 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034377af-801e-46c6-aabb-970f40d70c23 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:38.805798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86abfc2b-b32b-4ede-a742-d60a2a2282e5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:38.832724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd51e4-5375-45c4-a521-af77afc57f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:38.833417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd51e4-5375-45c4-a521-af77afc57f62 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:38.833705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd51e4-5375-45c4-a521-af77afc57f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:38.833985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd51e4-5375-45c4-a521-af77afc57f62 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:38.835316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd51e4-5375-45c4-a521-af77afc57f62 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:38.835630 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd51e4-5375-45c4-a521-af77afc57f62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:38.837561 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd51e4-5375-45c4-a521-af77afc57f62 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:38.878015 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360e03b-5b3e-49f6-9df6-d468e3b29c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:38.878768 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360e03b-5b3e-49f6-9df6-d468e3b29c06 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:38.879056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360e03b-5b3e-49f6-9df6-d468e3b29c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:38.879337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360e03b-5b3e-49f6-9df6-d468e3b29c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:38.906307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 488/962] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Sep 1 05:19:38 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:38.987547 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360e03b-5b3e-49f6-9df6-d468e3b29c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:38.989498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360e03b-5b3e-49f6-9df6-d468e3b29c06 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:39.030082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:39.110968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2a3f1-6151-4e49-a023-2a3d0615a26f None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:39.111365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2a3f1-6151-4e49-a023-2a3d0615a26f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:39.111611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2a3f1-6151-4e49-a023-2a3d0615a26f None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:39.114607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 489/963] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:19:39.123022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ea592-a13d-4f45-a515-e9b375ed3113 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:39.123330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ea592-a13d-4f45-a515-e9b375ed3113 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:39.124091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ea592-a13d-4f45-a515-e9b375ed3113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:39.132555 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 475/964] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:19:38 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:39.138989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360e03b-5b3e-49f6-9df6-d468e3b29c06 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:39.150769 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-8a4ea592-a13d-4f45-a515-e9b375ed3113 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:39.152442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8a4ea592-a13d-4f45-a515-e9b375ed3113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:39.242796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 490/965] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:39.271949 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360e03b-5b3e-49f6-9df6-d468e3b29c06 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:39.307341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:39.313886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3052f-ace8-4052-bdde-6ca90a3a5bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:39.315071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3052f-ace8-4052-bdde-6ca90a3a5bcc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:39.315395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3052f-ace8-4052-bdde-6ca90a3a5bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:39.315729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3052f-ace8-4052-bdde-6ca90a3a5bcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:39.328431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3052f-ace8-4052-bdde-6ca90a3a5bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:39.332336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3052f-ace8-4052-bdde-6ca90a3a5bcc None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-30d3052f-ace8-4052-bdde-6ca90a3a5bcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:39.347722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:39.348740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:39.354704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:39.354704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:39.354704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:39.354704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 476/966] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:39.355058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ea592-a13d-4f45-a515-e9b375ed3113 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:39.391711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:39.438919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5d6df-e0e1-439f-886d-0ee5ab753aec None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:39.439432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5d6df-e0e1-439f-886d-0ee5ab753aec None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:39.440600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5d6df-e0e1-439f-886d-0ee5ab753aec None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:39.443214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 477/967] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:39.451410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ede15d-21e7-4022-b748-3444b051a07d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:39.451795 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ede15d-21e7-4022-b748-3444b051a07d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:39.452135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ede15d-21e7-4022-b748-3444b051a07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:39.474632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b8ede15d-21e7-4022-b748-3444b051a07d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:39.475874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b8ede15d-21e7-4022-b748-3444b051a07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:39.506697 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ea592-a13d-4f45-a515-e9b375ed3113 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:39.553434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b3c3e-8e8d-4157-9b09-00bbf21446ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:39.554072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3c3e-8e8d-4157-9b09-00bbf21446ea None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:39.554365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3c3e-8e8d-4157-9b09-00bbf21446ea None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:39.554642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3c3e-8e8d-4157-9b09-00bbf21446ea None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:39.555384 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b3c3e-8e8d-4157-9b09-00bbf21446ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:39.555692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b3c3e-8e8d-4157-9b09-00bbf21446ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:39.557204 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7b3c3e-8e8d-4157-9b09-00bbf21446ea None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:39.570440 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 491/968] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:39.571331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b3c3e-8e8d-4157-9b09-00bbf21446ea None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:39.575266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 478/969] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:39.579476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ede15d-21e7-4022-b748-3444b051a07d None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:39.748234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:39.763149 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ede15d-21e7-4022-b748-3444b051a07d None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:39.765902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b3c3e-8e8d-4157-9b09-00bbf21446ea None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:39.792568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:39.828206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7656cf-958a-4a1b-9c3c-35cd3f0b0e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:39.829325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7656cf-958a-4a1b-9c3c-35cd3f0b0e4c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:39.829943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7656cf-958a-4a1b-9c3c-35cd3f0b0e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:39.830524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7656cf-958a-4a1b-9c3c-35cd3f0b0e4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:39.830729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bdd19-af47-4402-98eb-c426e2809c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:39.831577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bdd19-af47-4402-98eb-c426e2809c39 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:39.831863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bdd19-af47-4402-98eb-c426e2809c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:39.832138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bdd19-af47-4402-98eb-c426e2809c39 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:39.832744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bdd19-af47-4402-98eb-c426e2809c39 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:39.834247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bdd19-af47-4402-98eb-c426e2809c39 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-1b4bdd19-af47-4402-98eb-c426e2809c39 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:39.845364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:39.847868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:19:39.850229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:39.854031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7656cf-958a-4a1b-9c3c-35cd3f0b0e4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:39.854031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7656cf-958a-4a1b-9c3c-35cd3f0b0e4c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:39.854624 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 492/970] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:39.854624 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bdd19-af47-4402-98eb-c426e2809c39 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-8b7656cf-958a-4a1b-9c3c-35cd3f0b0e4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:39.875121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:39.876346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:39.877858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:39.877858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:39.877858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:39.877858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:39.877858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:39.877858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:39.877858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:39.877858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:39.878342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 479/971] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:39.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7656cf-958a-4a1b-9c3c-35cd3f0b0e4c None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:40.014544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7656cf-958a-4a1b-9c3c-35cd3f0b0e4c None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:40.015654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bdd19-af47-4402-98eb-c426e2809c39 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:40.065823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980a280-cb3a-41f2-aa75-b1d26c9bc2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:40.066479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980a280-cb3a-41f2-aa75-b1d26c9bc2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:40.066848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980a280-cb3a-41f2-aa75-b1d26c9bc2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:40.067141 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980a280-cb3a-41f2-aa75-b1d26c9bc2e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:40.067673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980a280-cb3a-41f2-aa75-b1d26c9bc2e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:40.069067 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980a280-cb3a-41f2-aa75-b1d26c9bc2e5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:40.069240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc0e04-43df-4495-844f-5b6c25675372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:40.069818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc0e04-43df-4495-844f-5b6c25675372 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:40.070130 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc0e04-43df-4495-844f-5b6c25675372 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:40.070409 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc0e04-43df-4495-844f-5b6c25675372 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:40.071065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc0e04-43df-4495-844f-5b6c25675372 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:40.071370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc0e04-43df-4495-844f-5b6c25675372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:40.072822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc0e04-43df-4495-844f-5b6c25675372 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:40.078687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 493/972] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:19:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-e980a280-cb3a-41f2-aa75-b1d26c9bc2e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:40.079126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:40.081759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:40.084073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:40.086050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc0e04-43df-4495-844f-5b6c25675372 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:40.086328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 480/973] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Sep 1 05:19:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:40.087750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980a280-cb3a-41f2-aa75-b1d26c9bc2e5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:40.116750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:40.128099 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:40.215627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980a280-cb3a-41f2-aa75-b1d26c9bc2e5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:40.260280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5005-55b1-421a-927f-5fb85f46ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:40.261002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5005-55b1-421a-927f-5fb85f46ad4d None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:40.261333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5005-55b1-421a-927f-5fb85f46ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:40.261748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d5005-55b1-421a-927f-5fb85f46ad4d None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:40.262510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d5005-55b1-421a-927f-5fb85f46ad4d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:40.262963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d5005-55b1-421a-927f-5fb85f46ad4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:40.264720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d5005-55b1-421a-927f-5fb85f46ad4d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:40.271823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc0e04-43df-4495-844f-5b6c25675372 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:40.280300 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 481/974] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Sep 1 05:19:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:40.280300 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5005-55b1-421a-927f-5fb85f46ad4d None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:40.317354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5f2c-afd0-4a31-91a9-485284783a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:40.318418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5f2c-afd0-4a31-91a9-485284783a72 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:40.318855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5f2c-afd0-4a31-91a9-485284783a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:40.319298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd5f2c-afd0-4a31-91a9-485284783a72 None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:40.320469 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd5f2c-afd0-4a31-91a9-485284783a72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:40.320973 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd5f2c-afd0-4a31-91a9-485284783a72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:40.323567 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecd5f2c-afd0-4a31-91a9-485284783a72 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:40.338891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 494/975] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:40.339790 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5f2c-afd0-4a31-91a9-485284783a72 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:40.438452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:40.444910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d5005-55b1-421a-927f-5fb85f46ad4d None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:40.464880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:40.496661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3ae26-a5f0-4949-958d-c10cd12cd980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:40.497697 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ae26-a5f0-4949-958d-c10cd12cd980 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:40.498122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ae26-a5f0-4949-958d-c10cd12cd980 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:40.498566 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ae26-a5f0-4949-958d-c10cd12cd980 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:40.499618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3ae26-a5f0-4949-958d-c10cd12cd980 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:40.500103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3ae26-a5f0-4949-958d-c10cd12cd980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:40.503387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3ae26-a5f0-4949-958d-c10cd12cd980 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:40.503981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd5f2c-afd0-4a31-91a9-485284783a72 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:40.517229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 482/976] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:19:40 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:40.517229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3ae26-a5f0-4949-958d-c10cd12cd980 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:40.570578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569255c-dfd1-4323-9274-a83acc74f9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:40.571597 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569255c-dfd1-4323-9274-a83acc74f9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:40.572055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569255c-dfd1-4323-9274-a83acc74f9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:40.572478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569255c-dfd1-4323-9274-a83acc74f9f5 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:40.573511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569255c-dfd1-4323-9274-a83acc74f9f5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:40.574004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569255c-dfd1-4323-9274-a83acc74f9f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:40.576103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569255c-dfd1-4323-9274-a83acc74f9f5 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:40.586918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 495/977] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Sep 1 05:19:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:40.595599 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569255c-dfd1-4323-9274-a83acc74f9f5 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:40.691638 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3ae26-a5f0-4949-958d-c10cd12cd980 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:40.744519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae525e-76f2-47ee-8dbb-4bd83fc8169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:40.745321 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae525e-76f2-47ee-8dbb-4bd83fc8169b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:40.746499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae525e-76f2-47ee-8dbb-4bd83fc8169b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:40.746912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae525e-76f2-47ee-8dbb-4bd83fc8169b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:40.747799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae525e-76f2-47ee-8dbb-4bd83fc8169b None admin] RBAC: Adding query filter params (role.id=72ab9b883acc46cf845fa8d599a2bd45, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=eb75c0fb10484f3d80813962a4283b02) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:40.748238 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae525e-76f2-47ee-8dbb-4bd83fc8169b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:40.750700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae525e-76f2-47ee-8dbb-4bd83fc8169b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:40.766368 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 483/978] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:19:40 2022] GET /identity/v3/role_assignments?user.id=eb75c0fb10484f3d80813962a4283b02&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=72ab9b883acc46cf845fa8d599a2bd45 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:40.795713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569255c-dfd1-4323-9274-a83acc74f9f5 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:40.845293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2180745-23e2-434f-af20-dc5654193dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:40.846683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2180745-23e2-434f-af20-dc5654193dfe None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:40.847095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2180745-23e2-434f-af20-dc5654193dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:40.847520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2180745-23e2-434f-af20-dc5654193dfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:40.848481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2180745-23e2-434f-af20-dc5654193dfe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:40.850201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2180745-23e2-434f-af20-dc5654193dfe None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:41.005641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:41.014758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 496/979] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:19:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:19:42.712137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab937c-ba1f-45e0-bc80-e125bbc11eed None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:42.713008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab937c-ba1f-45e0-bc80-e125bbc11eed None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:42.713008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab937c-ba1f-45e0-bc80-e125bbc11eed None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:42.717430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 484/980] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:42.723750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf8a5f-fee0-4872-8ce2-17eb226384c5 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:42.724311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf8a5f-fee0-4872-8ce2-17eb226384c5 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:42.724820 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf8a5f-fee0-4872-8ce2-17eb226384c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:42.757203 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-bdaf8a5f-fee0-4872-8ce2-17eb226384c5 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:42.759516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-bdaf8a5f-fee0-4872-8ce2-17eb226384c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:42.905332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 497/981] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:43.178942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab937c-ba1f-45e0-bc80-e125bbc11eed None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:43.185458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107932a-1487-486b-9c87-7f3bffabf606 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:43.185756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107932a-1487-486b-9c87-7f3bffabf606 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:43.186120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107932a-1487-486b-9c87-7f3bffabf606 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:43.187780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 498/982] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:19:43.193337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1fd70-39e4-4a24-a704-9182c7e96016 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:43.193743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1fd70-39e4-4a24-a704-9182c7e96016 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:43.193925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc1fd70-39e4-4a24-a704-9182c7e96016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:43.214643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:43.219012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-1cc1fd70-39e4-4a24-a704-9182c7e96016 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:43.220259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1cc1fd70-39e4-4a24-a704-9182c7e96016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:43.316135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 499/983] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:43.324205 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab937c-ba1f-45e0-bc80-e125bbc11eed None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:43.372168 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81765f79-5579-41e3-b11f-d74585dfb0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:43.373066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81765f79-5579-41e3-b11f-d74585dfb0ad None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:43.373536 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81765f79-5579-41e3-b11f-d74585dfb0ad None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:43.373958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81765f79-5579-41e3-b11f-d74585dfb0ad None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:43.374841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81765f79-5579-41e3-b11f-d74585dfb0ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:43.376468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81765f79-5579-41e3-b11f-d74585dfb0ad None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:43.471622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 485/984] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:19:43 2022] POST /identity/v3/services => generated 242 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:19:43.547919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc3fb-055e-4ad4-a314-be185595a646 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:43.548417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc3fb-055e-4ad4-a314-be185595a646 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:43.548941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bc3fb-055e-4ad4-a314-be185595a646 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:43.551811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 500/985] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:43.560583 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9109565-cf70-48f4-a33b-e92c4ab023f5 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:43.561044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9109565-cf70-48f4-a33b-e92c4ab023f5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:43.561545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9109565-cf70-48f4-a33b-e92c4ab023f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:43.595021 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-e9109565-cf70-48f4-a33b-e92c4ab023f5 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:43.598651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e9109565-cf70-48f4-a33b-e92c4ab023f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:43.600750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bc3fb-055e-4ad4-a314-be185595a646 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:43.694613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:43.740885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 486/986] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:43.767538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bc3fb-055e-4ad4-a314-be185595a646 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:43.811171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838cb39-7b36-4022-ac3c-980f149f2c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:43.811910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838cb39-7b36-4022-ac3c-980f149f2c98 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:43.812194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838cb39-7b36-4022-ac3c-980f149f2c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:43.812468 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838cb39-7b36-4022-ac3c-980f149f2c98 None admin] PATH_INFO: `/v3/services/image` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:43.813074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838cb39-7b36-4022-ac3c-980f149f2c98 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:43.815415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838cb39-7b36-4022-ac3c-980f149f2c98 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-1838cb39-7b36-4022-ac3c-980f149f2c98 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:43.829875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:43.831170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:19:43.832121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:43.833485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 501/987] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Sep 1 05:19:43 2022] GET /identity/v3/services/image => generated 86 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:43.842402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9109565-cf70-48f4-a33b-e92c4ab023f5 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:43.873309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:44.046125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9109565-cf70-48f4-a33b-e92c4ab023f5 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:44.093494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ee031-3ce8-492b-9800-9f3119623fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:44.094545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ee031-3ce8-492b-9800-9f3119623fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:44.100113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ee031-3ce8-492b-9800-9f3119623fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:44.100113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ee031-3ce8-492b-9800-9f3119623fd9 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:44.100113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ee031-3ce8-492b-9800-9f3119623fd9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:44.100113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ee031-3ce8-492b-9800-9f3119623fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:44.100113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ee031-3ce8-492b-9800-9f3119623fd9 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:44.117714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 487/988] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:44.121124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838cb39-7b36-4022-ac3c-980f149f2c98 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:44.139018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ee031-3ce8-492b-9800-9f3119623fd9 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:44.245881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:44.272125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838cb39-7b36-4022-ac3c-980f149f2c98 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:44.274999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ee031-3ce8-492b-9800-9f3119623fd9 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:44.295882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:44.319030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adf85b-f0fc-4fa9-8ce4-1ba530ee0c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:44.319615 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adf85b-f0fc-4fa9-8ce4-1ba530ee0c9c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:44.319893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adf85b-f0fc-4fa9-8ce4-1ba530ee0c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:44.320003 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be9ac6-4bc3-409f-8aa8-99cad41e2f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:44.320197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adf85b-f0fc-4fa9-8ce4-1ba530ee0c9c None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:44.320634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be9ac6-4bc3-409f-8aa8-99cad41e2f29 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:44.320893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adf85b-f0fc-4fa9-8ce4-1ba530ee0c9c None admin] RBAC: Adding query filter params (type=image) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:44.320990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be9ac6-4bc3-409f-8aa8-99cad41e2f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:44.321220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be9ac6-4bc3-409f-8aa8-99cad41e2f29 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:44.321323 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adf85b-f0fc-4fa9-8ce4-1ba530ee0c9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:44.321884 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be9ac6-4bc3-409f-8aa8-99cad41e2f29 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:44.323198 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adf85b-f0fc-4fa9-8ce4-1ba530ee0c9c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:44.323402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be9ac6-4bc3-409f-8aa8-99cad41e2f29 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:44.329232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 502/989] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:44 2022] GET /identity/v3/services?type=image => generated 122 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-53be9ac6-4bc3-409f-8aa8-99cad41e2f29 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:44.334276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:44.336520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:44.338879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:44.341561 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 488/990] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Sep 1 05:19:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:44.349187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adf85b-f0fc-4fa9-8ce4-1ba530ee0c9c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:44.477517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adf85b-f0fc-4fa9-8ce4-1ba530ee0c9c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:44.526168 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1aeafd-e85f-4ee4-8c75-37e3a096a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:44.526829 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1aeafd-e85f-4ee4-8c75-37e3a096a954 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:44.527105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1aeafd-e85f-4ee4-8c75-37e3a096a954 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:44.527357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1aeafd-e85f-4ee4-8c75-37e3a096a954 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:44.528014 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1aeafd-e85f-4ee4-8c75-37e3a096a954 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:44.528320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1aeafd-e85f-4ee4-8c75-37e3a096a954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:44.529783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1aeafd-e85f-4ee4-8c75-37e3a096a954 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:44.536131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 503/991] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Sep 1 05:19:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:44.542743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be9ac6-4bc3-409f-8aa8-99cad41e2f29 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:44.710289 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be9ac6-4bc3-409f-8aa8-99cad41e2f29 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:44.789765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf643a8-83d9-4b80-80fd-2bba1187e0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:44.790677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf643a8-83d9-4b80-80fd-2bba1187e0df None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:44.790677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf643a8-83d9-4b80-80fd-2bba1187e0df None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:44.790914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf643a8-83d9-4b80-80fd-2bba1187e0df None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:44.791565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf643a8-83d9-4b80-80fd-2bba1187e0df None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:44.791987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf643a8-83d9-4b80-80fd-2bba1187e0df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:44.793341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf643a8-83d9-4b80-80fd-2bba1187e0df None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:44.800782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 489/992] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Sep 1 05:19:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:44.806616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1aeafd-e85f-4ee4-8c75-37e3a096a954 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:44.869061 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:44.971172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1aeafd-e85f-4ee4-8c75-37e3a096a954 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:45.030268 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589dc4d-912a-4007-9cca-31f65d578ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:45.031393 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589dc4d-912a-4007-9cca-31f65d578ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:45.031954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589dc4d-912a-4007-9cca-31f65d578ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:45.032399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589dc4d-912a-4007-9cca-31f65d578ad1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:45.035022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589dc4d-912a-4007-9cca-31f65d578ad1 None admin] RBAC: Adding query filter params (interface=admin, service_id=43777cca3d41473cb22267d340caa205, region_id=RegionOne) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:45.035596 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589dc4d-912a-4007-9cca-31f65d578ad1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:45.038209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589dc4d-912a-4007-9cca-31f65d578ad1 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:45.053359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 504/993] 10.222.0.48 () {56 vars in 1249 bytes} [Thu Sep 1 05:19:44 2022] GET /identity/v3/endpoints?service_id=43777cca3d41473cb22267d340caa205&interface=admin®ion_id=RegionOne => generated 193 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:45.055022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf643a8-83d9-4b80-80fd-2bba1187e0df None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:45.073874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:45.219558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf643a8-83d9-4b80-80fd-2bba1187e0df None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:45.270919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8018c98c-4032-48d3-949c-36a394635216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:45.271462 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c98c-4032-48d3-949c-36a394635216 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:45.271779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c98c-4032-48d3-949c-36a394635216 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:45.272049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8018c98c-4032-48d3-949c-36a394635216 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:45.272682 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018c98c-4032-48d3-949c-36a394635216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:45.274146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8018c98c-4032-48d3-949c-36a394635216 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:45.281779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 490/994] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Sep 1 05:19:45 2022] GET /identity/v3/services => generated 1727 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:19:46.031462 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8fbc6-d594-46c5-960f-b9bb0c52c2ca None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:46.032259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8fbc6-d594-46c5-960f-b9bb0c52c2ca None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:46.032657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8fbc6-d594-46c5-960f-b9bb0c52c2ca None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:46.035933 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 505/995] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:46.044964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec245bf4-c9be-437a-8738-8cac74f73bd1 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:46.045543 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec245bf4-c9be-437a-8738-8cac74f73bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:46.045995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec245bf4-c9be-437a-8738-8cac74f73bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:46.078169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ec245bf4-c9be-437a-8738-8cac74f73bd1 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:46.080289 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ec245bf4-c9be-437a-8738-8cac74f73bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:46.205632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:46.217428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 491/996] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:46.511240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213499a4-2673-4138-a788-01364a28f255 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:46.511756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213499a4-2673-4138-a788-01364a28f255 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:46.512066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213499a4-2673-4138-a788-01364a28f255 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:46.513613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 506/997] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:46.520036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c90ff3-1790-4dc4-8312-ea231a5d6284 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:46.520377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c90ff3-1790-4dc4-8312-ea231a5d6284 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:46.520590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c90ff3-1790-4dc4-8312-ea231a5d6284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:46.523425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213499a4-2673-4138-a788-01364a28f255 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:46.542183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-36c90ff3-1790-4dc4-8312-ea231a5d6284 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:46.543413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-36c90ff3-1790-4dc4-8312-ea231a5d6284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:46.634416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 492/998] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:46.682106 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213499a4-2673-4138-a788-01364a28f255 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:46.704253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:46.757598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3205d-9291-451f-a160-223f1ce3cbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:46.758680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3205d-9291-451f-a160-223f1ce3cbfe None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:46.759183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3205d-9291-451f-a160-223f1ce3cbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:46.759675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3205d-9291-451f-a160-223f1ce3cbfe None admin] PATH_INFO: `/v3/services/compute` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:46.760914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3205d-9291-451f-a160-223f1ce3cbfe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:46.763144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3205d-9291-451f-a160-223f1ce3cbfe None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-85f3205d-9291-451f-a160-223f1ce3cbfe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:46.779661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:46.780762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:46.783458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 507/999] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:46.788848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c90ff3-1790-4dc4-8312-ea231a5d6284 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:46.916746 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3205d-9291-451f-a160-223f1ce3cbfe None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:46.981309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c90ff3-1790-4dc4-8312-ea231a5d6284 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:47.042900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:47.051634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9eaca7-80f6-474d-9602-dd70f75648e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:47.052643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eaca7-80f6-474d-9602-dd70f75648e1 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:47.052643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eaca7-80f6-474d-9602-dd70f75648e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:47.052940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9eaca7-80f6-474d-9602-dd70f75648e1 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:47.057838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9eaca7-80f6-474d-9602-dd70f75648e1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:47.057838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9eaca7-80f6-474d-9602-dd70f75648e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:47.057838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9eaca7-80f6-474d-9602-dd70f75648e1 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:47.064909 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 493/1000] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:19:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:47.070163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9eaca7-80f6-474d-9602-dd70f75648e1 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:47.089178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3205d-9291-451f-a160-223f1ce3cbfe None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:47.154869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfc3a5-4c47-4852-83e1-f09abcc3d0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:47.155895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfc3a5-4c47-4852-83e1-f09abcc3d0af None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:47.156357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfc3a5-4c47-4852-83e1-f09abcc3d0af None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:47.156818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfc3a5-4c47-4852-83e1-f09abcc3d0af None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:47.158277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfc3a5-4c47-4852-83e1-f09abcc3d0af None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:47.159535 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfc3a5-4c47-4852-83e1-f09abcc3d0af None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:47.223646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9eaca7-80f6-474d-9602-dd70f75648e1 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:47.263132 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f140bbf-2f2f-471f-b7d4-d3e6858492c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:47.263804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f140bbf-2f2f-471f-b7d4-d3e6858492c3 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:47.264085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f140bbf-2f2f-471f-b7d4-d3e6858492c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:47.264377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f140bbf-2f2f-471f-b7d4-d3e6858492c3 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:47.265072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f140bbf-2f2f-471f-b7d4-d3e6858492c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:47.265426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f140bbf-2f2f-471f-b7d4-d3e6858492c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:47.266913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f140bbf-2f2f-471f-b7d4-d3e6858492c3 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:47.273594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 494/1001] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:19:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:47.279797 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f140bbf-2f2f-471f-b7d4-d3e6858492c3 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:47.311109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 508/1002] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:19:46 2022] POST /identity/v3/services => generated 242 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:19:47.387892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:47.469756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f140bbf-2f2f-471f-b7d4-d3e6858492c3 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:47.547621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1b502-8c29-48bb-abed-52de86c3add8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:47.547877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1b502-8c29-48bb-abed-52de86c3add8 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:47.548556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1b502-8c29-48bb-abed-52de86c3add8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:47.550214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1b502-8c29-48bb-abed-52de86c3add8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:47.550753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1b502-8c29-48bb-abed-52de86c3add8 None admin] RBAC: Adding query filter params (interface=public, service_id=e1acc5bc19e14d53b73937d54fb9b5ab, region_id=RegionOne) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:47.551799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1b502-8c29-48bb-abed-52de86c3add8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:47.552874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1b502-8c29-48bb-abed-52de86c3add8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:47.558632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797cc64-f484-4303-8ee9-2e9ab7fe31f7 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:47.558947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797cc64-f484-4303-8ee9-2e9ab7fe31f7 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:47.559254 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797cc64-f484-4303-8ee9-2e9ab7fe31f7 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:47.560305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 495/1003] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Sep 1 05:19:47 2022] GET /identity/v3/endpoints?service_id=e1acc5bc19e14d53b73937d54fb9b5ab&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:47.561356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 509/1004] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:47.566997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1b502-8c29-48bb-abed-52de86c3add8 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:47.568183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea120e4-837c-4418-b8d7-c9805b90150b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:47.568470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea120e4-837c-4418-b8d7-c9805b90150b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:47.568937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea120e4-837c-4418-b8d7-c9805b90150b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:47.601053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5ea120e4-837c-4418-b8d7-c9805b90150b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:47.602444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5ea120e4-837c-4418-b8d7-c9805b90150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:47.635236 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:47.689884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 510/1005] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:47 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:47.757206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1b502-8c29-48bb-abed-52de86c3add8 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:47.785864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:47.819824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8368b8d-9e60-437f-b58c-cc47107b4c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:47.820876 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8368b8d-9e60-437f-b58c-cc47107b4c91 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:47.821398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8368b8d-9e60-437f-b58c-cc47107b4c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:47.821902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8368b8d-9e60-437f-b58c-cc47107b4c91 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:47.823041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8368b8d-9e60-437f-b58c-cc47107b4c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:47.825848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8368b8d-9e60-437f-b58c-cc47107b4c91 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:47.845494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 496/1006] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Sep 1 05:19:47 2022] GET /identity/v3/services => generated 1957 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:19:47.968308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea120e4-837c-4418-b8d7-c9805b90150b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:48.124298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea120e4-837c-4418-b8d7-c9805b90150b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:48.197152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823045b-4240-4c84-8176-2aa454fbba01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:48.197983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823045b-4240-4c84-8176-2aa454fbba01 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:48.198421 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823045b-4240-4c84-8176-2aa454fbba01 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:48.198578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823045b-4240-4c84-8176-2aa454fbba01 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:48.199212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823045b-4240-4c84-8176-2aa454fbba01 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:48.200862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823045b-4240-4c84-8176-2aa454fbba01 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-d823045b-4240-4c84-8176-2aa454fbba01 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:48.211614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:48.218365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:48.223534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 511/1007] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Sep 1 05:19:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:48.227448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8368b8d-9e60-437f-b58c-cc47107b4c91 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:48.347452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8368b8d-9e60-437f-b58c-cc47107b4c91 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:48.415185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b07c67-2f3b-4a3f-a476-e25863c3b8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:48.416145 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b07c67-2f3b-4a3f-a476-e25863c3b8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:48.416655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b07c67-2f3b-4a3f-a476-e25863c3b8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:48.417187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b07c67-2f3b-4a3f-a476-e25863c3b8a8 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:48.418302 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b07c67-2f3b-4a3f-a476-e25863c3b8a8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:48.418866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b07c67-2f3b-4a3f-a476-e25863c3b8a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:48.421057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b07c67-2f3b-4a3f-a476-e25863c3b8a8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:48.437212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 497/1008] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Sep 1 05:19:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:48.438828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823045b-4240-4c84-8176-2aa454fbba01 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:48.479788 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:48.586765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823045b-4240-4c84-8176-2aa454fbba01 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:48.634842 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebbf81-3677-406d-b285-2428997b6995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:48.635636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebbf81-3677-406d-b285-2428997b6995 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:48.636028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebbf81-3677-406d-b285-2428997b6995 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:48.636397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebbf81-3677-406d-b285-2428997b6995 None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:48.637146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebbf81-3677-406d-b285-2428997b6995 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:48.637576 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebbf81-3677-406d-b285-2428997b6995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:48.639128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebbf81-3677-406d-b285-2428997b6995 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:48.645811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 512/1009] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Sep 1 05:19:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:48.654587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b07c67-2f3b-4a3f-a476-e25863c3b8a8 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:48.735059 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:48.854230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b07c67-2f3b-4a3f-a476-e25863c3b8a8 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:48.935669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc690c0-e312-4d17-93b1-8a4f2affa5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:48.936723 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc690c0-e312-4d17-93b1-8a4f2affa5f1 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:48.937227 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc690c0-e312-4d17-93b1-8a4f2affa5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:48.937763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc690c0-e312-4d17-93b1-8a4f2affa5f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:48.939630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc690c0-e312-4d17-93b1-8a4f2affa5f1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:48.942569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc690c0-e312-4d17-93b1-8a4f2affa5f1 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:49.131611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 498/1010] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:19:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:49.950603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84831a6-007c-4c4d-a43b-350c755fd519 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:49.951979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84831a6-007c-4c4d-a43b-350c755fd519 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:49.952458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84831a6-007c-4c4d-a43b-350c755fd519 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:49.956001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 513/1011] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:49.962606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ee13d-6b60-487b-934c-a93b5f79cc13 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:49.963144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ee13d-6b60-487b-934c-a93b5f79cc13 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:49.963144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ee13d-6b60-487b-934c-a93b5f79cc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:49.983288 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-e48ee13d-6b60-487b-934c-a93b5f79cc13 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:49.984551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e48ee13d-6b60-487b-934c-a93b5f79cc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:50.085064 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 499/1012] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:49 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:50.232208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefc7db-d3cc-45aa-b7f5-16a295dbcc0e None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:50.232551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefc7db-d3cc-45aa-b7f5-16a295dbcc0e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:50.232750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefc7db-d3cc-45aa-b7f5-16a295dbcc0e None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:50.234340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 514/1013] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:50.241192 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd259f-b6f2-49ca-9bd9-7450be726f8f None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:50.241686 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd259f-b6f2-49ca-9bd9-7450be726f8f None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:50.242100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd259f-b6f2-49ca-9bd9-7450be726f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:50.267924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-14dd259f-b6f2-49ca-9bd9-7450be726f8f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:50.270120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-14dd259f-b6f2-49ca-9bd9-7450be726f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:50.327967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:50.398681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 500/1014] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:50 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:50.402877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefc7db-d3cc-45aa-b7f5-16a295dbcc0e None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:50.583587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:50.601967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefc7db-d3cc-45aa-b7f5-16a295dbcc0e None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:50.665721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586eed93-fbec-4816-a81c-a024c3f9bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:50.666291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eed93-fbec-4816-a81c-a024c3f9bf7e None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:50.666572 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eed93-fbec-4816-a81c-a024c3f9bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:50.666845 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eed93-fbec-4816-a81c-a024c3f9bf7e None admin] PATH_INFO: `/v3/services/image` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:50.667445 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586eed93-fbec-4816-a81c-a024c3f9bf7e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:50.668855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586eed93-fbec-4816-a81c-a024c3f9bf7e None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-586eed93-fbec-4816-a81c-a024c3f9bf7e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:50.679826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:50.681041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:50.686674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 515/1015] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Sep 1 05:19:50 2022] GET /identity/v3/services/image => generated 86 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:50.687599 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd259f-b6f2-49ca-9bd9-7450be726f8f None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:50.713467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586eed93-fbec-4816-a81c-a024c3f9bf7e None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:50.806329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd259f-b6f2-49ca-9bd9-7450be726f8f None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:50.843703 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586eed93-fbec-4816-a81c-a024c3f9bf7e None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:50.863199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75602762-f189-40d1-b359-6a7cdc57e610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:50.864887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75602762-f189-40d1-b359-6a7cdc57e610 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:50.865293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75602762-f189-40d1-b359-6a7cdc57e610 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:50.865824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75602762-f189-40d1-b359-6a7cdc57e610 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:50.867033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75602762-f189-40d1-b359-6a7cdc57e610 None admin] RBAC: Adding query filter params (name=image) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:50.867588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75602762-f189-40d1-b359-6a7cdc57e610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:50.870278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75602762-f189-40d1-b359-6a7cdc57e610 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:50.885515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 501/1016] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:50.892900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75602762-f189-40d1-b359-6a7cdc57e610 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:50.895443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb09766-ffa9-4d74-8c76-cf97691ec1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:50.896108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb09766-ffa9-4d74-8c76-cf97691ec1ca None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:50.896380 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb09766-ffa9-4d74-8c76-cf97691ec1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:50.896648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb09766-ffa9-4d74-8c76-cf97691ec1ca None admin] PATH_INFO: `/v3/services/compute` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:50.897247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb09766-ffa9-4d74-8c76-cf97691ec1ca None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:50.898688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb09766-ffa9-4d74-8c76-cf97691ec1ca None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-ecb09766-ffa9-4d74-8c76-cf97691ec1ca None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:50.910071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:50.912084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 05:19:50.913991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:50.916761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 516/1017] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:50.919447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb09766-ffa9-4d74-8c76-cf97691ec1ca None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:50.951564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:50.971333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:51.058818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75602762-f189-40d1-b359-6a7cdc57e610 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:51.110937 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0403a84-5c49-4a13-87f3-372497408fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:51.111908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0403a84-5c49-4a13-87f3-372497408fbd None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:51.112211 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0403a84-5c49-4a13-87f3-372497408fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:51.112755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0403a84-5c49-4a13-87f3-372497408fbd None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:51.113196 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0403a84-5c49-4a13-87f3-372497408fbd None admin] RBAC: Adding query filter params (type=image) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:51.113750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0403a84-5c49-4a13-87f3-372497408fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:51.116592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0403a84-5c49-4a13-87f3-372497408fbd None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:51.117722 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb09766-ffa9-4d74-8c76-cf97691ec1ca None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:51.131761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 502/1018] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:51.133183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0403a84-5c49-4a13-87f3-372497408fbd None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:51.182086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c344d33-4604-4c4d-9795-68fb4ed2901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:51.183043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c344d33-4604-4c4d-9795-68fb4ed2901d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:51.183565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c344d33-4604-4c4d-9795-68fb4ed2901d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:51.184002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c344d33-4604-4c4d-9795-68fb4ed2901d None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:51.185168 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c344d33-4604-4c4d-9795-68fb4ed2901d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:51.185761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c344d33-4604-4c4d-9795-68fb4ed2901d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:51.188402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c344d33-4604-4c4d-9795-68fb4ed2901d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:51.199950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 517/1019] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:19:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:51.208755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c344d33-4604-4c4d-9795-68fb4ed2901d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:51.266342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:51.277082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0403a84-5c49-4a13-87f3-372497408fbd None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:51.317323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99ecf0-85d2-4a19-b630-619157a59758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:51.318141 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99ecf0-85d2-4a19-b630-619157a59758 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:51.318570 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99ecf0-85d2-4a19-b630-619157a59758 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:51.318934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99ecf0-85d2-4a19-b630-619157a59758 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:51.319862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99ecf0-85d2-4a19-b630-619157a59758 None admin] RBAC: Adding query filter params (interface=public, service_id=200d2d5a2c414837a4fa5d10d9f63c16, region_id=RegionOne) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:51.320270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99ecf0-85d2-4a19-b630-619157a59758 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:51.322208 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99ecf0-85d2-4a19-b630-619157a59758 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:51.329107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 503/1020] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Sep 1 05:19:51 2022] GET /identity/v3/endpoints?service_id=200d2d5a2c414837a4fa5d10d9f63c16&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:51.331516 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d866-4c76-4b1a-ad0d-dd8d6093abb6 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:51.332022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d866-4c76-4b1a-ad0d-dd8d6093abb6 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:51.332528 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d866-4c76-4b1a-ad0d-dd8d6093abb6 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:51.335455 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 504/1021] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:51.338053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2d866-4c76-4b1a-ad0d-dd8d6093abb6 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:51.353889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:51.378504 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c344d33-4604-4c4d-9795-68fb4ed2901d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:51.419930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941660d8-6d3d-46bd-826d-59535ac657be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:51.420693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941660d8-6d3d-46bd-826d-59535ac657be None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:51.420977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941660d8-6d3d-46bd-826d-59535ac657be None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:51.421296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941660d8-6d3d-46bd-826d-59535ac657be None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:51.421990 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941660d8-6d3d-46bd-826d-59535ac657be None admin] RBAC: Adding query filter params (type=compute) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:51.422297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941660d8-6d3d-46bd-826d-59535ac657be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:51.424112 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941660d8-6d3d-46bd-826d-59535ac657be None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:51.430031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 518/1022] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Sep 1 05:19:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:51.430031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28d9a-3542-4c6d-aef7-3ece7692ff47 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:51.430031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28d9a-3542-4c6d-aef7-3ece7692ff47 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:51.430031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28d9a-3542-4c6d-aef7-3ece7692ff47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:51.453587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-f2d28d9a-3542-4c6d-aef7-3ece7692ff47 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:51.455292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f2d28d9a-3542-4c6d-aef7-3ece7692ff47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:51.458566 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2d866-4c76-4b1a-ad0d-dd8d6093abb6 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:51.506851 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8101186-b3e3-49b8-a93a-912ba18410ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:51.507472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8101186-b3e3-49b8-a93a-912ba18410ef None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:51.507746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8101186-b3e3-49b8-a93a-912ba18410ef None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:51.508026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8101186-b3e3-49b8-a93a-912ba18410ef None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:51.508645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8101186-b3e3-49b8-a93a-912ba18410ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:51.510085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8101186-b3e3-49b8-a93a-912ba18410ef None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:51.517776 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 505/1023] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Sep 1 05:19:51 2022] GET /identity/v3/services => generated 1957 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:19:51.518645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8101186-b3e3-49b8-a93a-912ba18410ef None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:51.549166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:51.549796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 519/1024] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:51 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:51.661509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8101186-b3e3-49b8-a93a-912ba18410ef None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:51.716032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f2716-dd39-480f-a361-b51c61a378d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:51.716897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f2716-dd39-480f-a361-b51c61a378d8 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:51.717232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f2716-dd39-480f-a361-b51c61a378d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:51.717560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f2716-dd39-480f-a361-b51c61a378d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:51.718244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f2716-dd39-480f-a361-b51c61a378d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:51.719752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f2716-dd39-480f-a361-b51c61a378d8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:51.870594 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d28d9a-3542-4c6d-aef7-3ece7692ff47 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:51.881671 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 506/1025] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:19:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:51.976223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:52.004587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d28d9a-3542-4c6d-aef7-3ece7692ff47 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:52.065163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697432f3-8198-41de-9770-418279de76e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:52.066701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697432f3-8198-41de-9770-418279de76e1 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:52.067283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697432f3-8198-41de-9770-418279de76e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:52.067807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697432f3-8198-41de-9770-418279de76e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:52.069302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697432f3-8198-41de-9770-418279de76e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:52.071140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697432f3-8198-41de-9770-418279de76e1 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:52.073472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 520/1026] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:52.080658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f2716-dd39-480f-a361-b51c61a378d8 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:52.190149 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:52.233738 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f2716-dd39-480f-a361-b51c61a378d8 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:52.278919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779cd01-0f2d-4983-86de-a55119de680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:52.279542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779cd01-0f2d-4983-86de-a55119de680e None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:52.279820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779cd01-0f2d-4983-86de-a55119de680e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:52.280094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779cd01-0f2d-4983-86de-a55119de680e None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:52.280745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779cd01-0f2d-4983-86de-a55119de680e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:52.282227 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779cd01-0f2d-4983-86de-a55119de680e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:52.425402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 507/1027] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:19:52 2022] POST /identity/v3/projects => generated 311 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:54.020264 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37816d89-84d9-41bf-b7c8-f561ea413930 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:54.020803 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37816d89-84d9-41bf-b7c8-f561ea413930 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:54.021183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37816d89-84d9-41bf-b7c8-f561ea413930 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:54.023979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 521/1028] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:54.033121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40ba8-1aa4-46b5-b54e-352f8656c0ec None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:54.033712 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40ba8-1aa4-46b5-b54e-352f8656c0ec None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:54.034099 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e40ba8-1aa4-46b5-b54e-352f8656c0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:54.063479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-61e40ba8-1aa4-46b5-b54e-352f8656c0ec None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:54.066277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-61e40ba8-1aa4-46b5-b54e-352f8656c0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:54.156997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 508/1029] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:54.467057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321ea2-dc5d-40da-b717-795af20c6728 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:54.467237 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321ea2-dc5d-40da-b717-795af20c6728 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:54.467523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321ea2-dc5d-40da-b717-795af20c6728 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:54.469069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 522/1030] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:19:54.474577 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e80215-0ae6-4a73-a5f0-d665ce6f2c9c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:54.474868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e80215-0ae6-4a73-a5f0-d665ce6f2c9c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:54.475153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e80215-0ae6-4a73-a5f0-d665ce6f2c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:54.499396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-14e80215-0ae6-4a73-a5f0-d665ce6f2c9c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:54.500664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-14e80215-0ae6-4a73-a5f0-d665ce6f2c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:54.561054 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08321ea2-dc5d-40da-b717-795af20c6728 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:54.569482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:54.600990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 509/1031] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:19:54.717619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08321ea2-dc5d-40da-b717-795af20c6728 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:54.761795 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58059a-0072-408a-8671-52e924aafa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:54.762485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58059a-0072-408a-8671-52e924aafa79 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:54.762856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58059a-0072-408a-8671-52e924aafa79 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:54.763132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58059a-0072-408a-8671-52e924aafa79 None admin] PATH_INFO: `/v3/services/image` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:54.763726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58059a-0072-408a-8671-52e924aafa79 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:54.765194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58059a-0072-408a-8671-52e924aafa79 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-0d58059a-0072-408a-8671-52e924aafa79 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:54.776474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:54.782026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:54.783534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 523/1032] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Sep 1 05:19:54 2022] GET /identity/v3/services/image => generated 86 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:54.787680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e80215-0ae6-4a73-a5f0-d665ce6f2c9c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:54.893744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58059a-0072-408a-8671-52e924aafa79 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:54.912980 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:54.950325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e80215-0ae6-4a73-a5f0-d665ce6f2c9c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:54.997531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abf7d5-fcd7-45c1-9001-0d76a7bceb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:54.998053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abf7d5-fcd7-45c1-9001-0d76a7bceb07 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:54.998372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abf7d5-fcd7-45c1-9001-0d76a7bceb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:54.998662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abf7d5-fcd7-45c1-9001-0d76a7bceb07 None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:54.999311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abf7d5-fcd7-45c1-9001-0d76a7bceb07 None admin] RBAC: Adding query filter params (name=image) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:54.999620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abf7d5-fcd7-45c1-9001-0d76a7bceb07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:55.001739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abf7d5-fcd7-45c1-9001-0d76a7bceb07 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:55.011128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 510/1033] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:55.018310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abf7d5-fcd7-45c1-9001-0d76a7bceb07 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:55.101447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58059a-0072-408a-8671-52e924aafa79 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:55.107710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:55.151669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62abbf-7b94-42eb-a1d7-19d5d1c62e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:55.152392 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62abbf-7b94-42eb-a1d7-19d5d1c62e58 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:55.152677 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62abbf-7b94-42eb-a1d7-19d5d1c62e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:55.152974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62abbf-7b94-42eb-a1d7-19d5d1c62e58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:55.167500 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62abbf-7b94-42eb-a1d7-19d5d1c62e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-0e62abbf-7b94-42eb-a1d7-19d5d1c62e58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:19:55.172712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:55.175045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:55.176358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:55.176358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:55.176358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:55.176358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:55.176358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:19:55.176358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:19:55.176358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:19:55.176358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:19:55.176358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:19:55.176358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:19:55.176358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:19:55.176358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:55.180202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 524/1034] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Sep 1 05:19:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:55.181063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abf7d5-fcd7-45c1-9001-0d76a7bceb07 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:55.181233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62abbf-7b94-42eb-a1d7-19d5d1c62e58 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:55.248520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d02238-cbf7-4690-abcd-71ea66ce20fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:55.249063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d02238-cbf7-4690-abcd-71ea66ce20fc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:55.249346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d02238-cbf7-4690-abcd-71ea66ce20fc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:55.249701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d02238-cbf7-4690-abcd-71ea66ce20fc None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:55.250399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d02238-cbf7-4690-abcd-71ea66ce20fc None admin] RBAC: Adding query filter params (type=image) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:55.250705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d02238-cbf7-4690-abcd-71ea66ce20fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:55.252454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d02238-cbf7-4690-abcd-71ea66ce20fc None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:55.259351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 511/1035] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:55.265322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d02238-cbf7-4690-abcd-71ea66ce20fc None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:55.276337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:55.323788 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62abbf-7b94-42eb-a1d7-19d5d1c62e58 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:55.381027 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274bae4-4a64-4136-940a-5ac243525936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:55.381788 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274bae4-4a64-4136-940a-5ac243525936 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:55.382064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274bae4-4a64-4136-940a-5ac243525936 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:55.382342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274bae4-4a64-4136-940a-5ac243525936 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:55.383418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274bae4-4a64-4136-940a-5ac243525936 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:55.383418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274bae4-4a64-4136-940a-5ac243525936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:55.384747 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274bae4-4a64-4136-940a-5ac243525936 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:55.395065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 525/1036] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Sep 1 05:19:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:55.396476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386a73-7837-442d-8b50-1543062c0d61 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:55.396843 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386a73-7837-442d-8b50-1543062c0d61 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:55.397011 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386a73-7837-442d-8b50-1543062c0d61 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:55.398888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 526/1037] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:19:55.401715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d02238-cbf7-4690-abcd-71ea66ce20fc None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:55.404598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea52d0b-f8c4-4b0a-b4bf-f3e943a9bac0 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:55.404890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea52d0b-f8c4-4b0a-b4bf-f3e943a9bac0 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:55.405167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea52d0b-f8c4-4b0a-b4bf-f3e943a9bac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:55.420995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:55.427684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-0ea52d0b-f8c4-4b0a-b4bf-f3e943a9bac0 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:55.428941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0ea52d0b-f8c4-4b0a-b4bf-f3e943a9bac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:55.447560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec33f8c-208e-46bb-bebe-e7ec19cc8b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:55.448287 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec33f8c-208e-46bb-bebe-e7ec19cc8b51 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:55.448737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec33f8c-208e-46bb-bebe-e7ec19cc8b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:55.449166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec33f8c-208e-46bb-bebe-e7ec19cc8b51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:55.449975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec33f8c-208e-46bb-bebe-e7ec19cc8b51 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:55.451685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec33f8c-208e-46bb-bebe-e7ec19cc8b51 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:55.514695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 527/1038] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:55.515541 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea52d0b-f8c4-4b0a-b4bf-f3e943a9bac0 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:55.590211 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 512/1039] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:19:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:19:55.618598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:55.673186 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea52d0b-f8c4-4b0a-b4bf-f3e943a9bac0 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:55.726001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d74f5-0603-42c2-9de7-1859434728c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:55.726691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d74f5-0603-42c2-9de7-1859434728c8 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:55.727036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d74f5-0603-42c2-9de7-1859434728c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:55.727278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d74f5-0603-42c2-9de7-1859434728c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:55.739927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d74f5-0603-42c2-9de7-1859434728c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:55.741479 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d74f5-0603-42c2-9de7-1859434728c8 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-d61d74f5-0603-42c2-9de7-1859434728c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:55.758875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:55.760511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:55.762230 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:55.762230 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:55.762230 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:55.767398 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 528/1040] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:55.767578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec33f8c-208e-46bb-bebe-e7ec19cc8b51 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:55.936435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec33f8c-208e-46bb-bebe-e7ec19cc8b51 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:55.964261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d74f5-0603-42c2-9de7-1859434728c8 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:55.996068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0a7f-3f5c-408c-ba70-01e8aaae5083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:55.997204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0a7f-3f5c-408c-ba70-01e8aaae5083 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:55.997573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0a7f-3f5c-408c-ba70-01e8aaae5083 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:55.997812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a0a7f-3f5c-408c-ba70-01e8aaae5083 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:55.998486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a0a7f-3f5c-408c-ba70-01e8aaae5083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:55.998789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a0a7f-3f5c-408c-ba70-01e8aaae5083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:56.000854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a0a7f-3f5c-408c-ba70-01e8aaae5083 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:56.022217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 513/1041] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:56.025471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0a7f-3f5c-408c-ba70-01e8aaae5083 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:56.068260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:56.171916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d74f5-0603-42c2-9de7-1859434728c8 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:56.180860 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a0a7f-3f5c-408c-ba70-01e8aaae5083 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:56.187872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:56.224510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc70c6-dea4-4ee8-9f83-a37c76f68466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:56.225178 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc70c6-dea4-4ee8-9f83-a37c76f68466 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:56.225495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc70c6-dea4-4ee8-9f83-a37c76f68466 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:56.225774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc70c6-dea4-4ee8-9f83-a37c76f68466 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:56.237029 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04facb3-e4de-4e13-b431-fe4b81c8fa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:56.238528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04facb3-e4de-4e13-b431-fe4b81c8fa81 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:56.239013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04facb3-e4de-4e13-b431-fe4b81c8fa81 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:56.239488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04facb3-e4de-4e13-b431-fe4b81c8fa81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:56.244251 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04facb3-e4de-4e13-b431-fe4b81c8fa81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:56.246363 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc70c6-dea4-4ee8-9f83-a37c76f68466 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:56.247594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc70c6-dea4-4ee8-9f83-a37c76f68466 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:56.248497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04facb3-e4de-4e13-b431-fe4b81c8fa81 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:56.252977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 529/1042] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:56.262012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04facb3-e4de-4e13-b431-fe4b81c8fa81 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-7dfc70c6-dea4-4ee8-9f83-a37c76f68466 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:19:56.275172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:56.277048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:56.279028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:56.279028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:56.279028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:19:56.279028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:19:56.279028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:19:56.279028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:19:56.279028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:19:56.279028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:19:56.279028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:19:56.279028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:56.281969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 514/1043] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Sep 1 05:19:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:56.292281 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc70c6-dea4-4ee8-9f83-a37c76f68466 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:56.449428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04facb3-e4de-4e13-b431-fe4b81c8fa81 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:56.481329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:56.498007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc70c6-dea4-4ee8-9f83-a37c76f68466 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:56.517282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32eb41-cd74-4e5b-970a-37cf432df33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:56.518342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32eb41-cd74-4e5b-970a-37cf432df33a None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:56.518794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32eb41-cd74-4e5b-970a-37cf432df33a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:56.519238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32eb41-cd74-4e5b-970a-37cf432df33a None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:56.520871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32eb41-cd74-4e5b-970a-37cf432df33a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:56.523957 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32eb41-cd74-4e5b-970a-37cf432df33a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:56.565658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303725ef-2ebb-460e-8a27-3fbaf0301b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:56.566655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303725ef-2ebb-460e-8a27-3fbaf0301b6e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:56.567105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303725ef-2ebb-460e-8a27-3fbaf0301b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:56.567591 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303725ef-2ebb-460e-8a27-3fbaf0301b6e None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:56.568984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303725ef-2ebb-460e-8a27-3fbaf0301b6e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:56.569506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303725ef-2ebb-460e-8a27-3fbaf0301b6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:56.572108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303725ef-2ebb-460e-8a27-3fbaf0301b6e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:56.605955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 515/1044] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Sep 1 05:19:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:56.612994 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303725ef-2ebb-460e-8a27-3fbaf0301b6e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:56.668380 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 530/1045] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:19:56 2022] POST /identity/v3/users => generated 285 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:19:56.763014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303725ef-2ebb-460e-8a27-3fbaf0301b6e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:56.808600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d06fa-88b8-419a-aa51-57032e6cbafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:56.809250 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d06fa-88b8-419a-aa51-57032e6cbafb None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:56.809609 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d06fa-88b8-419a-aa51-57032e6cbafb None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:56.809889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d06fa-88b8-419a-aa51-57032e6cbafb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:56.851774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:56.962720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d06fa-88b8-419a-aa51-57032e6cbafb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:56.965473 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d06fa-88b8-419a-aa51-57032e6cbafb None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:57.113415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 516/1046] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:19:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 05:19:57.116928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32eb41-cd74-4e5b-970a-37cf432df33a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:57.154992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:57.302804 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32eb41-cd74-4e5b-970a-37cf432df33a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:57.358148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b40f5-028f-4b76-aacd-3532269dc415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:57.359200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b40f5-028f-4b76-aacd-3532269dc415 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:57.359550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b40f5-028f-4b76-aacd-3532269dc415 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:57.359853 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b40f5-028f-4b76-aacd-3532269dc415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:57.379676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b40f5-028f-4b76-aacd-3532269dc415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:57.381651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b40f5-028f-4b76-aacd-3532269dc415 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-af9b40f5-028f-4b76-aacd-3532269dc415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:57.402613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:57.404551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:57.406337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:57.406337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:57.406337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:57.409653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 531/1047] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:57.413074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d06fa-88b8-419a-aa51-57032e6cbafb None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:57.496477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:57.569524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d06fa-88b8-419a-aa51-57032e6cbafb None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:57.622797 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65736bd1-24fa-4b5c-8389-57a861591c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:57.623782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736bd1-24fa-4b5c-8389-57a861591c0b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:57.624257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736bd1-24fa-4b5c-8389-57a861591c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:57.624741 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65736bd1-24fa-4b5c-8389-57a861591c0b None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:57.626090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65736bd1-24fa-4b5c-8389-57a861591c0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:57.626771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65736bd1-24fa-4b5c-8389-57a861591c0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:57.629481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65736bd1-24fa-4b5c-8389-57a861591c0b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:57.662825 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 517/1048] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:57.667858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b40f5-028f-4b76-aacd-3532269dc415 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:57.835617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:57.862219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b40f5-028f-4b76-aacd-3532269dc415 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:57.920022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e4ddd-eb1b-4b74-9602-a1741798e7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:57.926768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e4ddd-eb1b-4b74-9602-a1741798e7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:57.927531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e4ddd-eb1b-4b74-9602-a1741798e7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:57.928069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e4ddd-eb1b-4b74-9602-a1741798e7f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:57.936922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e4ddd-eb1b-4b74-9602-a1741798e7f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:57.939066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e4ddd-eb1b-4b74-9602-a1741798e7f1 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-525e4ddd-eb1b-4b74-9602-a1741798e7f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:19:57.956836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:57.957905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:57.958807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:19:57.958807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:19:57.958807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:19:57.958807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:19:57.958807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:19:57.958807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:19:57.958807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:19:57.958807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:19:57.965490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 532/1049] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:57.973430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65736bd1-24fa-4b5c-8389-57a861591c0b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:58.142582 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65736bd1-24fa-4b5c-8389-57a861591c0b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:58.154460 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:58.186604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fb0c4-c259-4cb8-a965-e41b17e348f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:58.187144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fb0c4-c259-4cb8-a965-e41b17e348f6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:58.187435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fb0c4-c259-4cb8-a965-e41b17e348f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:58.187712 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fb0c4-c259-4cb8-a965-e41b17e348f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:58.188463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fb0c4-c259-4cb8-a965-e41b17e348f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:58.188901 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fb0c4-c259-4cb8-a965-e41b17e348f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:58.190661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fb0c4-c259-4cb8-a965-e41b17e348f6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:58.208110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 518/1050] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:58.216377 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e4ddd-eb1b-4b74-9602-a1741798e7f1 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:58.219442 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e393423-8ac3-4541-a83c-79c7bea9ebae None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:58.219805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e393423-8ac3-4541-a83c-79c7bea9ebae None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:58.220112 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e393423-8ac3-4541-a83c-79c7bea9ebae None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:58.223030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 519/1051] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:19:58.228983 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b280f5-f20c-43ef-9622-5d15bf081903 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:58.229346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b280f5-f20c-43ef-9622-5d15bf081903 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:58.229575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b280f5-f20c-43ef-9622-5d15bf081903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:58.255715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-55b280f5-f20c-43ef-9622-5d15bf081903 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:58.256945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-55b280f5-f20c-43ef-9622-5d15bf081903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:58.362630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 520/1052] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:58.374803 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e4ddd-eb1b-4b74-9602-a1741798e7f1 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:58.438508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5999d2-2e13-4667-b1be-0e1c0c8a2e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:58.439338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5999d2-2e13-4667-b1be-0e1c0c8a2e65 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:58.439780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5999d2-2e13-4667-b1be-0e1c0c8a2e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:58.440256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5999d2-2e13-4667-b1be-0e1c0c8a2e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:58.441667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5999d2-2e13-4667-b1be-0e1c0c8a2e65 None admin] RBAC: Adding query filter params (role.id=72ab9b883acc46cf845fa8d599a2bd45, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=b7e84a5652df4d64aa1fd28f3d5383fe) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:58.442181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5999d2-2e13-4667-b1be-0e1c0c8a2e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:58.444564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5999d2-2e13-4667-b1be-0e1c0c8a2e65 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:58.453697 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 533/1053] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:19:58 2022] GET /identity/v3/role_assignments?user.id=b7e84a5652df4d64aa1fd28f3d5383fe&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=72ab9b883acc46cf845fa8d599a2bd45 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:58.703649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b280f5-f20c-43ef-9622-5d15bf081903 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:58.852577 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:58.857089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b280f5-f20c-43ef-9622-5d15bf081903 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:58.911193 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113fa37-da76-45cc-8414-9b5a92cb9314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:58.912670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113fa37-da76-45cc-8414-9b5a92cb9314 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:58.913471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113fa37-da76-45cc-8414-9b5a92cb9314 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:58.914194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113fa37-da76-45cc-8414-9b5a92cb9314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:59.046710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113fa37-da76-45cc-8414-9b5a92cb9314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:59.050242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113fa37-da76-45cc-8414-9b5a92cb9314 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:59.090806 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d187e-d979-4402-9a6e-c55a8dd4ca2b None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:59.091112 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d187e-d979-4402-9a6e-c55a8dd4ca2b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:59.091393 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d187e-d979-4402-9a6e-c55a8dd4ca2b None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:59.092810 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 534/1054] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:19:59.100212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2666-71f0-47f9-9abe-f8a932e1582b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:59.100719 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2666-71f0-47f9-9abe-f8a932e1582b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:59.101215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2666-71f0-47f9-9abe-f8a932e1582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:59.123822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:59.134514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-a11f2666-71f0-47f9-9abe-f8a932e1582b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:59.136665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a11f2666-71f0-47f9-9abe-f8a932e1582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:59.195562 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:59.211854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 521/1055] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:19:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:19:59.218146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113fa37-da76-45cc-8414-9b5a92cb9314 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:59.264533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 535/1056] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:19:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:19:59.405556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113fa37-da76-45cc-8414-9b5a92cb9314 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:59.478163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e3f3e-bb81-4df4-b58c-d89f83c348a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:59.479705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3f3e-bb81-4df4-b58c-d89f83c348a5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:59.480474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3f3e-bb81-4df4-b58c-d89f83c348a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:59.481194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e3f3e-bb81-4df4-b58c-d89f83c348a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:59.502148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e3f3e-bb81-4df4-b58c-d89f83c348a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:59.504975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e3f3e-bb81-4df4-b58c-d89f83c348a5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-739e3f3e-bb81-4df4-b58c-d89f83c348a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:19:59.525706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:59.526841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:19:59.527889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:19:59.527889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:19:59.527889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:59.527889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 522/1057] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:19:59.534868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f2666-71f0-47f9-9abe-f8a932e1582b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:59.577531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e3f3e-bb81-4df4-b58c-d89f83c348a5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:59.636166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:59.684424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f2666-71f0-47f9-9abe-f8a932e1582b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:59.697043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e3f3e-bb81-4df4-b58c-d89f83c348a5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:59.740818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ec57f-ecef-43e1-b41a-e810743d6d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:59.741551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ec57f-ecef-43e1-b41a-e810743d6d68 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:59.741856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ec57f-ecef-43e1-b41a-e810743d6d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:59.742133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ec57f-ecef-43e1-b41a-e810743d6d68 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:59.742864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ec57f-ecef-43e1-b41a-e810743d6d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:59.743199 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ec57f-ecef-43e1-b41a-e810743d6d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:59.744720 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ec57f-ecef-43e1-b41a-e810743d6d68 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:59.745250 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021e7ea-a42c-4745-9ba5-201892a43cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:59.746362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021e7ea-a42c-4745-9ba5-201892a43cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:59.746847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021e7ea-a42c-4745-9ba5-201892a43cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:59.747338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021e7ea-a42c-4745-9ba5-201892a43cf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:59.748144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:59.765510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 536/1058] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:19:59.775337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021e7ea-a42c-4745-9ba5-201892a43cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-5021e7ea-a42c-4745-9ba5-201892a43cf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:19:59.779629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:19:59.780763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:19:59.781653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:19:59.781653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:19:59.781653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:19:59.781653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:19:59.781653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:19:59.781653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:19:59.781653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:19:59.781653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:19:59.781653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:19:59.781653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:19:59.781653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:19:59.781653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:19:59.785829 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 523/1059] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:19:59.788597 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ec57f-ecef-43e1-b41a-e810743d6d68 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:59.956800 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ec57f-ecef-43e1-b41a-e810743d6d68 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:00.010144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722bd2d-738a-4416-928f-7a4db10b6d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:00.011004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722bd2d-738a-4416-928f-7a4db10b6d54 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:00.011431 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722bd2d-738a-4416-928f-7a4db10b6d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:00.011853 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722bd2d-738a-4416-928f-7a4db10b6d54 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:00.012680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722bd2d-738a-4416-928f-7a4db10b6d54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:00.013180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722bd2d-738a-4416-928f-7a4db10b6d54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:00.015673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722bd2d-738a-4416-928f-7a4db10b6d54 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:00.027478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 537/1060] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:19:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:00.034566 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021e7ea-a42c-4745-9ba5-201892a43cf1 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:00.183437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021e7ea-a42c-4745-9ba5-201892a43cf1 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:00.197327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:00.229419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09860d53-f9a9-4e58-b477-95c6293dc5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:00.230106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09860d53-f9a9-4e58-b477-95c6293dc5bc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:00.230448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09860d53-f9a9-4e58-b477-95c6293dc5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:00.230787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09860d53-f9a9-4e58-b477-95c6293dc5bc None admin] PATH_INFO: `/v3/users/358365d5e371435dbddb82c95fcb9ceb` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:00.249311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09860d53-f9a9-4e58-b477-95c6293dc5bc None admin] RBAC: Authorizing `identity:get_user(user_id=358365d5e371435dbddb82c95fcb9ceb)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:00.251469 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09860d53-f9a9-4e58-b477-95c6293dc5bc None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:00.253513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 524/1061] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:00 2022] GET /identity/v3/users/358365d5e371435dbddb82c95fcb9ceb => generated 285 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:00.260074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722bd2d-738a-4416-928f-7a4db10b6d54 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:00.336257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:00.386675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722bd2d-738a-4416-928f-7a4db10b6d54 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:00.434897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35a985-7b18-4722-9ab3-ed8f9c6a0b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:00.435681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35a985-7b18-4722-9ab3-ed8f9c6a0b4f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:00.436056 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35a985-7b18-4722-9ab3-ed8f9c6a0b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:00.436430 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35a985-7b18-4722-9ab3-ed8f9c6a0b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:00.521828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35a985-7b18-4722-9ab3-ed8f9c6a0b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:00.523245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35a985-7b18-4722-9ab3-ed8f9c6a0b4f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:00.583720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259845c9-e10f-4462-82c9-0c6803fe2a57 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:00.584201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259845c9-e10f-4462-82c9-0c6803fe2a57 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:00.584954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259845c9-e10f-4462-82c9-0c6803fe2a57 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:00.587339 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 525/1062] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:00.594552 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e16887-4417-4d3d-ad67-f8c249ab8e8a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:00.595030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e16887-4417-4d3d-ad67-f8c249ab8e8a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:00.595384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e16887-4417-4d3d-ad67-f8c249ab8e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:00.598352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:00.620907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-e1e16887-4417-4d3d-ad67-f8c249ab8e8a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:00.623193 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e1e16887-4417-4d3d-ad67-f8c249ab8e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:00.648150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 538/1063] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:20:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 05:20:00.659965 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35a985-7b18-4722-9ab3-ed8f9c6a0b4f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:00.716322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 526/1064] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:20:00.788673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35a985-7b18-4722-9ab3-ed8f9c6a0b4f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:00.841810 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45641f-5557-4e3e-8e81-cc154eea3768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:00.842748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45641f-5557-4e3e-8e81-cc154eea3768 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:00.843227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45641f-5557-4e3e-8e81-cc154eea3768 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:00.843730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45641f-5557-4e3e-8e81-cc154eea3768 None admin] PATH_INFO: `/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:00.846471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45641f-5557-4e3e-8e81-cc154eea3768 None admin] RBAC: Authorizing `identity:get_project(project_id=6ed9f320f70f4f03a9473fc4e3712b22)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:00.849169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e45641f-5557-4e3e-8e81-cc154eea3768 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:00.857884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 539/1065] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:20:00 2022] GET /identity/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22 => generated 311 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:00.859679 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e16887-4417-4d3d-ad67-f8c249ab8e8a None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:00.994858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:00.999511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e16887-4417-4d3d-ad67-f8c249ab8e8a None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:01.009901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45641f-5557-4e3e-8e81-cc154eea3768 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:01.048233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001c6c2-0ee0-424d-923a-a54373c61eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:01.048761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001c6c2-0ee0-424d-923a-a54373c61eed None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:01.049043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001c6c2-0ee0-424d-923a-a54373c61eed None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:01.049314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001c6c2-0ee0-424d-923a-a54373c61eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:01.050144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001c6c2-0ee0-424d-923a-a54373c61eed None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=6ed9f320f70f4f03a9473fc4e3712b22, user.id=358365d5e371435dbddb82c95fcb9ceb) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:01.050453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001c6c2-0ee0-424d-923a-a54373c61eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:01.051929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001c6c2-0ee0-424d-923a-a54373c61eed None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:01.052690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:01.058136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 527/1066] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:20:00 2022] GET /identity/v3/role_assignments?user.id=358365d5e371435dbddb82c95fcb9ceb&scope.project.id=6ed9f320f70f4f03a9473fc4e3712b22&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:01.172020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e45641f-5557-4e3e-8e81-cc154eea3768 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:01.229833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9530d-89ec-40f1-959f-02098336d107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:01.230694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9530d-89ec-40f1-959f-02098336d107 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:01.230981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9530d-89ec-40f1-959f-02098336d107 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:01.231326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be9530d-89ec-40f1-959f-02098336d107 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:01.245405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be9530d-89ec-40f1-959f-02098336d107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-5be9530d-89ec-40f1-959f-02098336d107 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:20:01.250987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:01.252396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:01.253234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:01.253234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:01.253234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:01.253234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:01.253234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:20:01.253234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:20:01.253234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:20:01.253234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:20:01.253234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:20:01.253234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:20:01.253234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:20:01.253234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:01.257832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 540/1067] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Sep 1 05:20:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:20:01.259258 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001c6c2-0ee0-424d-923a-a54373c61eed None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:01.394416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001c6c2-0ee0-424d-923a-a54373c61eed None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:01.464679 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e74c7-65a0-4a0f-a65e-c39af1afaa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:01.465517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e74c7-65a0-4a0f-a65e-c39af1afaa15 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:01.465886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e74c7-65a0-4a0f-a65e-c39af1afaa15 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:01.466270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e74c7-65a0-4a0f-a65e-c39af1afaa15 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:01.467094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e74c7-65a0-4a0f-a65e-c39af1afaa15 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:01.467469 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e74c7-65a0-4a0f-a65e-c39af1afaa15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:01.469047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e74c7-65a0-4a0f-a65e-c39af1afaa15 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:01.479582 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 528/1068] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Sep 1 05:20:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:01.486894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9530d-89ec-40f1-959f-02098336d107 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:01.589643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:01.615887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be9530d-89ec-40f1-959f-02098336d107 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:01.660444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792666d-fd7d-40e4-b125-379163b0e4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:01.661220 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792666d-fd7d-40e4-b125-379163b0e4ab None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:01.661739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792666d-fd7d-40e4-b125-379163b0e4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:01.662040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792666d-fd7d-40e4-b125-379163b0e4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:01.678799 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792666d-fd7d-40e4-b125-379163b0e4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:01.680726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792666d-fd7d-40e4-b125-379163b0e4ab None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-0792666d-fd7d-40e4-b125-379163b0e4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:20:01.708245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:01.710345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:20:01.711476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:20:01.711476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:20:01.711476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:01.713776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 541/1069] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:20:01.718242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e74c7-65a0-4a0f-a65e-c39af1afaa15 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:01.767139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:01.895226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e74c7-65a0-4a0f-a65e-c39af1afaa15 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:01.954167 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afa8e8-69c7-4751-a057-6272143f397b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:01.955047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa8e8-69c7-4751-a057-6272143f397b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:01.955382 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa8e8-69c7-4751-a057-6272143f397b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:01.955696 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa8e8-69c7-4751-a057-6272143f397b None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:01.956594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afa8e8-69c7-4751-a057-6272143f397b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:01.957008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afa8e8-69c7-4751-a057-6272143f397b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:01.958830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afa8e8-69c7-4751-a057-6272143f397b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:01.978365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 529/1070] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:01.986649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792666d-fd7d-40e4-b125-379163b0e4ab None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:02.147364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792666d-fd7d-40e4-b125-379163b0e4ab None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:02.205443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f39a3-531f-4958-855f-917ecb0b1f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:02.206714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f39a3-531f-4958-855f-917ecb0b1f87 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:02.207043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f39a3-531f-4958-855f-917ecb0b1f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:02.207458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f39a3-531f-4958-855f-917ecb0b1f87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:02.222614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f39a3-531f-4958-855f-917ecb0b1f87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:02.225343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f39a3-531f-4958-855f-917ecb0b1f87 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:02.228257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-2d1f39a3-531f-4958-855f-917ecb0b1f87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:20:02.246000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:02.248890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:02.250974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:02.250974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:02.250974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:20:02.250974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:20:02.250974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:20:02.250974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:20:02.250974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:20:02.250974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:20:02.250974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:20:02.250974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:02.250974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 542/1071] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Sep 1 05:20:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:20:02.257170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afa8e8-69c7-4751-a057-6272143f397b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:02.394423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:02.419457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afa8e8-69c7-4751-a057-6272143f397b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:02.466235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9c61b-20d4-46fd-ab2a-4e556af79cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:02.466775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9c61b-20d4-46fd-ab2a-4e556af79cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:02.467062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9c61b-20d4-46fd-ab2a-4e556af79cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:02.467338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9c61b-20d4-46fd-ab2a-4e556af79cd1 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:02.468089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9c61b-20d4-46fd-ab2a-4e556af79cd1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:02.468395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9c61b-20d4-46fd-ab2a-4e556af79cd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:02.470479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9c61b-20d4-46fd-ab2a-4e556af79cd1 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:02.492301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 530/1072] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Sep 1 05:20:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:02.502419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f39a3-531f-4958-855f-917ecb0b1f87 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:02.648666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f39a3-531f-4958-855f-917ecb0b1f87 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:02.689915 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330973d4-85f7-4117-890e-8a9f166ecf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:02.690559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330973d4-85f7-4117-890e-8a9f166ecf51 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:02.690840 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330973d4-85f7-4117-890e-8a9f166ecf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:02.691113 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330973d4-85f7-4117-890e-8a9f166ecf51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:02.704337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330973d4-85f7-4117-890e-8a9f166ecf51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:02.706753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330973d4-85f7-4117-890e-8a9f166ecf51 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-330973d4-85f7-4117-890e-8a9f166ecf51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:20:02.724207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:02.725234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:20:02.726266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:20:02.726266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:20:02.726266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:02.726266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 543/1073] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:20:02.731735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9c61b-20d4-46fd-ab2a-4e556af79cd1 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:02.859035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9c61b-20d4-46fd-ab2a-4e556af79cd1 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:02.904879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b389c7-b2dc-4292-931c-50ee6c8d31bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:02.905923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b389c7-b2dc-4292-931c-50ee6c8d31bb None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:02.905923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b389c7-b2dc-4292-931c-50ee6c8d31bb None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:02.906224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b389c7-b2dc-4292-931c-50ee6c8d31bb None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:02.906828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b389c7-b2dc-4292-931c-50ee6c8d31bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:02.907366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b389c7-b2dc-4292-931c-50ee6c8d31bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:02.909299 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b389c7-b2dc-4292-931c-50ee6c8d31bb None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:02.925860 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 531/1074] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:02.932245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330973d4-85f7-4117-890e-8a9f166ecf51 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:02.999189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:03.066083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330973d4-85f7-4117-890e-8a9f166ecf51 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:03.110521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9341b11-4b32-466a-91fd-1725d5b67875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:03.111536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9341b11-4b32-466a-91fd-1725d5b67875 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:03.111784 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9341b11-4b32-466a-91fd-1725d5b67875 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:03.112179 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9341b11-4b32-466a-91fd-1725d5b67875 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:03.120855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9341b11-4b32-466a-91fd-1725d5b67875 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:03.122573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9341b11-4b32-466a-91fd-1725d5b67875 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-f9341b11-4b32-466a-91fd-1725d5b67875 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:20:03.137262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:03.138333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:03.139426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:20:03.139426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:20:03.139426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:20:03.139426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:20:03.139426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:20:03.139426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:20:03.139426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:20:03.139426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:03.139426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 544/1075] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:20:03.148257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b389c7-b2dc-4292-931c-50ee6c8d31bb None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:03.153101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:03.238428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a2d4d-a550-495f-a642-d5a394b3f863 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:03.238710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a2d4d-a550-495f-a642-d5a394b3f863 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:03.238990 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a2d4d-a550-495f-a642-d5a394b3f863 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:03.240409 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 545/1076] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:20:03.246282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f81c5-2383-4b87-8083-e40d9dbd7128 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:03.246551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f81c5-2383-4b87-8083-e40d9dbd7128 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:03.246833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f81c5-2383-4b87-8083-e40d9dbd7128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:03.268490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-ee3f81c5-2383-4b87-8083-e40d9dbd7128 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:03.269682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ee3f81c5-2383-4b87-8083-e40d9dbd7128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:03.304913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b389c7-b2dc-4292-931c-50ee6c8d31bb None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:03.352168 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 546/1077] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:20:03.368134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e2462-937d-4bcc-93d0-dc40d1fb24d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:03.369075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e2462-937d-4bcc-93d0-dc40d1fb24d8 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:03.369541 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e2462-937d-4bcc-93d0-dc40d1fb24d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:03.369927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e2462-937d-4bcc-93d0-dc40d1fb24d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:03.371022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e2462-937d-4bcc-93d0-dc40d1fb24d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:03.371542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e2462-937d-4bcc-93d0-dc40d1fb24d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:03.374125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e2462-937d-4bcc-93d0-dc40d1fb24d8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:03.403480 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 532/1078] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:20:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:03.405515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f81c5-2383-4b87-8083-e40d9dbd7128 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:03.463644 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:03.539557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f81c5-2383-4b87-8083-e40d9dbd7128 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:03.584668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190838f-7f4b-456c-b9c1-73455c5710f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:03.585488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190838f-7f4b-456c-b9c1-73455c5710f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:03.585840 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190838f-7f4b-456c-b9c1-73455c5710f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:03.586175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190838f-7f4b-456c-b9c1-73455c5710f7 None admin] PATH_INFO: `/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/b7e84a5652df4d64aa1fd28f3d5383fe/roles/72ab9b883acc46cf845fa8d599a2bd45` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:03.588683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190838f-7f4b-456c-b9c1-73455c5710f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c3fe9229c45f1bfd295115ef94cd7, user_id=b7e84a5652df4d64aa1fd28f3d5383fe, role_id=72ab9b883acc46cf845fa8d599a2bd45)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:03.590276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5190838f-7f4b-456c-b9c1-73455c5710f7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:03.640658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e2462-937d-4bcc-93d0-dc40d1fb24d8 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:03.712945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:03.756439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e2462-937d-4bcc-93d0-dc40d1fb24d8 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:03.795300 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3772f3c-4efc-4568-9c33-d7a395fdd38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:03.795863 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3772f3c-4efc-4568-9c33-d7a395fdd38a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:03.796143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3772f3c-4efc-4568-9c33-d7a395fdd38a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:03.796413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3772f3c-4efc-4568-9c33-d7a395fdd38a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:03.808525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3772f3c-4efc-4568-9c33-d7a395fdd38a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-c3772f3c-4efc-4568-9c33-d7a395fdd38a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:20:03.814373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:03.816128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:20:03.818773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 533/1079] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:20:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:20:03.825538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3772f3c-4efc-4568-9c33-d7a395fdd38a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:03.879034 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 547/1080] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:20:03 2022] PUT /identity/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/b7e84a5652df4d64aa1fd28f3d5383fe/roles/72ab9b883acc46cf845fa8d599a2bd45 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:20:03.972297 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3772f3c-4efc-4568-9c33-d7a395fdd38a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:04.015993 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:04.033813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f2688-288e-47fc-8d75-a780aa638dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:04.042504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f2688-288e-47fc-8d75-a780aa638dcc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:04.042504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f2688-288e-47fc-8d75-a780aa638dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:04.042504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f2688-288e-47fc-8d75-a780aa638dcc None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:04.042504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f2688-288e-47fc-8d75-a780aa638dcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:04.042504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f2688-288e-47fc-8d75-a780aa638dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:04.042504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f2688-288e-47fc-8d75-a780aa638dcc None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:04.057497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 534/1081] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:20:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:04.059560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190838f-7f4b-456c-b9c1-73455c5710f7 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:04.179569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:04.182826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190838f-7f4b-456c-b9c1-73455c5710f7 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:04.222905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9add16b-f429-4edb-b879-0cba4ef30335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:04.223560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9add16b-f429-4edb-b879-0cba4ef30335 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:04.224068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9add16b-f429-4edb-b879-0cba4ef30335 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:04.224337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9add16b-f429-4edb-b879-0cba4ef30335 None admin] PATH_INFO: `/v3/users/358365d5e371435dbddb82c95fcb9ceb` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:04.225663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9add16b-f429-4edb-b879-0cba4ef30335 None admin] RBAC: Authorizing `identity:get_user(user_id=358365d5e371435dbddb82c95fcb9ceb)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:04.227122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9add16b-f429-4edb-b879-0cba4ef30335 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:04.228803 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 548/1082] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:04 2022] GET /identity/v3/users/358365d5e371435dbddb82c95fcb9ceb => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:04.235883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f2688-288e-47fc-8d75-a780aa638dcc None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:04.355634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f2688-288e-47fc-8d75-a780aa638dcc None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:04.395768 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d287f-b222-4e4d-bfcf-38c9ebc97c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:04.396429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d287f-b222-4e4d-bfcf-38c9ebc97c18 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:04.396706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d287f-b222-4e4d-bfcf-38c9ebc97c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:04.396978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d287f-b222-4e4d-bfcf-38c9ebc97c18 None admin] PATH_INFO: `/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:04.398295 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d287f-b222-4e4d-bfcf-38c9ebc97c18 None admin] RBAC: Authorizing `identity:get_project(project_id=6ed9f320f70f4f03a9473fc4e3712b22)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:04.399886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d287f-b222-4e4d-bfcf-38c9ebc97c18 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:04.401703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 535/1083] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:20:04 2022] GET /identity/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:04.408593 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9add16b-f429-4edb-b879-0cba4ef30335 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:04.524077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9add16b-f429-4edb-b879-0cba4ef30335 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:04.564499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4de95-f955-409e-81dc-dcc22c88bc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:04.565176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4de95-f955-409e-81dc-dcc22c88bc99 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:04.565488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4de95-f955-409e-81dc-dcc22c88bc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:04.565764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4de95-f955-409e-81dc-dcc22c88bc99 None admin] PATH_INFO: `/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22/users/358365d5e371435dbddb82c95fcb9ceb/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:04.567841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4de95-f955-409e-81dc-dcc22c88bc99 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ed9f320f70f4f03a9473fc4e3712b22, user_id=358365d5e371435dbddb82c95fcb9ceb, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:04.569309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4de95-f955-409e-81dc-dcc22c88bc99 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:04.722864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 549/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:20:04 2022] PUT /identity/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22/users/358365d5e371435dbddb82c95fcb9ceb/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:20:06.634947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f8aa4-db6d-4c1d-b0fb-24e65f6fd7e5 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:06.635616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f8aa4-db6d-4c1d-b0fb-24e65f6fd7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:06.635923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f8aa4-db6d-4c1d-b0fb-24e65f6fd7e5 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:06.638470 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 536/1085] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:06.647676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30548ff-013e-4e9c-9658-6ee45fc20b14 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:06.648529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30548ff-013e-4e9c-9658-6ee45fc20b14 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:06.648754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30548ff-013e-4e9c-9658-6ee45fc20b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:06.670120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c30548ff-013e-4e9c-9658-6ee45fc20b14 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:06.671502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c30548ff-013e-4e9c-9658-6ee45fc20b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:06.716787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:06.801524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ac826-be29-42e1-af5f-0d938fff8260 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:06.801905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ac826-be29-42e1-af5f-0d938fff8260 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:06.802305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ac826-be29-42e1-af5f-0d938fff8260 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:06.803286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 550/1086] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:06.804103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 537/1087] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:20:06.810532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38399f-37e7-48f3-954d-412cf8fdcfde None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:06.810871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38399f-37e7-48f3-954d-412cf8fdcfde None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:06.811121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38399f-37e7-48f3-954d-412cf8fdcfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:06.833024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-ae38399f-37e7-48f3-954d-412cf8fdcfde None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:06.834575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ae38399f-37e7-48f3-954d-412cf8fdcfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:06.923308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 551/1088] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:07.212134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ac826-be29-42e1-af5f-0d938fff8260 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:07.280050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:07.297931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38399f-37e7-48f3-954d-412cf8fdcfde None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:07.349193 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ac826-be29-42e1-af5f-0d938fff8260 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:07.392639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25285c12-6898-418b-9f46-f6a5287a8fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:07.393307 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25285c12-6898-418b-9f46-f6a5287a8fee None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:07.393622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25285c12-6898-418b-9f46-f6a5287a8fee None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:07.393898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25285c12-6898-418b-9f46-f6a5287a8fee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:07.406748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25285c12-6898-418b-9f46-f6a5287a8fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-25285c12-6898-418b-9f46-f6a5287a8fee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:20:07.413709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:07.415836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:20:07.416827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 538/1089] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:20:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:20:07.422795 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25285c12-6898-418b-9f46-f6a5287a8fee None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:07.451294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:07.468757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38399f-37e7-48f3-954d-412cf8fdcfde None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:07.518441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7461797-365b-4bf3-9b2b-cdfad71b8baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:07.519357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7461797-365b-4bf3-9b2b-cdfad71b8baa None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:07.519713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7461797-365b-4bf3-9b2b-cdfad71b8baa None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:07.520037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7461797-365b-4bf3-9b2b-cdfad71b8baa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:07.536489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7461797-365b-4bf3-9b2b-cdfad71b8baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-a7461797-365b-4bf3-9b2b-cdfad71b8baa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:20:07.542051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:07.543091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:07.545271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 552/1090] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Sep 1 05:20:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:20:07.552660 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7461797-365b-4bf3-9b2b-cdfad71b8baa None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:07.566372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25285c12-6898-418b-9f46-f6a5287a8fee None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:07.583892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:07.617147 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84abec3-d8ce-4eb1-ab02-6448f15ff39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:07.618142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84abec3-d8ce-4eb1-ab02-6448f15ff39f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:07.618584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84abec3-d8ce-4eb1-ab02-6448f15ff39f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:07.618972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84abec3-d8ce-4eb1-ab02-6448f15ff39f None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:07.619917 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84abec3-d8ce-4eb1-ab02-6448f15ff39f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:07.620405 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84abec3-d8ce-4eb1-ab02-6448f15ff39f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:07.622835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84abec3-d8ce-4eb1-ab02-6448f15ff39f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:07.639364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 539/1091] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:20:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:07.649242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84abec3-d8ce-4eb1-ab02-6448f15ff39f None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:07.702814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7461797-365b-4bf3-9b2b-cdfad71b8baa None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:07.744798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc13d2-26ab-4267-aa5e-a61d77fd2e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:07.745327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc13d2-26ab-4267-aa5e-a61d77fd2e0f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:07.745641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc13d2-26ab-4267-aa5e-a61d77fd2e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:07.745916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc13d2-26ab-4267-aa5e-a61d77fd2e0f None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:07.746592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc13d2-26ab-4267-aa5e-a61d77fd2e0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:07.746901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc13d2-26ab-4267-aa5e-a61d77fd2e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:07.748318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc13d2-26ab-4267-aa5e-a61d77fd2e0f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:07.759571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 553/1092] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Sep 1 05:20:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:07.766280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc13d2-26ab-4267-aa5e-a61d77fd2e0f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:07.782091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:07.786821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84abec3-d8ce-4eb1-ab02-6448f15ff39f None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:07.828556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08376901-0780-4792-a88e-eefed4d2ba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:07.829457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08376901-0780-4792-a88e-eefed4d2ba73 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:07.829961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08376901-0780-4792-a88e-eefed4d2ba73 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:07.830347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08376901-0780-4792-a88e-eefed4d2ba73 None admin] PATH_INFO: `/v3/users/358365d5e371435dbddb82c95fcb9ceb` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:07.831823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08376901-0780-4792-a88e-eefed4d2ba73 None admin] RBAC: Authorizing `identity:get_user(user_id=358365d5e371435dbddb82c95fcb9ceb)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:07.833913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08376901-0780-4792-a88e-eefed4d2ba73 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:07.836302 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 540/1093] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:07 2022] GET /identity/v3/users/358365d5e371435dbddb82c95fcb9ceb => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:07.846724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08376901-0780-4792-a88e-eefed4d2ba73 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:07.906559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:07.927248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc13d2-26ab-4267-aa5e-a61d77fd2e0f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:07.974715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f609f30-e4ca-48c7-ae89-6f99b11412c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:07.975532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f609f30-e4ca-48c7-ae89-6f99b11412c6 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:07.975873 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f609f30-e4ca-48c7-ae89-6f99b11412c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:07.976230 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f609f30-e4ca-48c7-ae89-6f99b11412c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:07.993289 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08376901-0780-4792-a88e-eefed4d2ba73 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:08.003954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f609f30-e4ca-48c7-ae89-6f99b11412c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:08.005656 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f609f30-e4ca-48c7-ae89-6f99b11412c6 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-1f609f30-e4ca-48c7-ae89-6f99b11412c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:20:08.023874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:08.026200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:20:08.028582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:20:08.028582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:20:08.028582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:08.028582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 554/1094] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:20:08.032987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f609f30-e4ca-48c7-ae89-6f99b11412c6 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:08.043486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef325c3-100c-47a5-b2e6-e1e652fb37dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:08.044119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef325c3-100c-47a5-b2e6-e1e652fb37dc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:08.044403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef325c3-100c-47a5-b2e6-e1e652fb37dc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:08.044679 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef325c3-100c-47a5-b2e6-e1e652fb37dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:08.127170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:08.141456 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef325c3-100c-47a5-b2e6-e1e652fb37dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:08.142997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef325c3-100c-47a5-b2e6-e1e652fb37dc None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:08.191439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:08.205579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f609f30-e4ca-48c7-ae89-6f99b11412c6 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:08.252955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 541/1095] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:20:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 05:20:08.259460 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef325c3-100c-47a5-b2e6-e1e652fb37dc None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:08.271380 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b121f-a982-4d57-ad19-1a64b12722ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:08.272418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b121f-a982-4d57-ad19-1a64b12722ca None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:08.272904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b121f-a982-4d57-ad19-1a64b12722ca None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:08.273410 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b121f-a982-4d57-ad19-1a64b12722ca None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:08.274611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b121f-a982-4d57-ad19-1a64b12722ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:08.275150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b121f-a982-4d57-ad19-1a64b12722ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:08.277589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b121f-a982-4d57-ad19-1a64b12722ca None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:08.307750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 555/1096] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:08.309209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b121f-a982-4d57-ad19-1a64b12722ca None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:08.377152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef325c3-100c-47a5-b2e6-e1e652fb37dc None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:08.419145 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f67eb-ec02-40ca-a2c5-c581e1996b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:08.419803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f67eb-ec02-40ca-a2c5-c581e1996b43 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:08.420088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f67eb-ec02-40ca-a2c5-c581e1996b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:08.420379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f67eb-ec02-40ca-a2c5-c581e1996b43 None admin] PATH_INFO: `/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:08.421567 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f67eb-ec02-40ca-a2c5-c581e1996b43 None admin] RBAC: Authorizing `identity:get_project(project_id=6ed9f320f70f4f03a9473fc4e3712b22)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:08.423119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f67eb-ec02-40ca-a2c5-c581e1996b43 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:08.424819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 542/1097] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:20:08 2022] GET /identity/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:08.435152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f67eb-ec02-40ca-a2c5-c581e1996b43 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:08.444605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b121f-a982-4d57-ad19-1a64b12722ca None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:08.471913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:08.484344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dd8f2-fc30-4d7a-b772-bea8ee4a8561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:08.485292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dd8f2-fc30-4d7a-b772-bea8ee4a8561 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:08.485603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dd8f2-fc30-4d7a-b772-bea8ee4a8561 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:08.485880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dd8f2-fc30-4d7a-b772-bea8ee4a8561 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:08.494165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dd8f2-fc30-4d7a-b772-bea8ee4a8561 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:08.495655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dd8f2-fc30-4d7a-b772-bea8ee4a8561 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-024dd8f2-fc30-4d7a-b772-bea8ee4a8561 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:20:08.509278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:08.516778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:08.518603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:08.518603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:08.518603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:20:08.518603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:20:08.518603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:20:08.518603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:20:08.518603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:20:08.518603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:20:08.518603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 05:20:08.518603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:08.518603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 556/1098] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Sep 1 05:20:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:20:08.519595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:08.520492 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dd8f2-fc30-4d7a-b772-bea8ee4a8561 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:08.591582 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f67eb-ec02-40ca-a2c5-c581e1996b43 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:08.646882 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07acb6c-84c6-4e21-aebf-ab14fb4cfeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:08.647828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07acb6c-84c6-4e21-aebf-ab14fb4cfeac None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:08.648276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07acb6c-84c6-4e21-aebf-ab14fb4cfeac None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:08.648725 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07acb6c-84c6-4e21-aebf-ab14fb4cfeac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:08.649958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07acb6c-84c6-4e21-aebf-ab14fb4cfeac None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=6ed9f320f70f4f03a9473fc4e3712b22, user.id=358365d5e371435dbddb82c95fcb9ceb) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:08.650427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07acb6c-84c6-4e21-aebf-ab14fb4cfeac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:08.652965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07acb6c-84c6-4e21-aebf-ab14fb4cfeac None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:08.663896 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 543/1099] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:20:08 2022] GET /identity/v3/role_assignments?user.id=358365d5e371435dbddb82c95fcb9ceb&scope.project.id=6ed9f320f70f4f03a9473fc4e3712b22&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:08.664170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dd8f2-fc30-4d7a-b772-bea8ee4a8561 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:08.708174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7ee7d-90df-47b6-9fba-fc3c3c7a41ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:08.708893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ee7d-90df-47b6-9fba-fc3c3c7a41ca None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:08.709076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ee7d-90df-47b6-9fba-fc3c3c7a41ca None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:08.709627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7ee7d-90df-47b6-9fba-fc3c3c7a41ca None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:08.710406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ee7d-90df-47b6-9fba-fc3c3c7a41ca None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:08.710715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ee7d-90df-47b6-9fba-fc3c3c7a41ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:08.712230 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7ee7d-90df-47b6-9fba-fc3c3c7a41ca None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:08.735741 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 557/1100] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Sep 1 05:20:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:08.742094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07acb6c-84c6-4e21-aebf-ab14fb4cfeac None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:08.835616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:08.866451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07acb6c-84c6-4e21-aebf-ab14fb4cfeac None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:08.915285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f3cc6-3207-4918-b875-28732d8099e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:08.915825 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f3cc6-3207-4918-b875-28732d8099e6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:08.916109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f3cc6-3207-4918-b875-28732d8099e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:08.916386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f3cc6-3207-4918-b875-28732d8099e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:09.019452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f3cc6-3207-4918-b875-28732d8099e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:09.021066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f3cc6-3207-4918-b875-28732d8099e6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:09.129667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:09.177719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 544/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:20:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:09.183690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7ee7d-90df-47b6-9fba-fc3c3c7a41ca None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:09.265660 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:09.352712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7ee7d-90df-47b6-9fba-fc3c3c7a41ca None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:09.397181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726f101-7b19-4e81-b68c-2fe7b1adfab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:09.397780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726f101-7b19-4e81-b68c-2fe7b1adfab7 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:09.398068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726f101-7b19-4e81-b68c-2fe7b1adfab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:09.398335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726f101-7b19-4e81-b68c-2fe7b1adfab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:09.410585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726f101-7b19-4e81-b68c-2fe7b1adfab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:09.412112 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726f101-7b19-4e81-b68c-2fe7b1adfab7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-d726f101-7b19-4e81-b68c-2fe7b1adfab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:20:09.431018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:09.432164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:20:09.433131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:20:09.433131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:20:09.433131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:09.433131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 558/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:20:09.438834 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f3cc6-3207-4918-b875-28732d8099e6 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:09.562034 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f3cc6-3207-4918-b875-28732d8099e6 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:09.602639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12be28-2bda-45a7-a4ad-cd11f85be300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:09.603283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12be28-2bda-45a7-a4ad-cd11f85be300 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:09.603565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12be28-2bda-45a7-a4ad-cd11f85be300 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:09.603839 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12be28-2bda-45a7-a4ad-cd11f85be300 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:09.604495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12be28-2bda-45a7-a4ad-cd11f85be300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:09.604800 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12be28-2bda-45a7-a4ad-cd11f85be300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:09.606236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12be28-2bda-45a7-a4ad-cd11f85be300 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:09.619771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 545/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:09.625930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726f101-7b19-4e81-b68c-2fe7b1adfab7 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:09.733628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:09.744542 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726f101-7b19-4e81-b68c-2fe7b1adfab7 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:09.815547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc10f2-68e2-41d0-ac98-2f915d8c7618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:09.816601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc10f2-68e2-41d0-ac98-2f915d8c7618 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:09.817281 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc10f2-68e2-41d0-ac98-2f915d8c7618 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:09.817801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc10f2-68e2-41d0-ac98-2f915d8c7618 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:09.832085 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc10f2-68e2-41d0-ac98-2f915d8c7618 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:09.835261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc10f2-68e2-41d0-ac98-2f915d8c7618 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-6cbc10f2-68e2-41d0-ac98-2f915d8c7618 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:20:09.859948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:09.861619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:09.868609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:20:09.868609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:20:09.868609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:20:09.868609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:20:09.868609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:20:09.868609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:20:09.868609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:20:09.868609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:09.868609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 559/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:20:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:20:09.870394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12be28-2bda-45a7-a4ad-cd11f85be300 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:09.919957 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:10.004133 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12be28-2bda-45a7-a4ad-cd11f85be300 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:10.048104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1b931-8877-461a-87c4-1f665f6e043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:10.048822 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1b931-8877-461a-87c4-1f665f6e043f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:10.049166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1b931-8877-461a-87c4-1f665f6e043f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:10.049560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1b931-8877-461a-87c4-1f665f6e043f None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:10.050603 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1b931-8877-461a-87c4-1f665f6e043f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:10.050972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1b931-8877-461a-87c4-1f665f6e043f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:10.052647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1b931-8877-461a-87c4-1f665f6e043f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:10.069204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 546/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:20:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:10.075978 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc10f2-68e2-41d0-ac98-2f915d8c7618 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:10.213396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc10f2-68e2-41d0-ac98-2f915d8c7618 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:10.263563 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead4ad3-93af-45ef-93e0-051cf0ff8089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:10.264102 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead4ad3-93af-45ef-93e0-051cf0ff8089 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:10.264386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead4ad3-93af-45ef-93e0-051cf0ff8089 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:10.264661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead4ad3-93af-45ef-93e0-051cf0ff8089 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:10.265464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead4ad3-93af-45ef-93e0-051cf0ff8089 None admin] RBAC: Adding query filter params (role.id=72ab9b883acc46cf845fa8d599a2bd45, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=b7e84a5652df4d64aa1fd28f3d5383fe) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:10.266341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead4ad3-93af-45ef-93e0-051cf0ff8089 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:10.267922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead4ad3-93af-45ef-93e0-051cf0ff8089 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:10.274974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 560/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:20:10 2022] GET /identity/v3/role_assignments?user.id=b7e84a5652df4d64aa1fd28f3d5383fe&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=72ab9b883acc46cf845fa8d599a2bd45 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:11.177297 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4cd28-5274-4e73-9070-7508952891f4 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:11.178143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4cd28-5274-4e73-9070-7508952891f4 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:11.178143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac4cd28-5274-4e73-9070-7508952891f4 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:11.179640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 547/1107] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:11.187280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4fe75-a335-45d9-bc21-e3b526b4191f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:11.188522 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4fe75-a335-45d9-bc21-e3b526b4191f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:11.189920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4fe75-a335-45d9-bc21-e3b526b4191f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:11.214617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-1ec4fe75-a335-45d9-bc21-e3b526b4191f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:11.216424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1ec4fe75-a335-45d9-bc21-e3b526b4191f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:11.233754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:11.317003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 561/1108] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:11.595041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4cd28-5274-4e73-9070-7508952891f4 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:11.705393 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:11.714132 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac4cd28-5274-4e73-9070-7508952891f4 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:11.754904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8101de32-ad34-4ac9-b765-846b660cdae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:11.755554 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101de32-ad34-4ac9-b765-846b660cdae1 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:11.755831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101de32-ad34-4ac9-b765-846b660cdae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:11.756098 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8101de32-ad34-4ac9-b765-846b660cdae1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:11.757280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101de32-ad34-4ac9-b765-846b660cdae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:11.758786 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8101de32-ad34-4ac9-b765-846b660cdae1 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:11.760443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 548/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:20:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:11.766940 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4fe75-a335-45d9-bc21-e3b526b4191f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:11.889791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4fe75-a335-45d9-bc21-e3b526b4191f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:11.930481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95b539-a7c1-4dc6-ba14-76897aaf6049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:11.931128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95b539-a7c1-4dc6-ba14-76897aaf6049 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:11.931530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95b539-a7c1-4dc6-ba14-76897aaf6049 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:11.931777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95b539-a7c1-4dc6-ba14-76897aaf6049 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:11.932334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95b539-a7c1-4dc6-ba14-76897aaf6049 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:11.933887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95b539-a7c1-4dc6-ba14-76897aaf6049 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:12.049829 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 562/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:20:11 2022] POST /identity/v3/users => generated 286 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:20:14.118347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ea1ee-865e-40b5-a501-f1e9431130de None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:14.118907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ea1ee-865e-40b5-a501-f1e9431130de None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:14.119115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ea1ee-865e-40b5-a501-f1e9431130de None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:14.120826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 549/1111] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:14.128063 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ae211-8211-400a-93e3-3135a036cc9f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:14.128687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ae211-8211-400a-93e3-3135a036cc9f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:14.128687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ae211-8211-400a-93e3-3135a036cc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:14.135385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:14.148878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-953ae211-8211-400a-93e3-3135a036cc9f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:14.150165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-953ae211-8211-400a-93e3-3135a036cc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:14.224985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 563/1112] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:20:14.506359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ea1ee-865e-40b5-a501-f1e9431130de None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:14.626074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ea1ee-865e-40b5-a501-f1e9431130de None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:14.670759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e28ed-b1f6-40ad-a35d-2a97680a77a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:14.671955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e28ed-b1f6-40ad-a35d-2a97680a77a6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:14.673014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e28ed-b1f6-40ad-a35d-2a97680a77a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:14.673635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e28ed-b1f6-40ad-a35d-2a97680a77a6 None admin] PATH_INFO: `/v3/roles/5183ce055fde4522816e3cdce43ed4e9` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:14.676362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e28ed-b1f6-40ad-a35d-2a97680a77a6 None admin] RBAC: Authorizing `identity:get_role(role_id=5183ce055fde4522816e3cdce43ed4e9)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:14.678928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e28ed-b1f6-40ad-a35d-2a97680a77a6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:14.681742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 550/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:14 2022] GET /identity/v3/roles/5183ce055fde4522816e3cdce43ed4e9 => generated 223 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:14.687827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ae211-8211-400a-93e3-3135a036cc9f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:14.818845 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ae211-8211-400a-93e3-3135a036cc9f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:14.854831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:14.860731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058efc0e-7cee-438a-b067-db875105fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:14.861467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058efc0e-7cee-438a-b067-db875105fd50 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:14.861788 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058efc0e-7cee-438a-b067-db875105fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:14.862103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058efc0e-7cee-438a-b067-db875105fd50 None admin] PATH_INFO: `/v3/users/a12df25a921c402896478c99d794d294` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:14.968904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058efc0e-7cee-438a-b067-db875105fd50 None admin] RBAC: Authorizing `identity:get_user(user_id=a12df25a921c402896478c99d794d294)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:14.970796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058efc0e-7cee-438a-b067-db875105fd50 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:14.972661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 564/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:14 2022] GET /identity/v3/users/a12df25a921c402896478c99d794d294 => generated 286 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:14.979852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e28ed-b1f6-40ad-a35d-2a97680a77a6 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:15.035304 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:15.223894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e28ed-b1f6-40ad-a35d-2a97680a77a6 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:15.264220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99774-b3f2-4457-b736-3ca7466c3698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:15.264841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99774-b3f2-4457-b736-3ca7466c3698 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:15.265117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99774-b3f2-4457-b736-3ca7466c3698 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:15.265415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b99774-b3f2-4457-b736-3ca7466c3698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:15.346893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99774-b3f2-4457-b736-3ca7466c3698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:15.348547 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b99774-b3f2-4457-b736-3ca7466c3698 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:15.382982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:15.466790 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 551/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:20:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:15.473439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058efc0e-7cee-438a-b067-db875105fd50 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:15.591698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058efc0e-7cee-438a-b067-db875105fd50 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:15.631604 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab57e0-2566-4eef-8b83-6dbe4f765a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:15.632249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab57e0-2566-4eef-8b83-6dbe4f765a80 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:15.632530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab57e0-2566-4eef-8b83-6dbe4f765a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:15.632803 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab57e0-2566-4eef-8b83-6dbe4f765a80 None admin] PATH_INFO: `/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:15.634031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab57e0-2566-4eef-8b83-6dbe4f765a80 None admin] RBAC: Authorizing `identity:get_project(project_id=6ed9f320f70f4f03a9473fc4e3712b22)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:15.635499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab57e0-2566-4eef-8b83-6dbe4f765a80 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:15.637242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 565/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:20:15 2022] GET /identity/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:15.644479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99774-b3f2-4457-b736-3ca7466c3698 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:15.760388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b99774-b3f2-4457-b736-3ca7466c3698 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:15.793528 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:15.800078 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e34bf4-4334-43df-8454-dcbfcde9521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:15.800777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e34bf4-4334-43df-8454-dcbfcde9521c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:15.812615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e34bf4-4334-43df-8454-dcbfcde9521c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:15.812615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e34bf4-4334-43df-8454-dcbfcde9521c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:15.812615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e34bf4-4334-43df-8454-dcbfcde9521c None admin] RBAC: Adding query filter params (role.id=5183ce055fde4522816e3cdce43ed4e9, scope.project.id=6ed9f320f70f4f03a9473fc4e3712b22, user.id=a12df25a921c402896478c99d794d294) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:15.812615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e34bf4-4334-43df-8454-dcbfcde9521c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:15.812615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e34bf4-4334-43df-8454-dcbfcde9521c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:15.814075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 552/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:20:15 2022] GET /identity/v3/role_assignments?user.id=a12df25a921c402896478c99d794d294&scope.project.id=6ed9f320f70f4f03a9473fc4e3712b22&role.id=5183ce055fde4522816e3cdce43ed4e9 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:17.826333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5615af-0317-4f89-8094-e11e979ff31e None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:17.826989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5615af-0317-4f89-8094-e11e979ff31e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:17.827341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5615af-0317-4f89-8094-e11e979ff31e None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:17.830447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 566/1118] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:17.837488 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495dc38-b401-47b1-b960-c3500fd4e142 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:17.838321 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495dc38-b401-47b1-b960-c3500fd4e142 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:17.838321 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495dc38-b401-47b1-b960-c3500fd4e142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:17.862633 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-d495dc38-b401-47b1-b960-c3500fd4e142 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:17.863941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d495dc38-b401-47b1-b960-c3500fd4e142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:17.945324 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 553/1119] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:18.234216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5615af-0317-4f89-8094-e11e979ff31e None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:18.309862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:18.389248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5615af-0317-4f89-8094-e11e979ff31e None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:18.449626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e405e7-98df-45db-813f-8d058ab9503a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:18.450273 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e405e7-98df-45db-813f-8d058ab9503a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:18.450553 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e405e7-98df-45db-813f-8d058ab9503a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:18.450828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e405e7-98df-45db-813f-8d058ab9503a None admin] PATH_INFO: `/v3/roles/5183ce055fde4522816e3cdce43ed4e9` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:18.452332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e405e7-98df-45db-813f-8d058ab9503a None admin] RBAC: Authorizing `identity:get_role(role_id=5183ce055fde4522816e3cdce43ed4e9)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:18.454545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e405e7-98df-45db-813f-8d058ab9503a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:18.455988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 567/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:18 2022] GET /identity/v3/roles/5183ce055fde4522816e3cdce43ed4e9 => generated 223 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:18.464019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495dc38-b401-47b1-b960-c3500fd4e142 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:18.587043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495dc38-b401-47b1-b960-c3500fd4e142 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:18.614797 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:18.627038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eee71-d6e2-4d8f-bfe7-1b5c793aa947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:18.630012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eee71-d6e2-4d8f-bfe7-1b5c793aa947 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:18.630012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eee71-d6e2-4d8f-bfe7-1b5c793aa947 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:18.630012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eee71-d6e2-4d8f-bfe7-1b5c793aa947 None admin] PATH_INFO: `/v3/users/a12df25a921c402896478c99d794d294` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:18.630012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eee71-d6e2-4d8f-bfe7-1b5c793aa947 None admin] RBAC: Authorizing `identity:get_user(user_id=a12df25a921c402896478c99d794d294)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:18.630975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eee71-d6e2-4d8f-bfe7-1b5c793aa947 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:18.632724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 554/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:18 2022] GET /identity/v3/users/a12df25a921c402896478c99d794d294 => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:18.639173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e405e7-98df-45db-813f-8d058ab9503a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:18.756132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e405e7-98df-45db-813f-8d058ab9503a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:18.786889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:18.795682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375fe4a-8d65-45ca-a1ff-1f1747a85ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:18.801629 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375fe4a-8d65-45ca-a1ff-1f1747a85ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:18.801629 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375fe4a-8d65-45ca-a1ff-1f1747a85ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:18.801629 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375fe4a-8d65-45ca-a1ff-1f1747a85ce8 None admin] PATH_INFO: `/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:18.801629 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375fe4a-8d65-45ca-a1ff-1f1747a85ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=6ed9f320f70f4f03a9473fc4e3712b22)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:18.801629 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375fe4a-8d65-45ca-a1ff-1f1747a85ce8 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:18.802376 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 568/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:20:18 2022] GET /identity/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:18.811768 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eee71-d6e2-4d8f-bfe7-1b5c793aa947 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:18.987581 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eee71-d6e2-4d8f-bfe7-1b5c793aa947 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:19.028003 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b6feb-5c6f-468d-bb33-fc04bf5943bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:19.028739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6feb-5c6f-468d-bb33-fc04bf5943bf None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:19.029068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6feb-5c6f-468d-bb33-fc04bf5943bf None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:19.029495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b6feb-5c6f-468d-bb33-fc04bf5943bf None admin] PATH_INFO: `/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22/users/a12df25a921c402896478c99d794d294/roles/5183ce055fde4522816e3cdce43ed4e9` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:19.032187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b6feb-5c6f-468d-bb33-fc04bf5943bf None admin] RBAC: Authorizing `identity:create_grant(project_id=6ed9f320f70f4f03a9473fc4e3712b22, user_id=a12df25a921c402896478c99d794d294, role_id=5183ce055fde4522816e3cdce43ed4e9)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:19.033791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b6feb-5c6f-468d-bb33-fc04bf5943bf None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:19.101675 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 555/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:20:18 2022] PUT /identity/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22/users/a12df25a921c402896478c99d794d294/roles/5183ce055fde4522816e3cdce43ed4e9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:20:21.151178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9da12-14f7-46ed-9cb9-4181fe1fca12 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:21.151856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9da12-14f7-46ed-9cb9-4181fe1fca12 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:21.151856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9da12-14f7-46ed-9cb9-4181fe1fca12 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:21.153103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 569/1124] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:20:21.159958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52c14c-347a-4c69-a0ad-6817f4b604cf None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:21.160556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52c14c-347a-4c69-a0ad-6817f4b604cf None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:21.160556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52c14c-347a-4c69-a0ad-6817f4b604cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:21.181356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-da52c14c-347a-4c69-a0ad-6817f4b604cf None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:21.182664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-da52c14c-347a-4c69-a0ad-6817f4b604cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:21.241636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:21.264798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 556/1125] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:20:21.544056 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9da12-14f7-46ed-9cb9-4181fe1fca12 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:21.668248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9da12-14f7-46ed-9cb9-4181fe1fca12 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:21.709663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d920f6-085b-457f-9cd0-45f6dd18d437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:21.710578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d920f6-085b-457f-9cd0-45f6dd18d437 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:21.710861 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d920f6-085b-457f-9cd0-45f6dd18d437 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:21.711134 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d920f6-085b-457f-9cd0-45f6dd18d437 None admin] PATH_INFO: `/v3/roles/5183ce055fde4522816e3cdce43ed4e9` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:21.712719 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d920f6-085b-457f-9cd0-45f6dd18d437 None admin] RBAC: Authorizing `identity:get_role(role_id=5183ce055fde4522816e3cdce43ed4e9)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:21.714165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d920f6-085b-457f-9cd0-45f6dd18d437 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:21.715643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 570/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:21 2022] GET /identity/v3/roles/5183ce055fde4522816e3cdce43ed4e9 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:21.722615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52c14c-347a-4c69-a0ad-6817f4b604cf None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:21.900916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da52c14c-347a-4c69-a0ad-6817f4b604cf None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:21.943367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b2d8b-e989-491c-ab43-2328a7407ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:21.944082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b2d8b-e989-491c-ab43-2328a7407ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:21.944403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b2d8b-e989-491c-ab43-2328a7407ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:21.944722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b2d8b-e989-491c-ab43-2328a7407ef6 None admin] PATH_INFO: `/v3/users/a12df25a921c402896478c99d794d294` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:21.946061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b2d8b-e989-491c-ab43-2328a7407ef6 None admin] RBAC: Authorizing `identity:get_user(user_id=a12df25a921c402896478c99d794d294)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:21.947753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b2d8b-e989-491c-ab43-2328a7407ef6 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:21.949538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 557/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:21 2022] GET /identity/v3/users/a12df25a921c402896478c99d794d294 => generated 286 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:21.956303 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d920f6-085b-457f-9cd0-45f6dd18d437 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:22.030135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:22.076005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d920f6-085b-457f-9cd0-45f6dd18d437 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:22.119711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032319d-79a0-4e8a-90ea-3ffe32c4a69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:22.120696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032319d-79a0-4e8a-90ea-3ffe32c4a69f None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.121155 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032319d-79a0-4e8a-90ea-3ffe32c4a69f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.121654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032319d-79a0-4e8a-90ea-3ffe32c4a69f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.257294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032319d-79a0-4e8a-90ea-3ffe32c4a69f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:22.260192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032319d-79a0-4e8a-90ea-3ffe32c4a69f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:22.336437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:22.383485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 571/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:20:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:22.389886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b2d8b-e989-491c-ab43-2328a7407ef6 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:22.449785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:22.510015 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b2d8b-e989-491c-ab43-2328a7407ef6 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:22.551451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147397ec-4b0b-4268-8775-1d330ee5abe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:22.552171 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147397ec-4b0b-4268-8775-1d330ee5abe4 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.552527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147397ec-4b0b-4268-8775-1d330ee5abe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.552846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147397ec-4b0b-4268-8775-1d330ee5abe4 None admin] PATH_INFO: `/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.554124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147397ec-4b0b-4268-8775-1d330ee5abe4 None admin] RBAC: Authorizing `identity:get_project(project_id=6ed9f320f70f4f03a9473fc4e3712b22)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:22.555648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147397ec-4b0b-4268-8775-1d330ee5abe4 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:22.557461 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 558/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:20:22 2022] GET /identity/v3/projects/6ed9f320f70f4f03a9473fc4e3712b22 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:22.569003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032319d-79a0-4e8a-90ea-3ffe32c4a69f None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:22.680279 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032319d-79a0-4e8a-90ea-3ffe32c4a69f None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:22.720958 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43c78f-2408-4da9-b4ad-633e6e820d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:22.721676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43c78f-2408-4da9-b4ad-633e6e820d0d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.722036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43c78f-2408-4da9-b4ad-633e6e820d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.722352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43c78f-2408-4da9-b4ad-633e6e820d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.723148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43c78f-2408-4da9-b4ad-633e6e820d0d None admin] RBAC: Adding query filter params (role.id=5183ce055fde4522816e3cdce43ed4e9, scope.project.id=6ed9f320f70f4f03a9473fc4e3712b22, user.id=a12df25a921c402896478c99d794d294) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:22.723494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43c78f-2408-4da9-b4ad-633e6e820d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:22.725028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43c78f-2408-4da9-b4ad-633e6e820d0d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:22.732311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 572/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:20:22 2022] GET /identity/v3/role_assignments?user.id=a12df25a921c402896478c99d794d294&scope.project.id=6ed9f320f70f4f03a9473fc4e3712b22&role.id=5183ce055fde4522816e3cdce43ed4e9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:24.851481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bbc8e-ea9e-49ea-94c0-1af8335a5bdc None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:24.852118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bbc8e-ea9e-49ea-94c0-1af8335a5bdc None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:24.852118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5bbc8e-ea9e-49ea-94c0-1af8335a5bdc None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:24.853419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 559/1131] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:24.859284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5c34-f6c0-430c-a711-1a4a60a89429 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:24.859905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5c34-f6c0-430c-a711-1a4a60a89429 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:24.859905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e5c34-f6c0-430c-a711-1a4a60a89429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:24.880533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-7d8e5c34-f6c0-430c-a711-1a4a60a89429 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:24.881801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7d8e5c34-f6c0-430c-a711-1a4a60a89429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:24.917350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:24.989002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 573/1132] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:25.263057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bbc8e-ea9e-49ea-94c0-1af8335a5bdc None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:25.384905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5bbc8e-ea9e-49ea-94c0-1af8335a5bdc None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:25.404536 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:25.424126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb7846-91ff-4c43-9f07-fa306dfa0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:25.424799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb7846-91ff-4c43-9f07-fa306dfa0d47 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:25.425081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb7846-91ff-4c43-9f07-fa306dfa0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:25.425354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb7846-91ff-4c43-9f07-fa306dfa0d47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:25.426745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb7846-91ff-4c43-9f07-fa306dfa0d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:25.428235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb7846-91ff-4c43-9f07-fa306dfa0d47 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:25.430283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 560/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:20:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:25.436937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5c34-f6c0-430c-a711-1a4a60a89429 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:25.557421 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e5c34-f6c0-430c-a711-1a4a60a89429 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:25.598986 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9897dc9-f630-46fa-99cc-91b94038fd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:25.599600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9897dc9-f630-46fa-99cc-91b94038fd1f None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:25.599880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9897dc9-f630-46fa-99cc-91b94038fd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:25.600153 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9897dc9-f630-46fa-99cc-91b94038fd1f None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:25.600833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9897dc9-f630-46fa-99cc-91b94038fd1f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:25.602338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9897dc9-f630-46fa-99cc-91b94038fd1f None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:25.742282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 574/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:20:25 2022] POST /identity/v3/projects => generated 311 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:20:27.830422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6db13-c8d4-42c2-81a1-96ebba0b4ed2 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:27.831245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6db13-c8d4-42c2-81a1-96ebba0b4ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:27.831429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6db13-c8d4-42c2-81a1-96ebba0b4ed2 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:27.832914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 561/1135] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:20:27.839712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb28ce4-29e7-4fc1-9172-7dbf28e57bfb None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:27.848411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb28ce4-29e7-4fc1-9172-7dbf28e57bfb None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:27.848411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb28ce4-29e7-4fc1-9172-7dbf28e57bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:27.860642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-3bb28ce4-29e7-4fc1-9172-7dbf28e57bfb None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:27.862170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3bb28ce4-29e7-4fc1-9172-7dbf28e57bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:27.864628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:27.943220 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 575/1136] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:28.224856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6db13-c8d4-42c2-81a1-96ebba0b4ed2 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:28.354440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda6db13-c8d4-42c2-81a1-96ebba0b4ed2 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:28.395589 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d9fdd-26ea-4f94-9771-df6ecaad3b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:28.396302 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d9fdd-26ea-4f94-9771-df6ecaad3b11 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:28.396581 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d9fdd-26ea-4f94-9771-df6ecaad3b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:28.396855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d9fdd-26ea-4f94-9771-df6ecaad3b11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:28.398120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d9fdd-26ea-4f94-9771-df6ecaad3b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:28.399600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d9fdd-26ea-4f94-9771-df6ecaad3b11 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:28.401294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 562/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:20:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:28.407617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb28ce4-29e7-4fc1-9172-7dbf28e57bfb None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:28.523938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb28ce4-29e7-4fc1-9172-7dbf28e57bfb None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:28.569084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3704a2d-a71c-4d0a-be54-3a1234b63dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:28.569815 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704a2d-a71c-4d0a-be54-3a1234b63dd1 None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:28.570155 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704a2d-a71c-4d0a-be54-3a1234b63dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:28.570481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704a2d-a71c-4d0a-be54-3a1234b63dd1 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:28.571224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3704a2d-a71c-4d0a-be54-3a1234b63dd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:28.572823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3704a2d-a71c-4d0a-be54-3a1234b63dd1 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:28.585367 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:28.746890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 576/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:20:28 2022] POST /identity/v3/users => generated 286 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:20:30.846759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd8d37-a4f9-44ed-9924-b0d434795040 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:30.847421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd8d37-a4f9-44ed-9924-b0d434795040 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:30.847421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd8d37-a4f9-44ed-9924-b0d434795040 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:30.849015 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 563/1139] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:20:30.856663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2df4a7-6987-417d-b6bb-4528ed5f812f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:30.857350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2df4a7-6987-417d-b6bb-4528ed5f812f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:30.857350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2df4a7-6987-417d-b6bb-4528ed5f812f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:30.940280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5d2df4a7-6987-417d-b6bb-4528ed5f812f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:30.941577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5d2df4a7-6987-417d-b6bb-4528ed5f812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:31.028167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 577/1140] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:20:31.343530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd8d37-a4f9-44ed-9924-b0d434795040 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:31.409654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:31.461070 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd8d37-a4f9-44ed-9924-b0d434795040 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:31.503757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf4ff0-0026-492c-b53a-5800ab395c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:31.504408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf4ff0-0026-492c-b53a-5800ab395c93 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:31.504685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf4ff0-0026-492c-b53a-5800ab395c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:31.504954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf4ff0-0026-492c-b53a-5800ab395c93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:31.518963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf4ff0-0026-492c-b53a-5800ab395c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-3ccf4ff0-0026-492c-b53a-5800ab395c93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:20:31.524123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:31.526138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:20:31.527958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 564/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:20:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:20:31.533592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2df4a7-6987-417d-b6bb-4528ed5f812f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:31.650333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2df4a7-6987-417d-b6bb-4528ed5f812f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:31.678970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:31.690983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636472eb-11ec-480b-bbcd-61f7268864c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:31.698275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636472eb-11ec-480b-bbcd-61f7268864c7 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:31.698275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636472eb-11ec-480b-bbcd-61f7268864c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:31.698275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636472eb-11ec-480b-bbcd-61f7268864c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:31.698275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636472eb-11ec-480b-bbcd-61f7268864c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:31.698275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636472eb-11ec-480b-bbcd-61f7268864c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:31.698275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636472eb-11ec-480b-bbcd-61f7268864c7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:31.704859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 578/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:20:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:31.711483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf4ff0-0026-492c-b53a-5800ab395c93 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:31.841446 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf4ff0-0026-492c-b53a-5800ab395c93 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:31.872362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:31.904565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc82ee-4ebc-43e8-931a-8df71dfd2434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:31.905115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc82ee-4ebc-43e8-931a-8df71dfd2434 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:31.905426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc82ee-4ebc-43e8-931a-8df71dfd2434 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:31.905701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc82ee-4ebc-43e8-931a-8df71dfd2434 None admin] PATH_INFO: `/v3/users/ae2a785cafdd43ceaa78cf76f1359b5f` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:31.923697 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc82ee-4ebc-43e8-931a-8df71dfd2434 None admin] RBAC: Authorizing `identity:get_user(user_id=ae2a785cafdd43ceaa78cf76f1359b5f)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:31.926015 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc82ee-4ebc-43e8-931a-8df71dfd2434 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:31.927810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 565/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:31 2022] GET /identity/v3/users/ae2a785cafdd43ceaa78cf76f1359b5f => generated 286 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:31.934208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636472eb-11ec-480b-bbcd-61f7268864c7 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:32.061802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636472eb-11ec-480b-bbcd-61f7268864c7 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:32.101778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c10e73-1bf3-46df-b748-633d6d23569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:32.102385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c10e73-1bf3-46df-b748-633d6d23569c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:32.102662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c10e73-1bf3-46df-b748-633d6d23569c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:32.102932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c10e73-1bf3-46df-b748-633d6d23569c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:32.163688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:32.177498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c10e73-1bf3-46df-b748-633d6d23569c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:32.178972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c10e73-1bf3-46df-b748-633d6d23569c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:32.297516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 579/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:20:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 05:20:32.303884 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc82ee-4ebc-43e8-931a-8df71dfd2434 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:32.427722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc82ee-4ebc-43e8-931a-8df71dfd2434 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:32.468522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284c64d-00d6-4816-94b2-98043d4be6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:32.470315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284c64d-00d6-4816-94b2-98043d4be6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:32.470315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284c64d-00d6-4816-94b2-98043d4be6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:32.470315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284c64d-00d6-4816-94b2-98043d4be6c8 None admin] PATH_INFO: `/v3/projects/af49b4c2378747febb7d3a86fe47aa35` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:32.471535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284c64d-00d6-4816-94b2-98043d4be6c8 None admin] RBAC: Authorizing `identity:get_project(project_id=af49b4c2378747febb7d3a86fe47aa35)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:32.473058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1284c64d-00d6-4816-94b2-98043d4be6c8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:32.474870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 566/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:20:32 2022] GET /identity/v3/projects/af49b4c2378747febb7d3a86fe47aa35 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:32.481909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c10e73-1bf3-46df-b748-633d6d23569c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:32.591711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:32.611949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c10e73-1bf3-46df-b748-633d6d23569c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:32.655335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1599de2-5728-430c-9b44-230ac50ee8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:32.655946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1599de2-5728-430c-9b44-230ac50ee8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:32.656266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1599de2-5728-430c-9b44-230ac50ee8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:32.656572 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1599de2-5728-430c-9b44-230ac50ee8c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:32.658094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1599de2-5728-430c-9b44-230ac50ee8c6 None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=af49b4c2378747febb7d3a86fe47aa35, user.id=ae2a785cafdd43ceaa78cf76f1359b5f) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:32.658410 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1599de2-5728-430c-9b44-230ac50ee8c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:32.659898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1599de2-5728-430c-9b44-230ac50ee8c6 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:32.666355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 580/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:20:32 2022] GET /identity/v3/role_assignments?user.id=ae2a785cafdd43ceaa78cf76f1359b5f&scope.project.id=af49b4c2378747febb7d3a86fe47aa35&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:34.799771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3ecf-40a2-4ec2-a420-5e74c9493a0e None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:34.800337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3ecf-40a2-4ec2-a420-5e74c9493a0e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:34.800337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b3ecf-40a2-4ec2-a420-5e74c9493a0e None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:34.801881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 567/1147] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:20:34.808100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262354-b0c4-400b-a9f2-2a3f457275e5 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:34.808706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262354-b0c4-400b-a9f2-2a3f457275e5 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:34.808706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92262354-b0c4-400b-a9f2-2a3f457275e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:34.830598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-92262354-b0c4-400b-a9f2-2a3f457275e5 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:34.831900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-92262354-b0c4-400b-a9f2-2a3f457275e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:34.921139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 581/1148] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:35.213662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b3ecf-40a2-4ec2-a420-5e74c9493a0e None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:35.267122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:35.336166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b3ecf-40a2-4ec2-a420-5e74c9493a0e None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:35.377708 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd12f0e-4f50-431d-bde2-f4f66d440182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:35.378370 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd12f0e-4f50-431d-bde2-f4f66d440182 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:35.378649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd12f0e-4f50-431d-bde2-f4f66d440182 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:35.378927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd12f0e-4f50-431d-bde2-f4f66d440182 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:35.391405 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd12f0e-4f50-431d-bde2-f4f66d440182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-afd12f0e-4f50-431d-bde2-f4f66d440182 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:20:35.396634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:35.398608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:20:35.400621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 568/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:20:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:20:35.408210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92262354-b0c4-400b-a9f2-2a3f457275e5 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:35.508897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:35.532500 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92262354-b0c4-400b-a9f2-2a3f457275e5 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:35.573136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3456a7-c729-4103-9f2b-9b01b1af25cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:35.573801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3456a7-c729-4103-9f2b-9b01b1af25cb None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:35.574083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3456a7-c729-4103-9f2b-9b01b1af25cb None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:35.574356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3456a7-c729-4103-9f2b-9b01b1af25cb None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:35.575056 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3456a7-c729-4103-9f2b-9b01b1af25cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:35.575361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3456a7-c729-4103-9f2b-9b01b1af25cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:35.576794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3456a7-c729-4103-9f2b-9b01b1af25cb None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:35.587033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 582/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:20:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:35.598496 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd12f0e-4f50-431d-bde2-f4f66d440182 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:35.755130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:35.758664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd12f0e-4f50-431d-bde2-f4f66d440182 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:35.802474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff053975-18ab-4069-9328-6efdb9f91b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:35.803191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff053975-18ab-4069-9328-6efdb9f91b53 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:35.803385 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff053975-18ab-4069-9328-6efdb9f91b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:35.803735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff053975-18ab-4069-9328-6efdb9f91b53 None admin] PATH_INFO: `/v3/users/ae2a785cafdd43ceaa78cf76f1359b5f` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:35.805052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff053975-18ab-4069-9328-6efdb9f91b53 None admin] RBAC: Authorizing `identity:get_user(user_id=ae2a785cafdd43ceaa78cf76f1359b5f)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:35.806657 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff053975-18ab-4069-9328-6efdb9f91b53 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:35.808492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 569/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:35 2022] GET /identity/v3/users/ae2a785cafdd43ceaa78cf76f1359b5f => generated 286 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:35.815088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3456a7-c729-4103-9f2b-9b01b1af25cb None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:35.980223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3456a7-c729-4103-9f2b-9b01b1af25cb None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:36.038096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1258e8df-1e99-48fa-bcb8-3afcea1e276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:36.039022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e8df-1e99-48fa-bcb8-3afcea1e276c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:36.039452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e8df-1e99-48fa-bcb8-3afcea1e276c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:36.039876 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1258e8df-1e99-48fa-bcb8-3afcea1e276c None admin] PATH_INFO: `/v3/projects/af49b4c2378747febb7d3a86fe47aa35` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:36.041968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258e8df-1e99-48fa-bcb8-3afcea1e276c None admin] RBAC: Authorizing `identity:get_project(project_id=af49b4c2378747febb7d3a86fe47aa35)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:36.044400 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1258e8df-1e99-48fa-bcb8-3afcea1e276c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:36.047497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 583/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:20:35 2022] GET /identity/v3/projects/af49b4c2378747febb7d3a86fe47aa35 => generated 311 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:36.053933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff053975-18ab-4069-9328-6efdb9f91b53 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:36.172730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff053975-18ab-4069-9328-6efdb9f91b53 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:36.213495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b9af8-7829-433b-9c78-6786f9766061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:36.214176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9af8-7829-433b-9c78-6786f9766061 None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:36.214454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9af8-7829-433b-9c78-6786f9766061 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:36.214727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b9af8-7829-433b-9c78-6786f9766061 None admin] PATH_INFO: `/v3/projects/af49b4c2378747febb7d3a86fe47aa35/users/ae2a785cafdd43ceaa78cf76f1359b5f/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:36.216711 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b9af8-7829-433b-9c78-6786f9766061 None admin] RBAC: Authorizing `identity:create_grant(project_id=af49b4c2378747febb7d3a86fe47aa35, user_id=ae2a785cafdd43ceaa78cf76f1359b5f, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:36.218430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b9af8-7829-433b-9c78-6786f9766061 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:36.427725 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 570/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:20:36 2022] PUT /identity/v3/projects/af49b4c2378747febb7d3a86fe47aa35/users/ae2a785cafdd43ceaa78cf76f1359b5f/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:20:38.527349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f224c-86c0-4b91-94f0-021963375b9f None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:38.528004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f224c-86c0-4b91-94f0-021963375b9f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:38.528004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f224c-86c0-4b91-94f0-021963375b9f None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:38.529278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 584/1154] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:20:38.537006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b14f5-d9b4-41c2-b3de-276cb4c836b4 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:38.537694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b14f5-d9b4-41c2-b3de-276cb4c836b4 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:38.537937 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b14f5-d9b4-41c2-b3de-276cb4c836b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:38.570730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-274b14f5-d9b4-41c2-b3de-276cb4c836b4 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:38.572816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-274b14f5-d9b4-41c2-b3de-276cb4c836b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:38.619218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:38.707619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 571/1155] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:38.981039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f224c-86c0-4b91-94f0-021963375b9f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:38.996223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:39.101952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f224c-86c0-4b91-94f0-021963375b9f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:39.141388 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce74723-0ad6-4d0d-bd8b-319741e8da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:39.142055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce74723-0ad6-4d0d-bd8b-319741e8da19 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:39.142334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce74723-0ad6-4d0d-bd8b-319741e8da19 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:39.142673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce74723-0ad6-4d0d-bd8b-319741e8da19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:39.157114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce74723-0ad6-4d0d-bd8b-319741e8da19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-3ce74723-0ad6-4d0d-bd8b-319741e8da19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:20:39.162370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:39.164176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:39.166127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 585/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:20:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:20:39.172594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b14f5-d9b4-41c2-b3de-276cb4c836b4 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:39.294407 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b14f5-d9b4-41c2-b3de-276cb4c836b4 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:39.335260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270084f-f7e9-45b5-a6c3-639fac480536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:39.336205 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270084f-f7e9-45b5-a6c3-639fac480536 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:39.336527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270084f-f7e9-45b5-a6c3-639fac480536 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:39.336840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270084f-f7e9-45b5-a6c3-639fac480536 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:39.337614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270084f-f7e9-45b5-a6c3-639fac480536 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:39.337960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270084f-f7e9-45b5-a6c3-639fac480536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:39.339531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270084f-f7e9-45b5-a6c3-639fac480536 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:39.349780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 572/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:20:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:39.358921 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce74723-0ad6-4d0d-bd8b-319741e8da19 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:39.440934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:39.476960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce74723-0ad6-4d0d-bd8b-319741e8da19 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:39.516701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fdc90-ac89-4d90-b03c-86facf7643d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:39.517341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fdc90-ac89-4d90-b03c-86facf7643d2 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:39.517651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fdc90-ac89-4d90-b03c-86facf7643d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:39.517923 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fdc90-ac89-4d90-b03c-86facf7643d2 None admin] PATH_INFO: `/v3/users/ae2a785cafdd43ceaa78cf76f1359b5f` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:39.519173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fdc90-ac89-4d90-b03c-86facf7643d2 None admin] RBAC: Authorizing `identity:get_user(user_id=ae2a785cafdd43ceaa78cf76f1359b5f)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:39.520638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fdc90-ac89-4d90-b03c-86facf7643d2 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:39.522407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 586/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:39 2022] GET /identity/v3/users/ae2a785cafdd43ceaa78cf76f1359b5f => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:39.532255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270084f-f7e9-45b5-a6c3-639fac480536 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:39.561233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:39.667303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270084f-f7e9-45b5-a6c3-639fac480536 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:39.710072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5c5a7-8319-455e-959e-61067801d3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:39.710963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5c5a7-8319-455e-959e-61067801d3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:39.711237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5c5a7-8319-455e-959e-61067801d3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:39.711505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5c5a7-8319-455e-959e-61067801d3c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:39.793124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5c5a7-8319-455e-959e-61067801d3c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:39.794646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5c5a7-8319-455e-959e-61067801d3c5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:39.820295 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:39.909105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 573/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:20:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:39.919014 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fdc90-ac89-4d90-b03c-86facf7643d2 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:40.038061 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fdc90-ac89-4d90-b03c-86facf7643d2 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:40.080116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0ac61-4d6e-455a-b9db-9bc1233ff2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:40.080828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0ac61-4d6e-455a-b9db-9bc1233ff2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:40.081118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0ac61-4d6e-455a-b9db-9bc1233ff2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:40.081403 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0ac61-4d6e-455a-b9db-9bc1233ff2e9 None admin] PATH_INFO: `/v3/projects/af49b4c2378747febb7d3a86fe47aa35` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:40.082676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0ac61-4d6e-455a-b9db-9bc1233ff2e9 None admin] RBAC: Authorizing `identity:get_project(project_id=af49b4c2378747febb7d3a86fe47aa35)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:40.084145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0ac61-4d6e-455a-b9db-9bc1233ff2e9 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:40.086178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 587/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:20:39 2022] GET /identity/v3/projects/af49b4c2378747febb7d3a86fe47aa35 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:40.092892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5c5a7-8319-455e-959e-61067801d3c5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:40.211926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5c5a7-8319-455e-959e-61067801d3c5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:40.236345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:40.252308 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe355-499f-42e6-98fe-4418750e897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:40.253089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe355-499f-42e6-98fe-4418750e897f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:40.253498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe355-499f-42e6-98fe-4418750e897f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:40.253883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe355-499f-42e6-98fe-4418750e897f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:40.254715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fe355-499f-42e6-98fe-4418750e897f None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=af49b4c2378747febb7d3a86fe47aa35, user.id=ae2a785cafdd43ceaa78cf76f1359b5f) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:40.255175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fe355-499f-42e6-98fe-4418750e897f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:40.256768 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fe355-499f-42e6-98fe-4418750e897f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:40.263504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 574/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:20:40 2022] GET /identity/v3/role_assignments?user.id=ae2a785cafdd43ceaa78cf76f1359b5f&scope.project.id=af49b4c2378747febb7d3a86fe47aa35&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:42.307556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26d736-774f-4a20-8d50-a821b52f498e None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:42.308165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26d736-774f-4a20-8d50-a821b52f498e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:42.308165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26d736-774f-4a20-8d50-a821b52f498e None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:42.309710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 588/1162] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:42.316223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11f377-4332-445a-bffd-3cc45c1a3321 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:42.316805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11f377-4332-445a-bffd-3cc45c1a3321 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:42.316805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11f377-4332-445a-bffd-3cc45c1a3321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:42.336922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ee11f377-4332-445a-bffd-3cc45c1a3321 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:42.338277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ee11f377-4332-445a-bffd-3cc45c1a3321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:42.414392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 575/1163] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:42.698886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26d736-774f-4a20-8d50-a821b52f498e None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:42.713135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:42.820169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26d736-774f-4a20-8d50-a821b52f498e None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:42.860994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed713619-6476-40a5-a2ac-ceaa61797e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:42.861705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed713619-6476-40a5-a2ac-ceaa61797e28 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:42.862028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed713619-6476-40a5-a2ac-ceaa61797e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:42.862344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed713619-6476-40a5-a2ac-ceaa61797e28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:42.941871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed713619-6476-40a5-a2ac-ceaa61797e28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:42.943431 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed713619-6476-40a5-a2ac-ceaa61797e28 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:42.952968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:43.062218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 589/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:20:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:20:43.069279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11f377-4332-445a-bffd-3cc45c1a3321 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:43.215026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11f377-4332-445a-bffd-3cc45c1a3321 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:43.242689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:43.278362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f465ff-71ad-4367-a4b5-af1dee7b143f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:43.279331 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f465ff-71ad-4367-a4b5-af1dee7b143f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:43.279770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f465ff-71ad-4367-a4b5-af1dee7b143f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:43.280185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f465ff-71ad-4367-a4b5-af1dee7b143f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:43.292154 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f465ff-71ad-4367-a4b5-af1dee7b143f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:43.294781 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f465ff-71ad-4367-a4b5-af1dee7b143f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-e3f465ff-71ad-4367-a4b5-af1dee7b143f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:43.318505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:43.320166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:20:43.321030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 576/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Sep 1 05:20:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:20:43.327157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed713619-6476-40a5-a2ac-ceaa61797e28 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:43.444248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed713619-6476-40a5-a2ac-ceaa61797e28 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:43.452665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:43.488856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4840998-00ab-49a0-952f-6816039ccf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:43.489763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4840998-00ab-49a0-952f-6816039ccf1a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:43.490260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4840998-00ab-49a0-952f-6816039ccf1a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:43.490747 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4840998-00ab-49a0-952f-6816039ccf1a None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:43.491900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4840998-00ab-49a0-952f-6816039ccf1a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:43.492427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4840998-00ab-49a0-952f-6816039ccf1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:43.495059 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4840998-00ab-49a0-952f-6816039ccf1a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:43.507625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 590/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Sep 1 05:20:43 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:45.627612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f1305-a8c9-4fa7-bbd0-2a6b4475cb5c None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:45.628251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f1305-a8c9-4fa7-bbd0-2a6b4475cb5c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:45.628251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f1305-a8c9-4fa7-bbd0-2a6b4475cb5c None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:45.629673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 577/1167] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:45.635668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29af7-6a66-4dfb-80a0-06799135344d None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:45.636308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29af7-6a66-4dfb-80a0-06799135344d None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:45.636308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29af7-6a66-4dfb-80a0-06799135344d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:45.658319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-90b29af7-6a66-4dfb-80a0-06799135344d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:45.659566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-90b29af7-6a66-4dfb-80a0-06799135344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:45.739019 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 591/1168] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:20:46.018147 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f1305-a8c9-4fa7-bbd0-2a6b4475cb5c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:46.138367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f1305-a8c9-4fa7-bbd0-2a6b4475cb5c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:46.178352 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd43abc-5902-4c2d-8383-be0e508ba721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:46.178971 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd43abc-5902-4c2d-8383-be0e508ba721 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:46.179251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd43abc-5902-4c2d-8383-be0e508ba721 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:46.179524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd43abc-5902-4c2d-8383-be0e508ba721 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:46.180210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd43abc-5902-4c2d-8383-be0e508ba721 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:46.181636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd43abc-5902-4c2d-8383-be0e508ba721 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:46.309081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 578/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Thu Sep 1 05:20:46 2022] POST /identity/v3/domains => generated 267 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:20:48.342398 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cc3aa-6981-4401-8d32-ac3a0d81fc89 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:48.343256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cc3aa-6981-4401-8d32-ac3a0d81fc89 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:48.343256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cc3aa-6981-4401-8d32-ac3a0d81fc89 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:48.345429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 592/1170] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:20:48.351459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4143d6-5e8e-448a-bd7a-d5f94526d6b4 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:48.352026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4143d6-5e8e-448a-bd7a-d5f94526d6b4 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:48.352134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4143d6-5e8e-448a-bd7a-d5f94526d6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:48.371980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-be4143d6-5e8e-448a-bd7a-d5f94526d6b4 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:48.373204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-be4143d6-5e8e-448a-bd7a-d5f94526d6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:48.406174 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:48.455433 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 579/1171] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:48.743823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cc3aa-6981-4401-8d32-ac3a0d81fc89 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:48.873465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:48.878309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cc3aa-6981-4401-8d32-ac3a0d81fc89 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:48.921979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26398220-7e48-4e2a-82f0-51adfe75defc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:48.923044 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26398220-7e48-4e2a-82f0-51adfe75defc None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:48.923454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26398220-7e48-4e2a-82f0-51adfe75defc None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:48.924096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26398220-7e48-4e2a-82f0-51adfe75defc None admin] PATH_INFO: `/v3/domains/e78129b6ed844b1bb8f6b0a8132184b9` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:48.939829 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26398220-7e48-4e2a-82f0-51adfe75defc None admin] RBAC: Authorizing `identity:get_domain(domain_id=e78129b6ed844b1bb8f6b0a8132184b9)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:48.941327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26398220-7e48-4e2a-82f0-51adfe75defc None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:48.943137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 593/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Thu Sep 1 05:20:48 2022] GET /identity/v3/domains/e78129b6ed844b1bb8f6b0a8132184b9 => generated 267 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:48.949581 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4143d6-5e8e-448a-bd7a-d5f94526d6b4 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:49.089010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4143d6-5e8e-448a-bd7a-d5f94526d6b4 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:49.127596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41abe1b-d3c6-41e5-8d6d-82a8cc3eebed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:49.128222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41abe1b-d3c6-41e5-8d6d-82a8cc3eebed None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:49.128508 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41abe1b-d3c6-41e5-8d6d-82a8cc3eebed None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:49.128778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41abe1b-d3c6-41e5-8d6d-82a8cc3eebed None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:49.129479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41abe1b-d3c6-41e5-8d6d-82a8cc3eebed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:49.130957 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41abe1b-d3c6-41e5-8d6d-82a8cc3eebed None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:49.277859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 580/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:20:48 2022] POST /identity/v3/projects => generated 361 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:20:51.320019 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328ea2c-99a3-4ea5-b421-f23fc8e60937 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:51.320652 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328ea2c-99a3-4ea5-b421-f23fc8e60937 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:51.320652 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a328ea2c-99a3-4ea5-b421-f23fc8e60937 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:51.322012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 594/1174] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:20:51.328600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1d2a9-5264-4286-a5cf-47f6e03f0233 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:51.329165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1d2a9-5264-4286-a5cf-47f6e03f0233 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:51.329165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1d2a9-5264-4286-a5cf-47f6e03f0233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:51.349589 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-51f1d2a9-5264-4286-a5cf-47f6e03f0233 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:51.350822 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-51f1d2a9-5264-4286-a5cf-47f6e03f0233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:51.364295 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:51.429300 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 581/1175] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:51.702046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328ea2c-99a3-4ea5-b421-f23fc8e60937 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:51.839107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a328ea2c-99a3-4ea5-b421-f23fc8e60937 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:51.884779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a101de-b22e-4703-8abe-a9988855bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:51.885437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a101de-b22e-4703-8abe-a9988855bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:51.885717 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a101de-b22e-4703-8abe-a9988855bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:51.886041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a101de-b22e-4703-8abe-a9988855bcd4 None admin] PATH_INFO: `/v3/domains/e78129b6ed844b1bb8f6b0a8132184b9` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:51.887221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a101de-b22e-4703-8abe-a9988855bcd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e78129b6ed844b1bb8f6b0a8132184b9)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:51.890004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a101de-b22e-4703-8abe-a9988855bcd4 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:51.891143 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 595/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Thu Sep 1 05:20:51 2022] GET /identity/v3/domains/e78129b6ed844b1bb8f6b0a8132184b9 => generated 267 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:51.901218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1d2a9-5264-4286-a5cf-47f6e03f0233 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:52.091551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1d2a9-5264-4286-a5cf-47f6e03f0233 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:52.146408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a550b0-89ec-4671-b4f3-c7cca162d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:52.147082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a550b0-89ec-4671-b4f3-c7cca162d2d0 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:52.147363 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a550b0-89ec-4671-b4f3-c7cca162d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:52.147637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a550b0-89ec-4671-b4f3-c7cca162d2d0 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:52.148331 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a550b0-89ec-4671-b4f3-c7cca162d2d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:52.149866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a550b0-89ec-4671-b4f3-c7cca162d2d0 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:52.284604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 582/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:20:51 2022] POST /identity/v3/users => generated 311 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:20:54.613467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a8ab0-83ad-492f-9484-ab6b0e3ac51e None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:54.614356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a8ab0-83ad-492f-9484-ab6b0e3ac51e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:54.614356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a8ab0-83ad-492f-9484-ab6b0e3ac51e None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:54.616010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 596/1178] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:20:54.622388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d71a-369d-4a3c-a2ef-ded1502daa44 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:54.622945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d71a-369d-4a3c-a2ef-ded1502daa44 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:54.622945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d71a-369d-4a3c-a2ef-ded1502daa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:54.629825 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:54.645177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-4317d71a-369d-4a3c-a2ef-ded1502daa44 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:54.646571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4317d71a-369d-4a3c-a2ef-ded1502daa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:54.727420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 583/1179] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:55.013748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a8ab0-83ad-492f-9484-ab6b0e3ac51e None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:55.049106 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:55.134732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a8ab0-83ad-492f-9484-ab6b0e3ac51e None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:55.170779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bbb4b-3c60-4af6-8d32-7a26c96c57c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:55.171416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bbb4b-3c60-4af6-8d32-7a26c96c57c0 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:55.172209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bbb4b-3c60-4af6-8d32-7a26c96c57c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:55.172614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bbb4b-3c60-4af6-8d32-7a26c96c57c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:55.184817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5bbb4b-3c60-4af6-8d32-7a26c96c57c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-ae5bbb4b-3c60-4af6-8d32-7a26c96c57c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:20:55.190435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:55.192349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:55.194008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 597/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:20:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:20:55.197997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d71a-369d-4a3c-a2ef-ded1502daa44 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:55.321849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d71a-369d-4a3c-a2ef-ded1502daa44 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:55.357775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:55.363756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e755335-7a21-4020-9bf1-5dd258baa3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:55.364595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e755335-7a21-4020-9bf1-5dd258baa3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:55.364915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e755335-7a21-4020-9bf1-5dd258baa3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:55.369231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e755335-7a21-4020-9bf1-5dd258baa3e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:55.369231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e755335-7a21-4020-9bf1-5dd258baa3e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:55.369231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e755335-7a21-4020-9bf1-5dd258baa3e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:55.369231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e755335-7a21-4020-9bf1-5dd258baa3e5 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:55.378155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 584/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:20:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:55.384616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bbb4b-3c60-4af6-8d32-7a26c96c57c0 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:55.487602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:55.501482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bbb4b-3c60-4af6-8d32-7a26c96c57c0 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:55.541011 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d5c8-eb8c-4af0-a9f0-4e72217f756d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:55.541753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d5c8-eb8c-4af0-a9f0-4e72217f756d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:55.542103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d5c8-eb8c-4af0-a9f0-4e72217f756d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:55.542422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31d5c8-eb8c-4af0-a9f0-4e72217f756d None admin] PATH_INFO: `/v3/users/5981be21d6f445d18d3e390ee105c162` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:55.559010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31d5c8-eb8c-4af0-a9f0-4e72217f756d None admin] RBAC: Authorizing `identity:get_user(user_id=5981be21d6f445d18d3e390ee105c162)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:55.560545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31d5c8-eb8c-4af0-a9f0-4e72217f756d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:55.563407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 598/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:55 2022] GET /identity/v3/users/5981be21d6f445d18d3e390ee105c162 => generated 311 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:55.569962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e755335-7a21-4020-9bf1-5dd258baa3e5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:55.687033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e755335-7a21-4020-9bf1-5dd258baa3e5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:55.727631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c79ccb-0788-4891-9053-6f9fef366bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:55.728331 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79ccb-0788-4891-9053-6f9fef366bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:55.728654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79ccb-0788-4891-9053-6f9fef366bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:55.728967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79ccb-0788-4891-9053-6f9fef366bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:55.800702 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:55.809641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c79ccb-0788-4891-9053-6f9fef366bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:55.813752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c79ccb-0788-4891-9053-6f9fef366bd3 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:55.932636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 585/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:20:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 05:20:55.939425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d5c8-eb8c-4af0-a9f0-4e72217f756d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:56.055976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31d5c8-eb8c-4af0-a9f0-4e72217f756d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:56.097893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fddaba-2934-457a-bfdd-473b39711176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:56.098554 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fddaba-2934-457a-bfdd-473b39711176 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:56.098839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fddaba-2934-457a-bfdd-473b39711176 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:56.099114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fddaba-2934-457a-bfdd-473b39711176 None admin] PATH_INFO: `/v3/projects/1479d221a4b149368edbb212b276de50` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:56.100383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fddaba-2934-457a-bfdd-473b39711176 None admin] RBAC: Authorizing `identity:get_project(project_id=1479d221a4b149368edbb212b276de50)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:56.101980 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fddaba-2934-457a-bfdd-473b39711176 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:56.103775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 599/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:20:55 2022] GET /identity/v3/projects/1479d221a4b149368edbb212b276de50 => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:56.111085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c79ccb-0788-4891-9053-6f9fef366bd3 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:56.223584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:56.231336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c79ccb-0788-4891-9053-6f9fef366bd3 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:56.272440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e569f5-5a50-4086-97c4-5777c8c73c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:56.273058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e569f5-5a50-4086-97c4-5777c8c73c37 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:56.273332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e569f5-5a50-4086-97c4-5777c8c73c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:56.273638 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e569f5-5a50-4086-97c4-5777c8c73c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:56.274375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e569f5-5a50-4086-97c4-5777c8c73c37 None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=1479d221a4b149368edbb212b276de50, user.id=5981be21d6f445d18d3e390ee105c162) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:56.274681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e569f5-5a50-4086-97c4-5777c8c73c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:56.276264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e569f5-5a50-4086-97c4-5777c8c73c37 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:56.282723 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 586/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:20:56 2022] GET /identity/v3/role_assignments?user.id=5981be21d6f445d18d3e390ee105c162&scope.project.id=1479d221a4b149368edbb212b276de50&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:58.602362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21658d-2136-44b8-88ed-f463f5712c04 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:58.602960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21658d-2136-44b8-88ed-f463f5712c04 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:58.602960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21658d-2136-44b8-88ed-f463f5712c04 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:58.604417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 600/1186] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:58.611629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9feb4c-9044-4196-8dc9-fa3d9ddf7a94 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:58.612192 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9feb4c-9044-4196-8dc9-fa3d9ddf7a94 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:58.612192 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9feb4c-9044-4196-8dc9-fa3d9ddf7a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:58.641035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-6d9feb4c-9044-4196-8dc9-fa3d9ddf7a94 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:58.642341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6d9feb4c-9044-4196-8dc9-fa3d9ddf7a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:58.722698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 587/1187] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:20:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:20:59.007242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21658d-2136-44b8-88ed-f463f5712c04 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:59.029900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:59.147083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21658d-2136-44b8-88ed-f463f5712c04 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:59.190178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72988b1-7743-4656-8439-2b104e9d121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:59.190859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72988b1-7743-4656-8439-2b104e9d121b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:59.191144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72988b1-7743-4656-8439-2b104e9d121b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:59.191429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72988b1-7743-4656-8439-2b104e9d121b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:59.204075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72988b1-7743-4656-8439-2b104e9d121b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-a72988b1-7743-4656-8439-2b104e9d121b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:20:59.209060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:20:59.210260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:20:59.212039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 601/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:20:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:20:59.217466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9feb4c-9044-4196-8dc9-fa3d9ddf7a94 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:59.372136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:59.394079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9feb4c-9044-4196-8dc9-fa3d9ddf7a94 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:59.453749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8987a-0626-4428-aa58-dd77e4cbc0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:59.454517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8987a-0626-4428-aa58-dd77e4cbc0db None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:59.454866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8987a-0626-4428-aa58-dd77e4cbc0db None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:59.455215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8987a-0626-4428-aa58-dd77e4cbc0db None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:59.456011 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8987a-0626-4428-aa58-dd77e4cbc0db None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:20:59.456405 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8987a-0626-4428-aa58-dd77e4cbc0db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:59.458016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8987a-0626-4428-aa58-dd77e4cbc0db None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:59.470719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 588/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:20:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:59.477274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72988b1-7743-4656-8439-2b104e9d121b None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:59.570879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:59.602277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72988b1-7743-4656-8439-2b104e9d121b None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:59.645366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccbc80-4574-4c75-b196-c62e485e0ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:59.646080 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccbc80-4574-4c75-b196-c62e485e0ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:59.646188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccbc80-4574-4c75-b196-c62e485e0ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:59.646461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccbc80-4574-4c75-b196-c62e485e0ea2 None admin] PATH_INFO: `/v3/users/5981be21d6f445d18d3e390ee105c162` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:59.647643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccbc80-4574-4c75-b196-c62e485e0ea2 None admin] RBAC: Authorizing `identity:get_user(user_id=5981be21d6f445d18d3e390ee105c162)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:59.649106 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccbc80-4574-4c75-b196-c62e485e0ea2 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:59.650770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 602/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:20:59 2022] GET /identity/v3/users/5981be21d6f445d18d3e390ee105c162 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:20:59.657900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8987a-0626-4428-aa58-dd77e4cbc0db None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:59.791900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8987a-0626-4428-aa58-dd77e4cbc0db None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:59.851494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2697d4-4de2-4947-8fce-fb76823a34fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:59.852339 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2697d4-4de2-4947-8fce-fb76823a34fc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:59.852742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2697d4-4de2-4947-8fce-fb76823a34fc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:59.853158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2697d4-4de2-4947-8fce-fb76823a34fc None admin] PATH_INFO: `/v3/projects/1479d221a4b149368edbb212b276de50` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:59.854513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2697d4-4de2-4947-8fce-fb76823a34fc None admin] RBAC: Authorizing `identity:get_project(project_id=1479d221a4b149368edbb212b276de50)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:59.856024 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2697d4-4de2-4947-8fce-fb76823a34fc None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:59.858278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 589/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:20:59 2022] GET /identity/v3/projects/1479d221a4b149368edbb212b276de50 => generated 361 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:20:59.866379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccbc80-4574-4c75-b196-c62e485e0ea2 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:21:00.025493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccbc80-4574-4c75-b196-c62e485e0ea2 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:21:00.090964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaffc51-5a3f-44cf-89fe-4bc66cb9dfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:21:00.092076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaffc51-5a3f-44cf-89fe-4bc66cb9dfe3 None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:00.092578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaffc51-5a3f-44cf-89fe-4bc66cb9dfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:00.093834 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaffc51-5a3f-44cf-89fe-4bc66cb9dfe3 None admin] PATH_INFO: `/v3/projects/1479d221a4b149368edbb212b276de50/users/5981be21d6f445d18d3e390ee105c162/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:00.097470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaffc51-5a3f-44cf-89fe-4bc66cb9dfe3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1479d221a4b149368edbb212b276de50, user_id=5981be21d6f445d18d3e390ee105c162, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:21:00.100314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaffc51-5a3f-44cf-89fe-4bc66cb9dfe3 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:21:00.192036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 603/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:20:59 2022] PUT /identity/v3/projects/1479d221a4b149368edbb212b276de50/users/5981be21d6f445d18d3e390ee105c162/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:21:02.277873 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa13a3-9209-4f3b-9a78-2f23054e50b8 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:02.278429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa13a3-9209-4f3b-9a78-2f23054e50b8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:02.278550 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa13a3-9209-4f3b-9a78-2f23054e50b8 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:02.279950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 590/1193] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:21:02.287129 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c79e02-93fc-4812-9d43-2178b5d23f38 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:02.287683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c79e02-93fc-4812-9d43-2178b5d23f38 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:02.287683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c79e02-93fc-4812-9d43-2178b5d23f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:02.294432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:02.308683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-42c79e02-93fc-4812-9d43-2178b5d23f38 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:21:02.313579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-42c79e02-93fc-4812-9d43-2178b5d23f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:21:02.392970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 604/1194] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:21:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:21:02.669449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa13a3-9209-4f3b-9a78-2f23054e50b8 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:21:02.698924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:02.800800 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa13a3-9209-4f3b-9a78-2f23054e50b8 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:21:02.842113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb49c35-4029-4b6f-913c-54c697cd1c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:21:02.842793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49c35-4029-4b6f-913c-54c697cd1c46 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:02.843074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49c35-4029-4b6f-913c-54c697cd1c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:02.844024 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb49c35-4029-4b6f-913c-54c697cd1c46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:02.856127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb49c35-4029-4b6f-913c-54c697cd1c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-7bb49c35-4029-4b6f-913c-54c697cd1c46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:21:02.861293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:21:02.862632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:21:02.863565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 591/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:21:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:21:02.873441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c79e02-93fc-4812-9d43-2178b5d23f38 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:21:03.010309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c79e02-93fc-4812-9d43-2178b5d23f38 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:21:03.044035 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:03.050078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa4f7c-4306-42b5-9bac-5f665b0856b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:21:03.050698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa4f7c-4306-42b5-9bac-5f665b0856b7 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:03.050976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa4f7c-4306-42b5-9bac-5f665b0856b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:03.051247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa4f7c-4306-42b5-9bac-5f665b0856b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:03.051925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa4f7c-4306-42b5-9bac-5f665b0856b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:21:03.052224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa4f7c-4306-42b5-9bac-5f665b0856b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:21:03.053661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa4f7c-4306-42b5-9bac-5f665b0856b7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:21:03.063508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 605/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:21:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:21:03.069862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb49c35-4029-4b6f-913c-54c697cd1c46 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:21:03.156080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:03.178236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb49c35-4029-4b6f-913c-54c697cd1c46 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:21:03.222186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d896075-7564-4f68-9bcf-374be1378977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:21:03.250372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d896075-7564-4f68-9bcf-374be1378977 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:03.250372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d896075-7564-4f68-9bcf-374be1378977 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:03.250372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d896075-7564-4f68-9bcf-374be1378977 None admin] PATH_INFO: `/v3/users/5981be21d6f445d18d3e390ee105c162` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:03.250372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d896075-7564-4f68-9bcf-374be1378977 None admin] RBAC: Authorizing `identity:get_user(user_id=5981be21d6f445d18d3e390ee105c162)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:21:03.250372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d896075-7564-4f68-9bcf-374be1378977 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:21:03.250372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 592/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Sep 1 05:21:03 2022] GET /identity/v3/users/5981be21d6f445d18d3e390ee105c162 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:21:03.251212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa4f7c-4306-42b5-9bac-5f665b0856b7 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:21:03.347683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa4f7c-4306-42b5-9bac-5f665b0856b7 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:21:03.385153 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d3c3a-0e19-4db1-9ced-65aff422dd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:21:03.385806 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d3c3a-0e19-4db1-9ced-65aff422dd3c None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:03.386094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d3c3a-0e19-4db1-9ced-65aff422dd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:03.386371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d3c3a-0e19-4db1-9ced-65aff422dd3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:03.455365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:03.464053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d3c3a-0e19-4db1-9ced-65aff422dd3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:21:03.478917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d3c3a-0e19-4db1-9ced-65aff422dd3c None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:21:03.581250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 606/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:21:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:21:03.588119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d896075-7564-4f68-9bcf-374be1378977 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:21:03.706477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d896075-7564-4f68-9bcf-374be1378977 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:21:03.754470 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763ebc13-4293-4200-bbdc-19ed32f4171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:21:03.755122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ebc13-4293-4200-bbdc-19ed32f4171c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:03.755401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ebc13-4293-4200-bbdc-19ed32f4171c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:03.755678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763ebc13-4293-4200-bbdc-19ed32f4171c None admin] PATH_INFO: `/v3/projects/1479d221a4b149368edbb212b276de50` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:03.756956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ebc13-4293-4200-bbdc-19ed32f4171c None admin] RBAC: Authorizing `identity:get_project(project_id=1479d221a4b149368edbb212b276de50)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:21:03.758467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763ebc13-4293-4200-bbdc-19ed32f4171c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:21:03.760217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 593/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Sep 1 05:21:03 2022] GET /identity/v3/projects/1479d221a4b149368edbb212b276de50 => generated 361 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:21:03.767358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d3c3a-0e19-4db1-9ced-65aff422dd3c None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:21:03.904758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:03.925325 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d3c3a-0e19-4db1-9ced-65aff422dd3c None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:21:03.990203 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc959a7-b83d-428a-b520-3823d25965fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:21:03.990721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc959a7-b83d-428a-b520-3823d25965fd None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:03.990996 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc959a7-b83d-428a-b520-3823d25965fd None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:03.991266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc959a7-b83d-428a-b520-3823d25965fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:03.992005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc959a7-b83d-428a-b520-3823d25965fd None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=1479d221a4b149368edbb212b276de50, user.id=5981be21d6f445d18d3e390ee105c162) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:21:03.992311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc959a7-b83d-428a-b520-3823d25965fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:21:03.993789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc959a7-b83d-428a-b520-3823d25965fd None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:21:04.001560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 607/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:21:03 2022] GET /identity/v3/role_assignments?user.id=5981be21d6f445d18d3e390ee105c162&scope.project.id=1479d221a4b149368edbb212b276de50&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:21:13.750059 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=93 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:13.997421 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=21 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:34.608828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe98600-2921-46b3-ab61-dc4a12135f47 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:34.609521 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe98600-2921-46b3-ab61-dc4a12135f47 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:34.609521 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe98600-2921-46b3-ab61-dc4a12135f47 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:34.611089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 594/1201] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:22:34.617523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c596d-cb3f-4bef-87d3-f14ca0867834 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:34.618156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c596d-cb3f-4bef-87d3-f14ca0867834 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:34.618156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c596d-cb3f-4bef-87d3-f14ca0867834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:34.639063 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-0f4c596d-cb3f-4bef-87d3-f14ca0867834 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:34.640382 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0f4c596d-cb3f-4bef-87d3-f14ca0867834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:34.739798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 608/1202] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:22:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:22:35.023199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe98600-2921-46b3-ab61-dc4a12135f47 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:35.161950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe98600-2921-46b3-ab61-dc4a12135f47 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:35.204110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c831e8-a369-4361-910e-414a99383b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:35.204770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c831e8-a369-4361-910e-414a99383b77 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:35.205051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c831e8-a369-4361-910e-414a99383b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:35.205325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c831e8-a369-4361-910e-414a99383b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:35.219365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c831e8-a369-4361-910e-414a99383b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:35.221060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c831e8-a369-4361-910e-414a99383b77 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-d3c831e8-a369-4361-910e-414a99383b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:22:35.239445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:35.241314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:22:35.243209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:22:35.243209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:35.243209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:22:35.243209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 595/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:35.251936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c596d-cb3f-4bef-87d3-f14ca0867834 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:35.390031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c596d-cb3f-4bef-87d3-f14ca0867834 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:35.427533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:35.434676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142e811e-b261-41f6-b0fe-599d232d5806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:35.436357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e811e-b261-41f6-b0fe-599d232d5806 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:35.436729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e811e-b261-41f6-b0fe-599d232d5806 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:35.437050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e811e-b261-41f6-b0fe-599d232d5806 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:35.437880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e811e-b261-41f6-b0fe-599d232d5806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:35.438232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e811e-b261-41f6-b0fe-599d232d5806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:35.439861 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142e811e-b261-41f6-b0fe-599d232d5806 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:35.453706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 609/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:35.463419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c831e8-a369-4361-910e-414a99383b77 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:35.532917 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:35.590788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c831e8-a369-4361-910e-414a99383b77 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:35.629471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f581f-1014-4829-bc82-e09eedb45e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:35.630232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f581f-1014-4829-bc82-e09eedb45e39 None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:35.630377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f581f-1014-4829-bc82-e09eedb45e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:35.630634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f581f-1014-4829-bc82-e09eedb45e39 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:35.631276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f581f-1014-4829-bc82-e09eedb45e39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:35.632727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f581f-1014-4829-bc82-e09eedb45e39 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:35.799374 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 596/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Sep 1 05:22:35 2022] POST /identity/v3/users => generated 251 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:22:37.881013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f2aad-9071-412a-a115-48afa6630388 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:37.881623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f2aad-9071-412a-a115-48afa6630388 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:37.881623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f2aad-9071-412a-a115-48afa6630388 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:37.882973 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 610/1206] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:22:37.889564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd286d-e5cd-4538-b970-eb33a6b5b2a2 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:37.890140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd286d-e5cd-4538-b970-eb33a6b5b2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:37.890140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd286d-e5cd-4538-b970-eb33a6b5b2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:37.912212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-6bbd286d-e5cd-4538-b970-eb33a6b5b2a2 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:37.913504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6bbd286d-e5cd-4538-b970-eb33a6b5b2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:37.989823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 597/1207] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:22:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:22:38.275369 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f2aad-9071-412a-a115-48afa6630388 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:38.400772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f2aad-9071-412a-a115-48afa6630388 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:38.441194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ee35a-89c8-4add-ae83-36a48ffd7707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:38.442057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ee35a-89c8-4add-ae83-36a48ffd7707 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:38.442437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ee35a-89c8-4add-ae83-36a48ffd7707 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:38.442798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ee35a-89c8-4add-ae83-36a48ffd7707 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:38.456614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ee35a-89c8-4add-ae83-36a48ffd7707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-ea4ee35a-89c8-4add-ae83-36a48ffd7707 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:22:38.461607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:38.463297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:22:38.464464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 611/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:22:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:22:38.477415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd286d-e5cd-4538-b970-eb33a6b5b2a2 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:38.541062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:38.614461 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd286d-e5cd-4538-b970-eb33a6b5b2a2 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:38.654844 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8e2f3-43f7-4250-8da7-e7e5ba2935fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:38.655464 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8e2f3-43f7-4250-8da7-e7e5ba2935fd None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:38.655740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8e2f3-43f7-4250-8da7-e7e5ba2935fd None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:38.656008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8e2f3-43f7-4250-8da7-e7e5ba2935fd None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:38.656736 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8e2f3-43f7-4250-8da7-e7e5ba2935fd None admin] RBAC: Adding query filter params (name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:38.656984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8e2f3-43f7-4250-8da7-e7e5ba2935fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:38.658429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8e2f3-43f7-4250-8da7-e7e5ba2935fd None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:38.667906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 598/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:22:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:38.678309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ee35a-89c8-4add-ae83-36a48ffd7707 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:38.770543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:38.852953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ee35a-89c8-4add-ae83-36a48ffd7707 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:38.893995 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ee353-33ba-4ef4-b878-4b4f2ba38244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:38.895054 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ee353-33ba-4ef4-b878-4b4f2ba38244 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:38.895054 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ee353-33ba-4ef4-b878-4b4f2ba38244 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:38.895357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ee353-33ba-4ef4-b878-4b4f2ba38244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:38.908582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ee353-33ba-4ef4-b878-4b4f2ba38244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:38.910142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ee353-33ba-4ef4-b878-4b4f2ba38244 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-2c5ee353-33ba-4ef4-b878-4b4f2ba38244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:22:38.928269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:38.930201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:22:38.932067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:22:38.932067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:38.932067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:22:38.932067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 612/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:38.938190 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8e2f3-43f7-4250-8da7-e7e5ba2935fd None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:39.054828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:39.058160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8e2f3-43f7-4250-8da7-e7e5ba2935fd None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:39.101847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddfd16-d484-431b-ae78-2654ebde95c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:39.102478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddfd16-d484-431b-ae78-2654ebde95c8 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:39.102753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddfd16-d484-431b-ae78-2654ebde95c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:39.103021 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddfd16-d484-431b-ae78-2654ebde95c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:39.103680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddfd16-d484-431b-ae78-2654ebde95c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:39.103978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddfd16-d484-431b-ae78-2654ebde95c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:39.105529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddfd16-d484-431b-ae78-2654ebde95c8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:39.123412 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 599/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:39.129723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ee353-33ba-4ef4-b878-4b4f2ba38244 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:39.267690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ee353-33ba-4ef4-b878-4b4f2ba38244 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:39.269696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:39.308510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb37a81-56ad-40c4-b6c5-91d8e04068e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:39.309157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb37a81-56ad-40c4-b6c5-91d8e04068e3 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:39.309468 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb37a81-56ad-40c4-b6c5-91d8e04068e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:39.310598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb37a81-56ad-40c4-b6c5-91d8e04068e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:39.319094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb37a81-56ad-40c4-b6c5-91d8e04068e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:39.320567 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb37a81-56ad-40c4-b6c5-91d8e04068e3 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-4eb37a81-56ad-40c4-b6c5-91d8e04068e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:22:39.333244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:39.336156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:39.337239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:39.337239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:39.337239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:22:39.337239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:22:39.337239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:22:39.337239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:22:39.337239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:22:39.337239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:22:39.337239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:22:39.337239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:22:39.337239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 613/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:39.343004 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddfd16-d484-431b-ae78-2654ebde95c8 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:39.464640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddfd16-d484-431b-ae78-2654ebde95c8 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:39.506455 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bf5bd-3136-4b6c-ada8-b30131dc2f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:39.507085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf5bd-3136-4b6c-ada8-b30131dc2f4a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:39.507365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf5bd-3136-4b6c-ada8-b30131dc2f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:39.507643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bf5bd-3136-4b6c-ada8-b30131dc2f4a None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:39.508386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bf5bd-3136-4b6c-ada8-b30131dc2f4a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:39.508693 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bf5bd-3136-4b6c-ada8-b30131dc2f4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:39.510194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bf5bd-3136-4b6c-ada8-b30131dc2f4a None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:39.531545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 600/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Sep 1 05:22:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:39.537759 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb37a81-56ad-40c4-b6c5-91d8e04068e3 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:39.657938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb37a81-56ad-40c4-b6c5-91d8e04068e3 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:39.719556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660bcda-2804-44ea-ac3d-76b04d69c595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:39.720510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660bcda-2804-44ea-ac3d-76b04d69c595 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:39.721011 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660bcda-2804-44ea-ac3d-76b04d69c595 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:39.721592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660bcda-2804-44ea-ac3d-76b04d69c595 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:39.758691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:39.800448 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660bcda-2804-44ea-ac3d-76b04d69c595 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:39.802015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660bcda-2804-44ea-ac3d-76b04d69c595 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:39.986295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 614/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:22:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:39.992717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bf5bd-3136-4b6c-ada8-b30131dc2f4a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:40.015379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:40.110003 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bf5bd-3136-4b6c-ada8-b30131dc2f4a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:40.152798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8be1c3-04ec-4c77-b1ac-274c2c740be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:40.154378 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8be1c3-04ec-4c77-b1ac-274c2c740be7 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:40.154777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8be1c3-04ec-4c77-b1ac-274c2c740be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:40.155118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8be1c3-04ec-4c77-b1ac-274c2c740be7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:40.168554 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8be1c3-04ec-4c77-b1ac-274c2c740be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:40.170360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8be1c3-04ec-4c77-b1ac-274c2c740be7 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-4f8be1c3-04ec-4c77-b1ac-274c2c740be7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:22:40.189249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:40.191293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:22:40.193185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:22:40.193185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:40.193185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:22:40.193185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 601/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:22:40.199589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660bcda-2804-44ea-ac3d-76b04d69c595 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:40.277412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:40.321830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660bcda-2804-44ea-ac3d-76b04d69c595 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:40.363740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287e811-c9af-4df2-a761-065152e41349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:40.364371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287e811-c9af-4df2-a761-065152e41349 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:40.364653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287e811-c9af-4df2-a761-065152e41349 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:40.364926 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287e811-c9af-4df2-a761-065152e41349 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:40.365657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287e811-c9af-4df2-a761-065152e41349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:40.366008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287e811-c9af-4df2-a761-065152e41349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:40.367483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7287e811-c9af-4df2-a761-065152e41349 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:40.381031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 615/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:40.387294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8be1c3-04ec-4c77-b1ac-274c2c740be7 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:40.476540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:40.511217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8be1c3-04ec-4c77-b1ac-274c2c740be7 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:40.549703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d5481-8156-428e-bb8c-4a1c9ff9a1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:40.550326 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d5481-8156-428e-bb8c-4a1c9ff9a1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:40.550647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d5481-8156-428e-bb8c-4a1c9ff9a1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:40.550965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d5481-8156-428e-bb8c-4a1c9ff9a1d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:40.558620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d5481-8156-428e-bb8c-4a1c9ff9a1d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:40.560644 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d5481-8156-428e-bb8c-4a1c9ff9a1d9 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-3f1d5481-8156-428e-bb8c-4a1c9ff9a1d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:22:40.573575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:40.574761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:40.576081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:22:40.576081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:22:40.576081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:22:40.576081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:22:40.576081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:22:40.576081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:22:40.576081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:22:40.576081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:22:40.576081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 602/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:22:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:40.582188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287e811-c9af-4df2-a761-065152e41349 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:40.695024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287e811-c9af-4df2-a761-065152e41349 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:40.720917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:40.733487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bb8a3-c0c9-45a5-8a01-fdd5ae0ec5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:40.734112 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bb8a3-c0c9-45a5-8a01-fdd5ae0ec5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:40.734397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bb8a3-c0c9-45a5-8a01-fdd5ae0ec5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:40.734671 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bb8a3-c0c9-45a5-8a01-fdd5ae0ec5c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:40.735379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bb8a3-c0c9-45a5-8a01-fdd5ae0ec5c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:40.735686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bb8a3-c0c9-45a5-8a01-fdd5ae0ec5c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:40.737194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bb8a3-c0c9-45a5-8a01-fdd5ae0ec5c2 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:40.751296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 616/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:22:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:40.758344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d5481-8156-428e-bb8c-4a1c9ff9a1d9 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:40.867624 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d5481-8156-428e-bb8c-4a1c9ff9a1d9 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:40.899320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:40.907062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796d097-0b80-40d7-a2f0-0a7ecf4f515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:40.907802 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796d097-0b80-40d7-a2f0-0a7ecf4f515f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:40.908124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796d097-0b80-40d7-a2f0-0a7ecf4f515f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:40.908451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796d097-0b80-40d7-a2f0-0a7ecf4f515f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:40.909267 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796d097-0b80-40d7-a2f0-0a7ecf4f515f None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=055823f7760f485eb91266a0d63db602) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:40.909714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796d097-0b80-40d7-a2f0-0a7ecf4f515f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:40.911281 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796d097-0b80-40d7-a2f0-0a7ecf4f515f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:40.918129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 603/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:22:40 2022] GET /identity/v3/role_assignments?user.id=055823f7760f485eb91266a0d63db602&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:43.534860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6957-95de-47b5-b452-c461593f0910 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:43.535494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6957-95de-47b5-b452-c461593f0910 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:43.535494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6957-95de-47b5-b452-c461593f0910 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:43.536792 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 617/1220] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:22:43.542781 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0d42d-2fa9-404e-b762-fdc74989988c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:43.543417 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0d42d-2fa9-404e-b762-fdc74989988c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:43.543417 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0d42d-2fa9-404e-b762-fdc74989988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:43.563148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b1c0d42d-2fa9-404e-b762-fdc74989988c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:43.564385 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b1c0d42d-2fa9-404e-b762-fdc74989988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:43.642256 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 604/1221] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:22:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:22:43.928650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f6957-95de-47b5-b452-c461593f0910 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:44.060451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f6957-95de-47b5-b452-c461593f0910 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:44.100274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeec17-565d-43ff-a83d-c3c36e0f114d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:44.100968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeec17-565d-43ff-a83d-c3c36e0f114d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:44.101295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeec17-565d-43ff-a83d-c3c36e0f114d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:44.101643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feeec17-565d-43ff-a83d-c3c36e0f114d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:44.118030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feeec17-565d-43ff-a83d-c3c36e0f114d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-5feeec17-565d-43ff-a83d-c3c36e0f114d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:22:44.123900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:44.126207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:22:44.128123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 618/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:22:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:44.133162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0d42d-2fa9-404e-b762-fdc74989988c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:44.282671 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0d42d-2fa9-404e-b762-fdc74989988c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:44.327391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:44.347280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51be62-a0f9-4119-8b60-1b0a851cc9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:44.348398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51be62-a0f9-4119-8b60-1b0a851cc9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:44.348891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51be62-a0f9-4119-8b60-1b0a851cc9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:44.349411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51be62-a0f9-4119-8b60-1b0a851cc9a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:44.350719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51be62-a0f9-4119-8b60-1b0a851cc9a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:44.351198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51be62-a0f9-4119-8b60-1b0a851cc9a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:44.353844 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51be62-a0f9-4119-8b60-1b0a851cc9a8 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:44.370329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 605/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:22:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:22:44.376701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeec17-565d-43ff-a83d-c3c36e0f114d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:44.428630 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:44.493976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feeec17-565d-43ff-a83d-c3c36e0f114d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:44.540316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4e26-c15d-4ed2-8cc3-ccc16e8df752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:44.541238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4e26-c15d-4ed2-8cc3-ccc16e8df752 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:44.544586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4e26-c15d-4ed2-8cc3-ccc16e8df752 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:44.544586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4e26-c15d-4ed2-8cc3-ccc16e8df752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:44.557226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef4e26-c15d-4ed2-8cc3-ccc16e8df752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:44.560172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef4e26-c15d-4ed2-8cc3-ccc16e8df752 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-06ef4e26-c15d-4ed2-8cc3-ccc16e8df752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:22:44.578605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:44.580514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:22:44.582767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:22:44.582767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:44.582767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:22:44.582767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 619/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:22:44.587864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51be62-a0f9-4119-8b60-1b0a851cc9a8 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:44.734201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51be62-a0f9-4119-8b60-1b0a851cc9a8 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:44.773864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650023b-7dc4-470d-a5b0-869cec6bf227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:44.774498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650023b-7dc4-470d-a5b0-869cec6bf227 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:44.774775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650023b-7dc4-470d-a5b0-869cec6bf227 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:44.775052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650023b-7dc4-470d-a5b0-869cec6bf227 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:44.775723 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650023b-7dc4-470d-a5b0-869cec6bf227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:44.776032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650023b-7dc4-470d-a5b0-869cec6bf227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:44.777491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650023b-7dc4-470d-a5b0-869cec6bf227 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:44.792969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 606/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:44.799778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4e26-c15d-4ed2-8cc3-ccc16e8df752 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:44.918191 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:44.926284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4e26-c15d-4ed2-8cc3-ccc16e8df752 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:44.967770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f92898-ed98-40f7-8057-60cb1119cf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:44.968431 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f92898-ed98-40f7-8057-60cb1119cf61 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:44.968715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f92898-ed98-40f7-8057-60cb1119cf61 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:44.968988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f92898-ed98-40f7-8057-60cb1119cf61 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:44.978064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f92898-ed98-40f7-8057-60cb1119cf61 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:44.979544 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f92898-ed98-40f7-8057-60cb1119cf61 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-56f92898-ed98-40f7-8057-60cb1119cf61 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:22:44.992490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:44.994282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:44.996076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:44.996076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:44.996076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:22:44.996076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:22:44.996076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:22:44.996076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:22:44.996076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:22:44.996076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:22:44.996076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:22:44.996076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:22:44.996076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 620/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:45.001894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650023b-7dc4-470d-a5b0-869cec6bf227 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:45.056429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:45.117008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650023b-7dc4-470d-a5b0-869cec6bf227 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:45.160101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b9e30-6e51-4af3-b89a-df41742d6d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:45.160730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b9e30-6e51-4af3-b89a-df41742d6d13 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:45.161010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b9e30-6e51-4af3-b89a-df41742d6d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:45.161282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b9e30-6e51-4af3-b89a-df41742d6d13 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:45.162069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b9e30-6e51-4af3-b89a-df41742d6d13 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:45.162377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b9e30-6e51-4af3-b89a-df41742d6d13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:45.163842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b9e30-6e51-4af3-b89a-df41742d6d13 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:45.184030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 607/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Sep 1 05:22:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:45.191350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f92898-ed98-40f7-8057-60cb1119cf61 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:45.365995 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f92898-ed98-40f7-8057-60cb1119cf61 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:45.425848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9abcb-f86e-46d1-8bc2-33dd915b0f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:45.426508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9abcb-f86e-46d1-8bc2-33dd915b0f99 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:45.426787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9abcb-f86e-46d1-8bc2-33dd915b0f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:45.427085 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9abcb-f86e-46d1-8bc2-33dd915b0f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:45.440198 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9abcb-f86e-46d1-8bc2-33dd915b0f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:45.445043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9abcb-f86e-46d1-8bc2-33dd915b0f99 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-3ac9abcb-f86e-46d1-8bc2-33dd915b0f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:22:45.459471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:45.460715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:22:45.461927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:22:45.461927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:45.461927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:22:45.461927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 621/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:45.468114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b9e30-6e51-4af3-b89a-df41742d6d13 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:45.581000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b9e30-6e51-4af3-b89a-df41742d6d13 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:45.585585 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:45.627430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5d45-acb3-4f9f-a84c-7713ab53f15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:45.628105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5d45-acb3-4f9f-a84c-7713ab53f15f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:45.628343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5d45-acb3-4f9f-a84c-7713ab53f15f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:45.628643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5d45-acb3-4f9f-a84c-7713ab53f15f None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:45.629319 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b5d45-acb3-4f9f-a84c-7713ab53f15f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:45.629670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b5d45-acb3-4f9f-a84c-7713ab53f15f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:45.631094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b5d45-acb3-4f9f-a84c-7713ab53f15f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:45.644894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 608/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:22:45.655195 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9abcb-f86e-46d1-8bc2-33dd915b0f99 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:45.671659 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:45.808062 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9abcb-f86e-46d1-8bc2-33dd915b0f99 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:45.852575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32f69-cf5b-4b5e-8c20-b2665220d0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:45.853257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32f69-cf5b-4b5e-8c20-b2665220d0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:45.857710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32f69-cf5b-4b5e-8c20-b2665220d0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:45.857710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32f69-cf5b-4b5e-8c20-b2665220d0f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:45.862000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32f69-cf5b-4b5e-8c20-b2665220d0f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:45.863482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32f69-cf5b-4b5e-8c20-b2665220d0f9 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-fee32f69-cf5b-4b5e-8c20-b2665220d0f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:22:45.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:45.879424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:45.881413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:22:45.881413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:22:45.881413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:22:45.881413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:22:45.881413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:22:45.881413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:22:45.881413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:22:45.881413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:22:45.881413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 622/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:22:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:45.890196 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5d45-acb3-4f9f-a84c-7713ab53f15f None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:46.074432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5d45-acb3-4f9f-a84c-7713ab53f15f None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:46.116414 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed5ef4-e43a-46b5-b864-4adf3fc61d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:46.117042 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed5ef4-e43a-46b5-b864-4adf3fc61d0e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:46.117327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed5ef4-e43a-46b5-b864-4adf3fc61d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:46.117641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed5ef4-e43a-46b5-b864-4adf3fc61d0e None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:46.118348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed5ef4-e43a-46b5-b864-4adf3fc61d0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:46.118658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed5ef4-e43a-46b5-b864-4adf3fc61d0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:46.120143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed5ef4-e43a-46b5-b864-4adf3fc61d0e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:46.138465 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 609/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:22:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:46.142575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32f69-cf5b-4b5e-8c20-b2665220d0f9 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:46.247770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:46.287128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32f69-cf5b-4b5e-8c20-b2665220d0f9 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:46.326781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeab70e-bc7d-4fef-a8ca-4c04b0698c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:46.327613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeab70e-bc7d-4fef-a8ca-4c04b0698c4a None admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:46.327939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeab70e-bc7d-4fef-a8ca-4c04b0698c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:46.328260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeab70e-bc7d-4fef-a8ca-4c04b0698c4a None admin] PATH_INFO: `/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/055823f7760f485eb91266a0d63db602/roles/64f98692a39a4f16bab66cd26ad8f65e` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:46.346944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeab70e-bc7d-4fef-a8ca-4c04b0698c4a None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c3fe9229c45f1bfd295115ef94cd7, user_id=055823f7760f485eb91266a0d63db602, role_id=64f98692a39a4f16bab66cd26ad8f65e)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:46.348417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeab70e-bc7d-4fef-a8ca-4c04b0698c4a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:46.465584 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 623/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:22:46 2022] PUT /identity/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/055823f7760f485eb91266a0d63db602/roles/64f98692a39a4f16bab66cd26ad8f65e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:48.484550 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894bc64-dc9d-4da9-83d4-1b044aa0abcf None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:48.485267 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894bc64-dc9d-4da9-83d4-1b044aa0abcf None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:48.485267 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894bc64-dc9d-4da9-83d4-1b044aa0abcf None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:48.486513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 610/1233] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:22:48.492738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948488b4-019f-4aa8-8a82-062abef2691c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:48.493451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948488b4-019f-4aa8-8a82-062abef2691c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:48.493451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948488b4-019f-4aa8-8a82-062abef2691c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:48.515378 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-948488b4-019f-4aa8-8a82-062abef2691c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:48.516687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-948488b4-019f-4aa8-8a82-062abef2691c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:48.598307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 624/1234] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:22:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:22:48.891755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894bc64-dc9d-4da9-83d4-1b044aa0abcf None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:48.929128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:49.021098 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894bc64-dc9d-4da9-83d4-1b044aa0abcf None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:49.062123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e043c-5ff6-4feb-85ca-a2152e20bd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:49.062782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e043c-5ff6-4feb-85ca-a2152e20bd7a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:49.063066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e043c-5ff6-4feb-85ca-a2152e20bd7a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:49.063344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e043c-5ff6-4feb-85ca-a2152e20bd7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:49.079490 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e043c-5ff6-4feb-85ca-a2152e20bd7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-a41e043c-5ff6-4feb-85ca-a2152e20bd7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:22:49.084183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:49.086093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:49.087714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:49.087714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:49.087714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:49.087714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:49.087714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:22:49.087714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:22:49.087714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:22:49.087714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:22:49.087714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:22:49.087714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:22:49.087714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:22:49.087714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:22:49.090961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 611/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Sep 1 05:22:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:49.093023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948488b4-019f-4aa8-8a82-062abef2691c None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:49.151432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:49.213489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948488b4-019f-4aa8-8a82-062abef2691c None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:49.253611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813767f-6f7d-4013-b8e6-765fa39acd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:49.254234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813767f-6f7d-4013-b8e6-765fa39acd8d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:49.254516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813767f-6f7d-4013-b8e6-765fa39acd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:49.254789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813767f-6f7d-4013-b8e6-765fa39acd8d None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:49.255465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813767f-6f7d-4013-b8e6-765fa39acd8d None admin] RBAC: Adding query filter params (name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:49.255770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813767f-6f7d-4013-b8e6-765fa39acd8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:49.257170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813767f-6f7d-4013-b8e6-765fa39acd8d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:49.266603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 625/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Sep 1 05:22:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:49.272701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e043c-5ff6-4feb-85ca-a2152e20bd7a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:49.373980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:49.392965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e043c-5ff6-4feb-85ca-a2152e20bd7a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:49.431499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f14410-cbdb-44f9-9215-bc715d83de4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:49.432149 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f14410-cbdb-44f9-9215-bc715d83de4c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:49.432427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f14410-cbdb-44f9-9215-bc715d83de4c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:49.432793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f14410-cbdb-44f9-9215-bc715d83de4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:49.445666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f14410-cbdb-44f9-9215-bc715d83de4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:49.447206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f14410-cbdb-44f9-9215-bc715d83de4c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-a2f14410-cbdb-44f9-9215-bc715d83de4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:22:49.464874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:49.467210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:22:49.469075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:22:49.469075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:49.469075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:22:49.469075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 612/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:49.477930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813767f-6f7d-4013-b8e6-765fa39acd8d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:49.663509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813767f-6f7d-4013-b8e6-765fa39acd8d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:49.674879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:49.703707 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbbc66-333b-41ca-9d38-c717cb867a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:49.704439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbbc66-333b-41ca-9d38-c717cb867a37 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:49.704584 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbbc66-333b-41ca-9d38-c717cb867a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:49.704847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbbc66-333b-41ca-9d38-c717cb867a37 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:49.705533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbbc66-333b-41ca-9d38-c717cb867a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:49.705831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbbc66-333b-41ca-9d38-c717cb867a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:49.707212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbbc66-333b-41ca-9d38-c717cb867a37 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:49.724220 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 626/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:49.732552 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f14410-cbdb-44f9-9215-bc715d83de4c None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:49.852114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f14410-cbdb-44f9-9215-bc715d83de4c None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:49.894212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc85454-8709-4041-8bb9-15d844e910d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:49.894885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc85454-8709-4041-8bb9-15d844e910d2 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:49.895151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc85454-8709-4041-8bb9-15d844e910d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:49.895424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc85454-8709-4041-8bb9-15d844e910d2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:49.898791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:49.905588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc85454-8709-4041-8bb9-15d844e910d2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:49.907182 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc85454-8709-4041-8bb9-15d844e910d2 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-3fc85454-8709-4041-8bb9-15d844e910d2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:22:49.920094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:49.921964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:49.923807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:49.923807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:49.923807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:22:49.923807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:22:49.923807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:22:49.923807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:22:49.923807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:22:49.923807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:22:49.923807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:22:49.923807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:22:49.923807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 613/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:49.928136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbbc66-333b-41ca-9d38-c717cb867a37 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:50.082926 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbbc66-333b-41ca-9d38-c717cb867a37 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:50.126010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bba35-3b13-4ddb-8bf0-4f9dddcc90d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:50.126801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bba35-3b13-4ddb-8bf0-4f9dddcc90d5 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:50.127125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bba35-3b13-4ddb-8bf0-4f9dddcc90d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:50.127467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19bba35-3b13-4ddb-8bf0-4f9dddcc90d5 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:50.128375 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bba35-3b13-4ddb-8bf0-4f9dddcc90d5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:50.128826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bba35-3b13-4ddb-8bf0-4f9dddcc90d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:50.130438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19bba35-3b13-4ddb-8bf0-4f9dddcc90d5 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:50.151642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 627/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Sep 1 05:22:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:22:50.159369 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc85454-8709-4041-8bb9-15d844e910d2 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:50.285703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc85454-8709-4041-8bb9-15d844e910d2 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:50.327174 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724fcff-38cc-4149-af87-8f288eec1fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:50.333161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724fcff-38cc-4149-af87-8f288eec1fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:50.333161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724fcff-38cc-4149-af87-8f288eec1fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:50.333161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724fcff-38cc-4149-af87-8f288eec1fe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:50.414654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:50.423195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724fcff-38cc-4149-af87-8f288eec1fe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:50.424629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724fcff-38cc-4149-af87-8f288eec1fe4 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:50.585440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 614/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:22:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:50.592138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bba35-3b13-4ddb-8bf0-4f9dddcc90d5 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:50.628716 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:50.720623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19bba35-3b13-4ddb-8bf0-4f9dddcc90d5 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:50.760602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52ceb-969d-4a6b-a9f8-b5fd1f53d352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:50.761327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52ceb-969d-4a6b-a9f8-b5fd1f53d352 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:50.761550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52ceb-969d-4a6b-a9f8-b5fd1f53d352 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:50.761818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52ceb-969d-4a6b-a9f8-b5fd1f53d352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:50.774913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c52ceb-969d-4a6b-a9f8-b5fd1f53d352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:50.777927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c52ceb-969d-4a6b-a9f8-b5fd1f53d352 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-63c52ceb-969d-4a6b-a9f8-b5fd1f53d352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:22:50.793356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:50.795826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:22:50.797559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:22:50.797559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:50.797559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:22:50.797559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 628/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:50.802672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724fcff-38cc-4149-af87-8f288eec1fe4 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:50.950780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:50.962404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724fcff-38cc-4149-af87-8f288eec1fe4 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:51.026729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0298891-290b-41d1-aa40-46e10fcaf306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:51.027780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0298891-290b-41d1-aa40-46e10fcaf306 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:51.028772 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0298891-290b-41d1-aa40-46e10fcaf306 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:51.029261 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0298891-290b-41d1-aa40-46e10fcaf306 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:51.031229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0298891-290b-41d1-aa40-46e10fcaf306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:51.031711 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0298891-290b-41d1-aa40-46e10fcaf306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:51.034402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0298891-290b-41d1-aa40-46e10fcaf306 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:51.058117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 615/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:22:51.065262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52ceb-969d-4a6b-a9f8-b5fd1f53d352 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:51.157960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:51.183908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52ceb-969d-4a6b-a9f8-b5fd1f53d352 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:51.224338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db7bfb-c99e-4e21-a694-bafd3a219c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:51.225036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db7bfb-c99e-4e21-a694-bafd3a219c76 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:51.225452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db7bfb-c99e-4e21-a694-bafd3a219c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:51.225817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db7bfb-c99e-4e21-a694-bafd3a219c76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:51.234128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db7bfb-c99e-4e21-a694-bafd3a219c76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:51.235596 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db7bfb-c99e-4e21-a694-bafd3a219c76 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-d8db7bfb-c99e-4e21-a694-bafd3a219c76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:22:51.248692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:51.250436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:51.252206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:22:51.252206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:22:51.252206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:22:51.252206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:22:51.252206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:22:51.252206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:22:51.252206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:22:51.252206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:22:51.253575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 629/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:22:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:51.256016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0298891-290b-41d1-aa40-46e10fcaf306 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:51.373615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0298891-290b-41d1-aa40-46e10fcaf306 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:51.413156 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f83a31-4be2-444f-b79f-2a7e91d3fa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:51.413891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83a31-4be2-444f-b79f-2a7e91d3fa17 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:51.414231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83a31-4be2-444f-b79f-2a7e91d3fa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:51.414621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83a31-4be2-444f-b79f-2a7e91d3fa17 None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:51.415407 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f83a31-4be2-444f-b79f-2a7e91d3fa17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:51.415756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f83a31-4be2-444f-b79f-2a7e91d3fa17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:51.417304 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f83a31-4be2-444f-b79f-2a7e91d3fa17 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:51.432425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 616/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:22:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:51.439801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db7bfb-c99e-4e21-a694-bafd3a219c76 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:51.556155 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db7bfb-c99e-4e21-a694-bafd3a219c76 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:51.599854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ed593-aa73-4ae3-bee6-2170619332e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:51.600457 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ed593-aa73-4ae3-bee6-2170619332e2 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:51.600731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ed593-aa73-4ae3-bee6-2170619332e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:51.600998 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ed593-aa73-4ae3-bee6-2170619332e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:51.601766 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ed593-aa73-4ae3-bee6-2170619332e2 None admin] RBAC: Adding query filter params (role.id=64f98692a39a4f16bab66cd26ad8f65e, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=055823f7760f485eb91266a0d63db602) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:51.602072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ed593-aa73-4ae3-bee6-2170619332e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:51.603545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ed593-aa73-4ae3-bee6-2170619332e2 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:51.610432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 630/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:22:51 2022] GET /identity/v3/role_assignments?user.id=055823f7760f485eb91266a0d63db602&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=64f98692a39a4f16bab66cd26ad8f65e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:53.748334 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6614d-b2f4-4984-b8f4-5cdc3637845b None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:53.749255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6614d-b2f4-4984-b8f4-5cdc3637845b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:53.749490 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6614d-b2f4-4984-b8f4-5cdc3637845b None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:53.751303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 617/1247] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:22:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:22:53.758017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cf902-7563-4f27-a16b-2a270b63bce7 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:53.758849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cf902-7563-4f27-a16b-2a270b63bce7 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:53.758849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301cf902-7563-4f27-a16b-2a270b63bce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:53.769515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:53.784877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-301cf902-7563-4f27-a16b-2a270b63bce7 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:53.786083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-301cf902-7563-4f27-a16b-2a270b63bce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:53.870588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 631/1248] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:22:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:22:54.206337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6614d-b2f4-4984-b8f4-5cdc3637845b None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:54.227790 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:54.329997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6614d-b2f4-4984-b8f4-5cdc3637845b None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:54.383123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b140b-5a0b-438e-826c-bac5d19745f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:54.383861 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b140b-5a0b-438e-826c-bac5d19745f5 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:54.384063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b140b-5a0b-438e-826c-bac5d19745f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:54.384335 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b140b-5a0b-438e-826c-bac5d19745f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:54.397877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b140b-5a0b-438e-826c-bac5d19745f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-f82b140b-5a0b-438e-826c-bac5d19745f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:22:54.403018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:54.404778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:22:54.406068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 618/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:22:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:54.411720 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cf902-7563-4f27-a16b-2a270b63bce7 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:54.538342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301cf902-7563-4f27-a16b-2a270b63bce7 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:54.587794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:54.596811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7674e5a-a570-4f5b-a9e7-2e1b7bceb2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:54.597970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7674e5a-a570-4f5b-a9e7-2e1b7bceb2ea None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:54.598455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7674e5a-a570-4f5b-a9e7-2e1b7bceb2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:54.598939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7674e5a-a570-4f5b-a9e7-2e1b7bceb2ea None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:54.600169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7674e5a-a570-4f5b-a9e7-2e1b7bceb2ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:54.600707 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7674e5a-a570-4f5b-a9e7-2e1b7bceb2ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:54.603448 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7674e5a-a570-4f5b-a9e7-2e1b7bceb2ea None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:54.620874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 632/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:22:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:54.626720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b140b-5a0b-438e-826c-bac5d19745f5 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:54.727135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:54.755030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b140b-5a0b-438e-826c-bac5d19745f5 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:54.795710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f29d8-23d2-484c-b6c9-c5e7406464cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:54.796210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f29d8-23d2-484c-b6c9-c5e7406464cc None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:54.796487 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f29d8-23d2-484c-b6c9-c5e7406464cc None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:54.796760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f29d8-23d2-484c-b6c9-c5e7406464cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:54.809887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f29d8-23d2-484c-b6c9-c5e7406464cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:54.811401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f29d8-23d2-484c-b6c9-c5e7406464cc None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-a19f29d8-23d2-484c-b6c9-c5e7406464cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:22:54.830666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:54.832463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:22:54.834200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:22:54.834200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:54.834200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:22:54.834200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 619/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:22:54.842803 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7674e5a-a570-4f5b-a9e7-2e1b7bceb2ea None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:54.966375 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7674e5a-a570-4f5b-a9e7-2e1b7bceb2ea None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:55.007724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4dde5-067c-43ba-901a-be17d21738b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:55.008400 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4dde5-067c-43ba-901a-be17d21738b6 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:55.008731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4dde5-067c-43ba-901a-be17d21738b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:55.009053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4dde5-067c-43ba-901a-be17d21738b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:55.009814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4dde5-067c-43ba-901a-be17d21738b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:55.010167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4dde5-067c-43ba-901a-be17d21738b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:55.011622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4dde5-067c-43ba-901a-be17d21738b6 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:55.026123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 633/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:22:55.032813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f29d8-23d2-484c-b6c9-c5e7406464cc None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:55.152860 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f29d8-23d2-484c-b6c9-c5e7406464cc None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:55.187401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:55.200474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38c65c-8bc5-4185-98fa-121c212af123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:55.201471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38c65c-8bc5-4185-98fa-121c212af123 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:55.201867 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38c65c-8bc5-4185-98fa-121c212af123 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:55.202286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38c65c-8bc5-4185-98fa-121c212af123 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:55.217174 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38c65c-8bc5-4185-98fa-121c212af123 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:55.219586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38c65c-8bc5-4185-98fa-121c212af123 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-aa38c65c-8bc5-4185-98fa-121c212af123 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:22:55.241906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:55.243438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:55.244520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:55.244520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:55.244520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:22:55.244520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:22:55.244520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:22:55.244520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:22:55.244520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:22:55.244520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:22:55.244520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:22:55.244520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:22:55.244520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 620/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:55.250347 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4dde5-067c-43ba-901a-be17d21738b6 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:55.316535 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:55.367989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4dde5-067c-43ba-901a-be17d21738b6 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:55.407912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a961c4f-4114-4014-b77a-5a78acf74a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:55.408574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a961c4f-4114-4014-b77a-5a78acf74a40 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:55.408865 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a961c4f-4114-4014-b77a-5a78acf74a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:55.409134 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a961c4f-4114-4014-b77a-5a78acf74a40 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:55.409917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a961c4f-4114-4014-b77a-5a78acf74a40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:55.410222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a961c4f-4114-4014-b77a-5a78acf74a40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:55.411687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a961c4f-4114-4014-b77a-5a78acf74a40 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:55.432021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 634/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Sep 1 05:22:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:22:55.442669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38c65c-8bc5-4185-98fa-121c212af123 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:55.568371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38c65c-8bc5-4185-98fa-121c212af123 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:55.609303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53a356-dd62-4a8d-b2df-eebaf70d2ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:55.609966 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53a356-dd62-4a8d-b2df-eebaf70d2ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:55.610252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53a356-dd62-4a8d-b2df-eebaf70d2ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:55.610636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53a356-dd62-4a8d-b2df-eebaf70d2ac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:55.677776 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:55.692457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53a356-dd62-4a8d-b2df-eebaf70d2ac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:55.693990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53a356-dd62-4a8d-b2df-eebaf70d2ac1 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:55.811282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 621/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:22:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:22:55.820489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a961c4f-4114-4014-b77a-5a78acf74a40 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:55.950899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a961c4f-4114-4014-b77a-5a78acf74a40 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:55.968681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:55.993520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4706b86-8167-4a04-855c-4163f28fef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:55.994300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4706b86-8167-4a04-855c-4163f28fef14 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:55.994674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4706b86-8167-4a04-855c-4163f28fef14 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:55.995033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4706b86-8167-4a04-855c-4163f28fef14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:56.013569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4706b86-8167-4a04-855c-4163f28fef14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:56.016403 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4706b86-8167-4a04-855c-4163f28fef14 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-b4706b86-8167-4a04-855c-4163f28fef14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:22:56.046875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:56.048309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:22:56.049480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:22:56.049480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:56.049480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:22:56.049480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 635/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:56.055349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53a356-dd62-4a8d-b2df-eebaf70d2ac1 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:56.162794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:56.178916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53a356-dd62-4a8d-b2df-eebaf70d2ac1 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:56.237136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10a8cd-1580-4335-8f0a-25a8d117644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:56.237136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a8cd-1580-4335-8f0a-25a8d117644e None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:56.237136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a8cd-1580-4335-8f0a-25a8d117644e None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:56.237136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10a8cd-1580-4335-8f0a-25a8d117644e None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:56.237679 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10a8cd-1580-4335-8f0a-25a8d117644e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:56.237679 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10a8cd-1580-4335-8f0a-25a8d117644e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:56.237679 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10a8cd-1580-4335-8f0a-25a8d117644e None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:56.237971 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 622/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:22:56.244718 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4706b86-8167-4a04-855c-4163f28fef14 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:56.380747 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4706b86-8167-4a04-855c-4163f28fef14 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:56.421764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278816b-13be-4a82-ac73-d760261b6b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:56.422420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278816b-13be-4a82-ac73-d760261b6b40 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:56.422701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278816b-13be-4a82-ac73-d760261b6b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:56.422977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278816b-13be-4a82-ac73-d760261b6b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:56.430808 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278816b-13be-4a82-ac73-d760261b6b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:56.432276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278816b-13be-4a82-ac73-d760261b6b40 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-c278816b-13be-4a82-ac73-d760261b6b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:22:56.446311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:56.447631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:56.448562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:22:56.448562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:22:56.448562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:22:56.448562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:22:56.448562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:22:56.448562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:22:56.448562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:22:56.448562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:22:56.448562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 636/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:22:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:56.457852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10a8cd-1580-4335-8f0a-25a8d117644e None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:56.612187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10a8cd-1580-4335-8f0a-25a8d117644e None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:56.676639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceba10-bcad-4219-8d74-a0727421789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:56.677726 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceba10-bcad-4219-8d74-a0727421789c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:56.678216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceba10-bcad-4219-8d74-a0727421789c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:56.678708 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceba10-bcad-4219-8d74-a0727421789c None admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:56.680113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ceba10-bcad-4219-8d74-a0727421789c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:56.680666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ceba10-bcad-4219-8d74-a0727421789c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:56.683268 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ceba10-bcad-4219-8d74-a0727421789c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:56.697272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 623/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:22:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:56.708282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278816b-13be-4a82-ac73-d760261b6b40 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:56.737496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:56.829779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278816b-13be-4a82-ac73-d760261b6b40 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:56.867906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f9a4-e233-4d83-9e08-db0f9fe6d9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:56.868426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f9a4-e233-4d83-9e08-db0f9fe6d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:56.868704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f9a4-e233-4d83-9e08-db0f9fe6d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:56.868976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f9a4-e233-4d83-9e08-db0f9fe6d9c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:56.869811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478f9a4-e233-4d83-9e08-db0f9fe6d9c0 None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=055823f7760f485eb91266a0d63db602) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:56.870119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478f9a4-e233-4d83-9e08-db0f9fe6d9c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:56.872113 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478f9a4-e233-4d83-9e08-db0f9fe6d9c0 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:56.879104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 637/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:22:56 2022] GET /identity/v3/role_assignments?user.id=055823f7760f485eb91266a0d63db602&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:58.883346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75c198-faa6-429a-8ca3-f07206b38a02 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:58.883905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75c198-faa6-429a-8ca3-f07206b38a02 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:58.883905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75c198-faa6-429a-8ca3-f07206b38a02 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:58.885410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 624/1261] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:22:58.893739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222deaed-b844-475d-9828-948d5193b4a0 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:58.894510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222deaed-b844-475d-9828-948d5193b4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:58.894641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222deaed-b844-475d-9828-948d5193b4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:58.926448 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-222deaed-b844-475d-9828-948d5193b4a0 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:22:58.928658 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-222deaed-b844-475d-9828-948d5193b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:22:59.012610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 638/1262] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:22:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:22:59.290932 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75c198-faa6-429a-8ca3-f07206b38a02 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:59.303504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:59.409733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75c198-faa6-429a-8ca3-f07206b38a02 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:59.450881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fde46-799f-45ab-a3dd-9b42dd1e82e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:59.451623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fde46-799f-45ab-a3dd-9b42dd1e82e9 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:59.451908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fde46-799f-45ab-a3dd-9b42dd1e82e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:59.452182 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fde46-799f-45ab-a3dd-9b42dd1e82e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:59.464614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fde46-799f-45ab-a3dd-9b42dd1e82e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-cf9fde46-799f-45ab-a3dd-9b42dd1e82e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:22:59.470395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:59.472337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:22:59.474006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 625/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:22:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:22:59.479580 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222deaed-b844-475d-9828-948d5193b4a0 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:59.501667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:59.601355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222deaed-b844-475d-9828-948d5193b4a0 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:59.643666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09293de3-af38-4f0e-a1ab-2fd88f01b841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:59.644335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09293de3-af38-4f0e-a1ab-2fd88f01b841 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:59.644653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09293de3-af38-4f0e-a1ab-2fd88f01b841 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:59.644982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09293de3-af38-4f0e-a1ab-2fd88f01b841 None admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:59.645933 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09293de3-af38-4f0e-a1ab-2fd88f01b841 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:22:59.646275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09293de3-af38-4f0e-a1ab-2fd88f01b841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:59.647731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09293de3-af38-4f0e-a1ab-2fd88f01b841 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:59.658561 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 639/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:22:59.665088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fde46-799f-45ab-a3dd-9b42dd1e82e9 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:22:59.747562 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:59.789157 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fde46-799f-45ab-a3dd-9b42dd1e82e9 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:22:59.837558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b96b4d-ee33-404b-bc1b-0f5817aa0251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:22:59.838285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b96b4d-ee33-404b-bc1b-0f5817aa0251 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:22:59.838607 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b96b4d-ee33-404b-bc1b-0f5817aa0251 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:22:59.839170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b96b4d-ee33-404b-bc1b-0f5817aa0251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:22:59.853727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b96b4d-ee33-404b-bc1b-0f5817aa0251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:22:59.855195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b96b4d-ee33-404b-bc1b-0f5817aa0251 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-e2b96b4d-ee33-404b-bc1b-0f5817aa0251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:22:59.878060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:22:59.879823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:22:59.881744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:22:59.881744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:22:59.881744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:22:59.881744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 626/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:22:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:22:59.889530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09293de3-af38-4f0e-a1ab-2fd88f01b841 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:00.016725 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:00.044078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09293de3-af38-4f0e-a1ab-2fd88f01b841 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:00.085113 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d327cc5-9a94-42af-99d3-44626b63173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:00.085832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d327cc5-9a94-42af-99d3-44626b63173d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:00.086170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d327cc5-9a94-42af-99d3-44626b63173d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:00.086498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d327cc5-9a94-42af-99d3-44626b63173d None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:00.087270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d327cc5-9a94-42af-99d3-44626b63173d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:00.087619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d327cc5-9a94-42af-99d3-44626b63173d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:00.089405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d327cc5-9a94-42af-99d3-44626b63173d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:00.104269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 640/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:23:00.110843 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b96b4d-ee33-404b-bc1b-0f5817aa0251 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:00.256653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b96b4d-ee33-404b-bc1b-0f5817aa0251 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:00.283612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:00.305295 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c537e2-7066-42b1-a83b-5a93a613d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:00.306107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c537e2-7066-42b1-a83b-5a93a613d50a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:00.306483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c537e2-7066-42b1-a83b-5a93a613d50a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:00.306862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c537e2-7066-42b1-a83b-5a93a613d50a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:00.316502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c537e2-7066-42b1-a83b-5a93a613d50a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:00.318829 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c537e2-7066-42b1-a83b-5a93a613d50a None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-e6c537e2-7066-42b1-a83b-5a93a613d50a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:23:00.336169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:23:00.338155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:23:00.341139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:23:00.341139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:23:00.341139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:23:00.341139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:23:00.341139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:23:00.341139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:23:00.341139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:23:00.341139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:23:00.341139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:23:00.341139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:23:00.341139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 627/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:23:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:23:00.346107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d327cc5-9a94-42af-99d3-44626b63173d None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:00.477169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d327cc5-9a94-42af-99d3-44626b63173d None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:00.539724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b98c43-2641-4e9d-bd05-d9f7cc499dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:00.540350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b98c43-2641-4e9d-bd05-d9f7cc499dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:00.540635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b98c43-2641-4e9d-bd05-d9f7cc499dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:00.541018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b98c43-2641-4e9d-bd05-d9f7cc499dd7 None admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:00.541990 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b98c43-2641-4e9d-bd05-d9f7cc499dd7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:00.542338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b98c43-2641-4e9d-bd05-d9f7cc499dd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:00.544160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b98c43-2641-4e9d-bd05-d9f7cc499dd7 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:00.555674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:00.569248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 641/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Sep 1 05:23:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:00.578357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c537e2-7066-42b1-a83b-5a93a613d50a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:00.724749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c537e2-7066-42b1-a83b-5a93a613d50a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:00.771484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29613c2-1d2d-4a85-a607-fd67b163e084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:00.772064 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29613c2-1d2d-4a85-a607-fd67b163e084 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:00.772341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29613c2-1d2d-4a85-a607-fd67b163e084 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:00.772608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29613c2-1d2d-4a85-a607-fd67b163e084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:00.786324 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29613c2-1d2d-4a85-a607-fd67b163e084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:00.788104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29613c2-1d2d-4a85-a607-fd67b163e084 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-c29613c2-1d2d-4a85-a607-fd67b163e084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:23:00.808087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:23:00.810652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:23:00.811806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:23:00.811806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:23:00.811806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:23:00.811806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 628/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:23:00.821477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b98c43-2641-4e9d-bd05-d9f7cc499dd7 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:00.961436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b98c43-2641-4e9d-bd05-d9f7cc499dd7 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:01.014043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcc1e4-a375-4a3a-99ed-e359e04fe281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:01.014656 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcc1e4-a375-4a3a-99ed-e359e04fe281 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:01.014932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcc1e4-a375-4a3a-99ed-e359e04fe281 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:01.015199 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fcc1e4-a375-4a3a-99ed-e359e04fe281 None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:01.015855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcc1e4-a375-4a3a-99ed-e359e04fe281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:01.016143 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcc1e4-a375-4a3a-99ed-e359e04fe281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:01.017634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fcc1e4-a375-4a3a-99ed-e359e04fe281 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:01.035092 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 642/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:23:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:01.040972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29613c2-1d2d-4a85-a607-fd67b163e084 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:01.093973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:01.230480 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29613c2-1d2d-4a85-a607-fd67b163e084 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:01.282680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf898b-9c45-4f31-97b0-4f7135e34a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:01.283345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf898b-9c45-4f31-97b0-4f7135e34a68 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:01.283628 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf898b-9c45-4f31-97b0-4f7135e34a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:01.283907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf898b-9c45-4f31-97b0-4f7135e34a68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:01.295636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf898b-9c45-4f31-97b0-4f7135e34a68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:01.295636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf898b-9c45-4f31-97b0-4f7135e34a68 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-47bf898b-9c45-4f31-97b0-4f7135e34a68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:23:01.308755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:23:01.311105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:23:01.313007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:23:01.313007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:23:01.313007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:23:01.313007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:23:01.313007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:23:01.313007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:23:01.313007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:23:01.313007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:23:01.313007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 629/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:23:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:23:01.319373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcc1e4-a375-4a3a-99ed-e359e04fe281 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:01.407129 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:01.481925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fcc1e4-a375-4a3a-99ed-e359e04fe281 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:01.536566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e7e25-322e-416b-93d2-2ab2d02ba959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:01.537320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7e25-322e-416b-93d2-2ab2d02ba959 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:01.537763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7e25-322e-416b-93d2-2ab2d02ba959 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:01.538131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7e25-322e-416b-93d2-2ab2d02ba959 None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:01.539002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e7e25-322e-416b-93d2-2ab2d02ba959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:01.539455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e7e25-322e-416b-93d2-2ab2d02ba959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:01.541137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e7e25-322e-416b-93d2-2ab2d02ba959 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:01.557737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 643/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:23:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:01.566681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf898b-9c45-4f31-97b0-4f7135e34a68 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:01.703244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:01.714220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf898b-9c45-4f31-97b0-4f7135e34a68 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:01.761091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16426bb5-d143-4955-b136-354f3de2eb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:01.762055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16426bb5-d143-4955-b136-354f3de2eb9b None admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:01.762874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16426bb5-d143-4955-b136-354f3de2eb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:01.763568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16426bb5-d143-4955-b136-354f3de2eb9b None admin] PATH_INFO: `/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/055823f7760f485eb91266a0d63db602/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:01.765689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16426bb5-d143-4955-b136-354f3de2eb9b None admin] RBAC: Authorizing `identity:create_grant(project_id=e57c3fe9229c45f1bfd295115ef94cd7, user_id=055823f7760f485eb91266a0d63db602, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:01.767236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16426bb5-d143-4955-b136-354f3de2eb9b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:01.890052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 630/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Sep 1 05:23:01 2022] PUT /identity/v3/projects/e57c3fe9229c45f1bfd295115ef94cd7/users/055823f7760f485eb91266a0d63db602/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:23:04.044466 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec534-c3ce-42ff-b273-acd1bee698bd None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:04.045286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec534-c3ce-42ff-b273-acd1bee698bd None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:04.045515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec534-c3ce-42ff-b273-acd1bee698bd None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:04.047052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 644/1274] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:23:04.053234 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f92a3c-f9e0-4ae8-b9e2-345e8bc5fbe4 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:04.053848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f92a3c-f9e0-4ae8-b9e2-345e8bc5fbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:04.053848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f92a3c-f9e0-4ae8-b9e2-345e8bc5fbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:04.073493 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-57f92a3c-f9e0-4ae8-b9e2-345e8bc5fbe4 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:04.075192 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-57f92a3c-f9e0-4ae8-b9e2-345e8bc5fbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:04.160315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 631/1275] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:23:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:23:04.532104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddec534-c3ce-42ff-b273-acd1bee698bd None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:04.666877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddec534-c3ce-42ff-b273-acd1bee698bd None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:04.703286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:04.734505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f765b43-cb41-48fe-8eb1-f0eb517ece81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:04.735216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f765b43-cb41-48fe-8eb1-f0eb517ece81 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:04.735549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f765b43-cb41-48fe-8eb1-f0eb517ece81 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:04.735866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f765b43-cb41-48fe-8eb1-f0eb517ece81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:04.748657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f765b43-cb41-48fe-8eb1-f0eb517ece81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-0f765b43-cb41-48fe-8eb1-f0eb517ece81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:23:04.753971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:23:04.755654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:23:04.756673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 645/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Sep 1 05:23:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:23:04.761630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f92a3c-f9e0-4ae8-b9e2-345e8bc5fbe4 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:04.857077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:04.876772 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f92a3c-f9e0-4ae8-b9e2-345e8bc5fbe4 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:04.916155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945b49-1ad8-4a90-bff1-b7da302185c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:04.916818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945b49-1ad8-4a90-bff1-b7da302185c7 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:04.917137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945b49-1ad8-4a90-bff1-b7da302185c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:04.917492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945b49-1ad8-4a90-bff1-b7da302185c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:04.919148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88945b49-1ad8-4a90-bff1-b7da302185c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:04.919497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88945b49-1ad8-4a90-bff1-b7da302185c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:04.920965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88945b49-1ad8-4a90-bff1-b7da302185c7 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:04.931028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 632/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Sep 1 05:23:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:04.937817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f765b43-cb41-48fe-8eb1-f0eb517ece81 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:05.058560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f765b43-cb41-48fe-8eb1-f0eb517ece81 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:05.100255 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a967d8-faf9-45db-b36a-a8627e043c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:05.104089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a967d8-faf9-45db-b36a-a8627e043c06 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:05.104089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a967d8-faf9-45db-b36a-a8627e043c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:05.104089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a967d8-faf9-45db-b36a-a8627e043c06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:05.113447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a967d8-faf9-45db-b36a-a8627e043c06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:05.114916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a967d8-faf9-45db-b36a-a8627e043c06 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-50a967d8-faf9-45db-b36a-a8627e043c06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:23:05.132330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:23:05.134248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:23:05.135290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:23:05.135290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:23:05.135290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:23:05.135290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 646/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:23:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:23:05.140211 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945b49-1ad8-4a90-bff1-b7da302185c7 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:05.258683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945b49-1ad8-4a90-bff1-b7da302185c7 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:05.308123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758c7d-c140-4af0-8a80-e8e6bcd15375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:05.308745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758c7d-c140-4af0-8a80-e8e6bcd15375 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:05.309571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758c7d-c140-4af0-8a80-e8e6bcd15375 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:05.309845 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758c7d-c140-4af0-8a80-e8e6bcd15375 None admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:05.310777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0758c7d-c140-4af0-8a80-e8e6bcd15375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:05.311134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0758c7d-c140-4af0-8a80-e8e6bcd15375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:05.312991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0758c7d-c140-4af0-8a80-e8e6bcd15375 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:05.332511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 633/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:23:05.338940 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a967d8-faf9-45db-b36a-a8627e043c06 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:05.376475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:05.460399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a967d8-faf9-45db-b36a-a8627e043c06 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:05.499932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86975004-bba7-4e2b-86a3-bc39f33b7e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:05.500569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86975004-bba7-4e2b-86a3-bc39f33b7e26 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:05.500850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86975004-bba7-4e2b-86a3-bc39f33b7e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:05.501123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86975004-bba7-4e2b-86a3-bc39f33b7e26 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:05.510822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86975004-bba7-4e2b-86a3-bc39f33b7e26 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:05.512963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86975004-bba7-4e2b-86a3-bc39f33b7e26 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-86975004-bba7-4e2b-86a3-bc39f33b7e26 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:23:05.526260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:23:05.528149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:23:05.530302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:23:05.530302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:23:05.530302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:23:05.530302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:23:05.530302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:23:05.530302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:23:05.530302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:23:05.530302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:23:05.530302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:23:05.530302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:23:05.530302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 647/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:23:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:23:05.536061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758c7d-c140-4af0-8a80-e8e6bcd15375 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:05.542695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:05.691383 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758c7d-c140-4af0-8a80-e8e6bcd15375 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:05.737289 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82a3b3-71eb-4768-bd26-9c0c317c9184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:05.737966 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82a3b3-71eb-4768-bd26-9c0c317c9184 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:05.738367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82a3b3-71eb-4768-bd26-9c0c317c9184 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:05.738713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82a3b3-71eb-4768-bd26-9c0c317c9184 None admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:05.739569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82a3b3-71eb-4768-bd26-9c0c317c9184 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:05.739960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82a3b3-71eb-4768-bd26-9c0c317c9184 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:05.741622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a82a3b3-71eb-4768-bd26-9c0c317c9184 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:05.763220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 634/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Sep 1 05:23:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:23:05.768935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86975004-bba7-4e2b-86a3-bc39f33b7e26 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:05.877470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:05.895939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86975004-bba7-4e2b-86a3-bc39f33b7e26 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:05.952717 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b6396-1008-4087-8dee-7d72d3a85bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:05.953302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b6396-1008-4087-8dee-7d72d3a85bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:05.953695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b6396-1008-4087-8dee-7d72d3a85bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:05.954227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b6396-1008-4087-8dee-7d72d3a85bc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:06.040037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b6396-1008-4087-8dee-7d72d3a85bc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:06.041688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b6396-1008-4087-8dee-7d72d3a85bc6 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:06.178358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:06.198273 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 648/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Sep 1 05:23:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:23:06.205842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82a3b3-71eb-4768-bd26-9c0c317c9184 None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:06.331066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:06.404108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82a3b3-71eb-4768-bd26-9c0c317c9184 None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:06.473311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000adbb2-fe9e-4b3d-b5be-58e9be6c999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:06.474717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000adbb2-fe9e-4b3d-b5be-58e9be6c999c None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:06.475213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000adbb2-fe9e-4b3d-b5be-58e9be6c999c None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:06.475690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000adbb2-fe9e-4b3d-b5be-58e9be6c999c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:06.495452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000adbb2-fe9e-4b3d-b5be-58e9be6c999c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:06.498272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000adbb2-fe9e-4b3d-b5be-58e9be6c999c None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-000adbb2-fe9e-4b3d-b5be-58e9be6c999c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:23:06.527207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:23:06.529160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:23:06.530611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:23:06.530611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:23:06.530611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:23:06.530611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 635/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:23:06.536536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b6396-1008-4087-8dee-7d72d3a85bc6 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:06.674493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b6396-1008-4087-8dee-7d72d3a85bc6 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:06.717520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac119fd-7f7e-406e-9793-d644e027736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:06.718150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac119fd-7f7e-406e-9793-d644e027736a None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:06.718427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac119fd-7f7e-406e-9793-d644e027736a None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:06.718696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac119fd-7f7e-406e-9793-d644e027736a None admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:06.719364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac119fd-7f7e-406e-9793-d644e027736a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:06.719668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac119fd-7f7e-406e-9793-d644e027736a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:06.721177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac119fd-7f7e-406e-9793-d644e027736a None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:06.735838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 649/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Sep 1 05:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:23:06.742176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000adbb2-fe9e-4b3d-b5be-58e9be6c999c None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:06.867160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000adbb2-fe9e-4b3d-b5be-58e9be6c999c None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:06.893875 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:06.916076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e123-4091-46fb-a7a7-7ce0f199fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:06.916840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e123-4091-46fb-a7a7-7ce0f199fd6a None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:06.917210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e123-4091-46fb-a7a7-7ce0f199fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:06.917584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e123-4091-46fb-a7a7-7ce0f199fd6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:06.926637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358e123-4091-46fb-a7a7-7ce0f199fd6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:06.928198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358e123-4091-46fb-a7a7-7ce0f199fd6a None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-1358e123-4091-46fb-a7a7-7ce0f199fd6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:23:06.942401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application with Lock( Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:23:06.944040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:23:06.944975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:23:06.944975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:23:06.944975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:23:06.944975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:23:06.944975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:23:06.944975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:23:06.944975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:23:06.944975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:23:06.944975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 636/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Sep 1 05:23:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:23:06.953080 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac119fd-7f7e-406e-9793-d644e027736a None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:07.016504 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:07.074938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac119fd-7f7e-406e-9793-d644e027736a None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:07.116554 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3b779-238e-4dbe-a49c-5da2b941228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:07.117180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3b779-238e-4dbe-a49c-5da2b941228b None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:07.117503 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3b779-238e-4dbe-a49c-5da2b941228b None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:07.117779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3b779-238e-4dbe-a49c-5da2b941228b None admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:07.118486 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3b779-238e-4dbe-a49c-5da2b941228b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:07.118796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3b779-238e-4dbe-a49c-5da2b941228b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:07.120299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3b779-238e-4dbe-a49c-5da2b941228b None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:07.135569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 650/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Sep 1 05:23:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:07.142940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e123-4091-46fb-a7a7-7ce0f199fd6a None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:07.319981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e123-4091-46fb-a7a7-7ce0f199fd6a None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:07.369646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f69299-c2a5-4e04-ac6f-473091417f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:07.370272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f69299-c2a5-4e04-ac6f-473091417f89 None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:07.370550 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f69299-c2a5-4e04-ac6f-473091417f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:07.370820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f69299-c2a5-4e04-ac6f-473091417f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:07.372104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f69299-c2a5-4e04-ac6f-473091417f89 None admin] RBAC: Adding query filter params (role.id=91cb2a98aba34b5dab105da573aa67b0, scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7, user.id=055823f7760f485eb91266a0d63db602) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:07.372411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f69299-c2a5-4e04-ac6f-473091417f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:07.374403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f69299-c2a5-4e04-ac6f-473091417f89 None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:07.381706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 637/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Sep 1 05:23:07 2022] GET /identity/v3/role_assignments?user.id=055823f7760f485eb91266a0d63db602&scope.project.id=e57c3fe9229c45f1bfd295115ef94cd7&role.id=91cb2a98aba34b5dab105da573aa67b0 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:23:09.504665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8453b9-08d1-4a5d-bf26-e4f799f79479 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:09.505570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8453b9-08d1-4a5d-bf26-e4f799f79479 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:09.505570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8453b9-08d1-4a5d-bf26-e4f799f79479 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:09.507180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 651/1288] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:23:09.514022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f1abb-79ef-45cd-8190-d907164817a1 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:09.514758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f1abb-79ef-45cd-8190-d907164817a1 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:09.514758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f1abb-79ef-45cd-8190-d907164817a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:09.536459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-885f1abb-79ef-45cd-8190-d907164817a1 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:09.537755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-885f1abb-79ef-45cd-8190-d907164817a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:09.577162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:09.622149 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 638/1289] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:23:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:23:10.130392 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8453b9-08d1-4a5d-bf26-e4f799f79479 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:10.291838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8453b9-08d1-4a5d-bf26-e4f799f79479 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:10.306885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:10.341987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea2581-d669-4016-afb9-2173895791ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:10.342641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea2581-d669-4016-afb9-2173895791ae None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:10.342931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea2581-d669-4016-afb9-2173895791ae None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:10.343297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea2581-d669-4016-afb9-2173895791ae None admin] PATH_INFO: `/v3/services/placement` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:10.343903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea2581-d669-4016-afb9-2173895791ae None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:10.345569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea2581-d669-4016-afb9-2173895791ae None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-84ea2581-d669-4016-afb9-2173895791ae None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:23:10.355943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:23:10.358348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:23:10.360109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 652/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Sep 1 05:23:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:23:10.365143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f1abb-79ef-45cd-8190-d907164817a1 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:10.529208 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f1abb-79ef-45cd-8190-d907164817a1 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:10.572551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6998f5-b3c9-4e76-ba25-1478fdd4960d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:10.573320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6998f5-b3c9-4e76-ba25-1478fdd4960d None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:10.573642 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6998f5-b3c9-4e76-ba25-1478fdd4960d None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:10.573916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6998f5-b3c9-4e76-ba25-1478fdd4960d None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:10.574673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6998f5-b3c9-4e76-ba25-1478fdd4960d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:10.575224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6998f5-b3c9-4e76-ba25-1478fdd4960d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:10.576804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6998f5-b3c9-4e76-ba25-1478fdd4960d None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:10.583010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 639/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Sep 1 05:23:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:10.593024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea2581-d669-4016-afb9-2173895791ae None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:10.723960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea2581-d669-4016-afb9-2173895791ae None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:10.766839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e636a-c2c8-46c2-9930-a66e9c886c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:10.767474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e636a-c2c8-46c2-9930-a66e9c886c9d None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:10.767755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e636a-c2c8-46c2-9930-a66e9c886c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:10.768026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e636a-c2c8-46c2-9930-a66e9c886c9d None admin] PATH_INFO: `/v3/services` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:10.768686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e636a-c2c8-46c2-9930-a66e9c886c9d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:10.768989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e636a-c2c8-46c2-9930-a66e9c886c9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:10.770604 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e636a-c2c8-46c2-9930-a66e9c886c9d None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:10.776016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 653/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Sep 1 05:23:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:12.865576 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a409a2-719f-49de-9413-1377dfa929b5 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:12.866410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a409a2-719f-49de-9413-1377dfa929b5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:12.866410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a409a2-719f-49de-9413-1377dfa929b5 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:12.867633 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 640/1293] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:23:12.874327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b568e9-0a33-4676-83a2-f5b640e6154c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:12.874935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b568e9-0a33-4676-83a2-f5b640e6154c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:12.874935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b568e9-0a33-4676-83a2-f5b640e6154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:12.896020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-a0b568e9-0a33-4676-83a2-f5b640e6154c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:12.898355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a0b568e9-0a33-4676-83a2-f5b640e6154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:12.934269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:12.982797 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 654/1294] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:23:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:23:13.268575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a409a2-719f-49de-9413-1377dfa929b5 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:13.323925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:13.421564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a409a2-719f-49de-9413-1377dfa929b5 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:13.476569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f37cdd-cb42-4ccb-8f8b-7b3f7dbbad7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:13.477213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f37cdd-cb42-4ccb-8f8b-7b3f7dbbad7f None admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:13.477527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f37cdd-cb42-4ccb-8f8b-7b3f7dbbad7f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:13.477804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f37cdd-cb42-4ccb-8f8b-7b3f7dbbad7f None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:13.478496 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f37cdd-cb42-4ccb-8f8b-7b3f7dbbad7f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:13.480086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f37cdd-cb42-4ccb-8f8b-7b3f7dbbad7f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:13.645420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 641/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Sep 1 05:23:13 2022] POST /identity/v3/services => generated 246 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:23:15.742737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66e1a0-a191-44c4-8d0b-109aed29fd4f None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.743363 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66e1a0-a191-44c4-8d0b-109aed29fd4f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.743363 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66e1a0-a191-44c4-8d0b-109aed29fd4f None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.744829 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 655/1296] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:23:15.752003 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910e17b-112a-45ee-b522-8a9e9ef4f319 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.752667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910e17b-112a-45ee-b522-8a9e9ef4f319 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.752667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910e17b-112a-45ee-b522-8a9e9ef4f319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.778243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-1910e17b-112a-45ee-b522-8a9e9ef4f319 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:15.780199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1910e17b-112a-45ee-b522-8a9e9ef4f319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:15.878833 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 642/1297] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:23:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:23:16.162417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66e1a0-a191-44c4-8d0b-109aed29fd4f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:16.289061 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66e1a0-a191-44c4-8d0b-109aed29fd4f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:16.331104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccd2e7-acce-41d0-80c2-347dbfcac4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:16.331748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccd2e7-acce-41d0-80c2-347dbfcac4ad None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:16.332032 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccd2e7-acce-41d0-80c2-347dbfcac4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:16.332305 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccd2e7-acce-41d0-80c2-347dbfcac4ad None admin] PATH_INFO: `/v3/services/placement` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:16.332909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccd2e7-acce-41d0-80c2-347dbfcac4ad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:16.334365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccd2e7-acce-41d0-80c2-347dbfcac4ad None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-f8ccd2e7-acce-41d0-80c2-347dbfcac4ad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:23:16.346909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:23:16.348077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:23:16.348951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 656/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Sep 1 05:23:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:23:16.356923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910e17b-112a-45ee-b522-8a9e9ef4f319 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:16.400298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:16.547359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910e17b-112a-45ee-b522-8a9e9ef4f319 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:16.586742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaffe0-d466-4839-a497-ee28ba51335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:16.587367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaffe0-d466-4839-a497-ee28ba51335b None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:16.587646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaffe0-d466-4839-a497-ee28ba51335b None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:16.587907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaffe0-d466-4839-a497-ee28ba51335b None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:16.588560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaffe0-d466-4839-a497-ee28ba51335b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:16.588854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaffe0-d466-4839-a497-ee28ba51335b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:16.591060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcaffe0-d466-4839-a497-ee28ba51335b None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:16.596897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 643/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Sep 1 05:23:16 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:16.604186 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccd2e7-acce-41d0-80c2-347dbfcac4ad None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:16.646320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:16.754216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccd2e7-acce-41d0-80c2-347dbfcac4ad None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:16.795369 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6084f-7ed7-4c6e-9d98-430b6a2928e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:16.796738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6084f-7ed7-4c6e-9d98-430b6a2928e9 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:16.796738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6084f-7ed7-4c6e-9d98-430b6a2928e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:16.796738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6084f-7ed7-4c6e-9d98-430b6a2928e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:16.797484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6084f-7ed7-4c6e-9d98-430b6a2928e9 None admin] RBAC: Adding query filter params (interface=public, service_id=d6c3bc8c834b4229875b4339ac9b7453, region_id=RegionOne) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:16.797730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6084f-7ed7-4c6e-9d98-430b6a2928e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:16.799149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6084f-7ed7-4c6e-9d98-430b6a2928e9 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:16.805451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 657/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Sep 1 05:23:16 2022] GET /identity/v3/endpoints?service_id=d6c3bc8c834b4229875b4339ac9b7453&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:16.812494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaffe0-d466-4839-a497-ee28ba51335b None admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:16.914038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:16.950504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaffe0-d466-4839-a497-ee28ba51335b None admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:16.998932 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c76e43-3a32-41ae-9d04-5bcbe0363fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:16.999575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c76e43-3a32-41ae-9d04-5bcbe0363fbf None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:17.000125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c76e43-3a32-41ae-9d04-5bcbe0363fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:17.000955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c76e43-3a32-41ae-9d04-5bcbe0363fbf None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:17.001612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c76e43-3a32-41ae-9d04-5bcbe0363fbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:17.003033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c76e43-3a32-41ae-9d04-5bcbe0363fbf None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:17.010493 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 644/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Sep 1 05:23:16 2022] GET /identity/v3/services => generated 2191 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:23:19.072615 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5148477-466e-49d1-9ba9-8520d2be6938 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:19.073485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5148477-466e-49d1-9ba9-8520d2be6938 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:19.073485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5148477-466e-49d1-9ba9-8520d2be6938 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:19.075893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 658/1302] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:23:19.083162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fff0e6-9c1c-4e59-b5e5-6e622e0ecc8d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:19.083723 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fff0e6-9c1c-4e59-b5e5-6e622e0ecc8d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:19.087420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fff0e6-9c1c-4e59-b5e5-6e622e0ecc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:19.117315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-59fff0e6-9c1c-4e59-b5e5-6e622e0ecc8d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:23:19.119542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-59fff0e6-9c1c-4e59-b5e5-6e622e0ecc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:19.227684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 645/1303] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:23:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:23:19.520551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5148477-466e-49d1-9ba9-8520d2be6938 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:19.639053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:19.646371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5148477-466e-49d1-9ba9-8520d2be6938 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:19.686742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733153bf-109f-4d65-bcd5-7e83da447fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:19.687636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733153bf-109f-4d65-bcd5-7e83da447fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:19.687767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733153bf-109f-4d65-bcd5-7e83da447fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:19.687974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733153bf-109f-4d65-bcd5-7e83da447fc5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:19.688580 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733153bf-109f-4d65-bcd5-7e83da447fc5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:19.690416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733153bf-109f-4d65-bcd5-7e83da447fc5 None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-733153bf-109f-4d65-bcd5-7e83da447fc5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:23:19.701036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:23:19.703359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application with Lock( Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:23:19.705415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 659/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Sep 1 05:23:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:23:19.711122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fff0e6-9c1c-4e59-b5e5-6e622e0ecc8d None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:19.805618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:19.835441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fff0e6-9c1c-4e59-b5e5-6e622e0ecc8d None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:19.891604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ae871-acf4-4c4c-b8af-77131f71c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:19.892557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ae871-acf4-4c4c-b8af-77131f71c85f None admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:19.892982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ae871-acf4-4c4c-b8af-77131f71c85f None admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:19.893429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ae871-acf4-4c4c-b8af-77131f71c85f None admin] PATH_INFO: `/v3/services` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:19.894484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ae871-acf4-4c4c-b8af-77131f71c85f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:23:19.894953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ae871-acf4-4c4c-b8af-77131f71c85f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:19.896709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ae871-acf4-4c4c-b8af-77131f71c85f None admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:19.906044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 646/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Sep 1 05:23:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:23:19.914650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733153bf-109f-4d65-bcd5-7e83da447fc5 None admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:20.072745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733153bf-109f-4d65-bcd5-7e83da447fc5 None admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:20.123883 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab67306-82e3-4665-be79-f1012d046f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:20.124925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67306-82e3-4665-be79-f1012d046f8e None admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:20.125442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67306-82e3-4665-be79-f1012d046f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:20.125926 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab67306-82e3-4665-be79-f1012d046f8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:20.127277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab67306-82e3-4665-be79-f1012d046f8e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:20.130029 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab67306-82e3-4665-be79-f1012d046f8e None admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:20.288768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 660/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:23:19 2022] POST /identity/v3/endpoints => generated 331 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:23:29.907861 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=30 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:30.279308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:18.056340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a473ecc-7310-4119-8368-6646962ce8ad None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:18.056970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a473ecc-7310-4119-8368-6646962ce8ad None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:18.057289 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a473ecc-7310-4119-8368-6646962ce8ad None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:18.069789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7c073-1509-4d94-a0a2-f523e696d11c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:18.070387 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7c073-1509-4d94-a0a2-f523e696d11c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:18.070719 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7c073-1509-4d94-a0a2-f523e696d11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:18.077948 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 647/1307] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:33:18 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:33:18.267991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-4ff7c073-1509-4d94-a0a2-f523e696d11c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:18.269258 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-4ff7c073-1509-4d94-a0a2-f523e696d11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:18.431548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 661/1308] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:33:19.002838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96d516-543f-4e84-a61b-60f965c62c61 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:19.003124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96d516-543f-4e84-a61b-60f965c62c61 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:19.003388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96d516-543f-4e84-a61b-60f965c62c61 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:19.005004 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 648/1309] 10.222.0.48 () {54 vars in 965 bytes} [Thu Sep 1 05:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:33:19.015028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc32b74-dcd1-4e09-90dd-8b4d55d5ae6f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:19.015519 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc32b74-dcd1-4e09-90dd-8b4d55d5ae6f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:19.016188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc32b74-dcd1-4e09-90dd-8b4d55d5ae6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:19.131935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-4bc32b74-dcd1-4e09-90dd-8b4d55d5ae6f None None] MFA Rules not processed for user `2e7d31c0ec474c428ed932882b989d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:19.133294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-4bc32b74-dcd1-4e09-90dd-8b4d55d5ae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:19.160962 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:19.266760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 662/1310] 10.222.0.48 () {58 vars in 1062 bytes} [Thu Sep 1 05:33:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:33:19.282874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96d516-543f-4e84-a61b-60f965c62c61 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:19.286154 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6f96d516-543f-4e84-a61b-60f965c62c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:19.476733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96d516-543f-4e84-a61b-60f965c62c61 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:19.599616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45269747-8955-4fcb-8086-97c29f946e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:19.600436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45269747-8955-4fcb-8086-97c29f946e8b service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:19.600768 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45269747-8955-4fcb-8086-97c29f946e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:19.601106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45269747-8955-4fcb-8086-97c29f946e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:19.602962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-45269747-8955-4fcb-8086-97c29f946e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:19.704500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:19.820358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45269747-8955-4fcb-8086-97c29f946e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:19.822815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45269747-8955-4fcb-8086-97c29f946e8b service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:19.876459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 649/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:22.624092 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccfc1c-02d2-44aa-a3ab-0528366cb3f8 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:22.624805 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccfc1c-02d2-44aa-a3ab-0528366cb3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:22.624805 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccfc1c-02d2-44aa-a3ab-0528366cb3f8 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:22.626097 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 663/1312] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:33:22.632543 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d7b3-81b9-4418-9dfb-60f31c74c8ce None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:22.633172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d7b3-81b9-4418-9dfb-60f31c74c8ce None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:22.633172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34d7b3-81b9-4418-9dfb-60f31c74c8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:22.736858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-3f34d7b3-81b9-4418-9dfb-60f31c74c8ce None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:22.739150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3f34d7b3-81b9-4418-9dfb-60f31c74c8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:22.931441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 650/1313] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:23.264193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af8481-43e7-4d6f-aad8-df619c91e4e8 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:23.264907 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af8481-43e7-4d6f-aad8-df619c91e4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:23.265492 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af8481-43e7-4d6f-aad8-df619c91e4e8 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:23.267535 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 664/1314] 10.222.0.48 () {54 vars in 965 bytes} [Thu Sep 1 05:33:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:33:23.277250 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909b8e9-e940-4948-89a2-a6c9958678a5 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:23.277865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909b8e9-e940-4948-89a2-a6c9958678a5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:23.278300 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909b8e9-e940-4948-89a2-a6c9958678a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:23.293684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:23.387580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-3909b8e9-e940-4948-89a2-a6c9958678a5 None None] MFA Rules not processed for user `2e7d31c0ec474c428ed932882b989d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:23.389470 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3909b8e9-e940-4948-89a2-a6c9958678a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:23.489124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 651/1315] 10.222.0.48 () {58 vars in 1062 bytes} [Thu Sep 1 05:33:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:33:23.505088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af8481-43e7-4d6f-aad8-df619c91e4e8 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:23.507934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e1af8481-43e7-4d6f-aad8-df619c91e4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:23.666074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af8481-43e7-4d6f-aad8-df619c91e4e8 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:23.800358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:23.803775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e67c5b-6f75-4ca7-a7aa-fffbd3ac41d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:23.804391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e67c5b-6f75-4ca7-a7aa-fffbd3ac41d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:23.804664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e67c5b-6f75-4ca7-a7aa-fffbd3ac41d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:23.804999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e67c5b-6f75-4ca7-a7aa-fffbd3ac41d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:23.806758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-47e67c5b-6f75-4ca7-a7aa-fffbd3ac41d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:23.950076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e67c5b-6f75-4ca7-a7aa-fffbd3ac41d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:23.952168 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e67c5b-6f75-4ca7-a7aa-fffbd3ac41d9 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:23.976000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 665/1316] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:26.972317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df4fb-e8b6-4dd4-8930-1ee850ab6d6c None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.973226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df4fb-e8b6-4dd4-8930-1ee850ab6d6c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.973226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df4fb-e8b6-4dd4-8930-1ee850ab6d6c None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:26.974301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 652/1317] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:33:26.981242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39085591-a603-4ae8-8d38-8323155718ea None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:26.981865 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39085591-a603-4ae8-8d38-8323155718ea None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:26.982848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39085591-a603-4ae8-8d38-8323155718ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:27.099532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-39085591-a603-4ae8-8d38-8323155718ea None None] MFA Rules not processed for user `997f08f01dbe4348bbce534fb3b4be8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:27.100806 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-39085591-a603-4ae8-8d38-8323155718ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:27.165706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:27.220802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 666/1318] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:33:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:27.517491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06df4fb-e8b6-4dd4-8930-1ee850ab6d6c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:27.519066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a06df4fb-e8b6-4dd4-8930-1ee850ab6d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:27.647163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06df4fb-e8b6-4dd4-8930-1ee850ab6d6c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:27.650434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:27.731484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1cce0-f95e-494f-a445-c4051d5e1f0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:27.732100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1cce0-f95e-494f-a445-c4051d5e1f0e service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:27.732440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1cce0-f95e-494f-a445-c4051d5e1f0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:27.732716 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1cce0-f95e-494f-a445-c4051d5e1f0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:27.734488 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0ca1cce0-f95e-494f-a445-c4051d5e1f0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:27.867793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1cce0-f95e-494f-a445-c4051d5e1f0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:27.869299 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1cce0-f95e-494f-a445-c4051d5e1f0e service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:27.894758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 653/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:31.100024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdab09-6af7-4e38-bafa-546ccc9ac1bb None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:31.100659 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdab09-6af7-4e38-bafa-546ccc9ac1bb None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:31.100659 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdab09-6af7-4e38-bafa-546ccc9ac1bb None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:31.101991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 667/1320] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:33:31.111069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4871119-2085-4c43-b29b-38387c74c1c6 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:31.111728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4871119-2085-4c43-b29b-38387c74c1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:31.111728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4871119-2085-4c43-b29b-38387c74c1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:31.163029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:31.193894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-c4871119-2085-4c43-b29b-38387c74c1c6 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:31.195162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c4871119-2085-4c43-b29b-38387c74c1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:31.305404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 654/1321] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:33:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:33:31.595833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdab09-6af7-4e38-bafa-546ccc9ac1bb None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:31.597660 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-10bdab09-6af7-4e38-bafa-546ccc9ac1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:31.715646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdab09-6af7-4e38-bafa-546ccc9ac1bb None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:31.799135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f1553-9637-4eeb-b296-da23988998b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:31.799752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f1553-9637-4eeb-b296-da23988998b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:31.800033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f1553-9637-4eeb-b296-da23988998b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:31.800303 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f1553-9637-4eeb-b296-da23988998b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:31.802048 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b12f1553-9637-4eeb-b296-da23988998b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:31.810717 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:31.930025 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f1553-9637-4eeb-b296-da23988998b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:31.931514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f1553-9637-4eeb-b296-da23988998b6 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:31.954298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 668/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:35.499261 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7839eb-3e30-40c5-b329-08a6b0410593 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:35.500000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7839eb-3e30-40c5-b329-08a6b0410593 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:35.500000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7839eb-3e30-40c5-b329-08a6b0410593 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:35.501926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 655/1323] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:33:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:33:35.507374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27425da-908f-45db-893b-ef0f60e978fc None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:35.508086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27425da-908f-45db-893b-ef0f60e978fc None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:35.508086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27425da-908f-45db-893b-ef0f60e978fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:35.586643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-b27425da-908f-45db-893b-ef0f60e978fc None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:35.587954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b27425da-908f-45db-893b-ef0f60e978fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:35.655572 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:35.701742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 669/1324] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:35.994292 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7839eb-3e30-40c5-b329-08a6b0410593 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:35.996043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-dc7839eb-3e30-40c5-b329-08a6b0410593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:36.152100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7839eb-3e30-40c5-b329-08a6b0410593 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:36.167092 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:36.272769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa8ed8-8e83-4596-b0ea-085809c04d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:36.273621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa8ed8-8e83-4596-b0ea-085809c04d5f service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:36.274088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa8ed8-8e83-4596-b0ea-085809c04d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:36.274471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa8ed8-8e83-4596-b0ea-085809c04d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:36.276582 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-67fa8ed8-8e83-4596-b0ea-085809c04d5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:36.417778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa8ed8-8e83-4596-b0ea-085809c04d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:36.419213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa8ed8-8e83-4596-b0ea-085809c04d5f service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:36.441233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 656/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:38.604636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92608-5097-4628-834e-14e98c4dbc43 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:38.605399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92608-5097-4628-834e-14e98c4dbc43 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:38.605399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92608-5097-4628-834e-14e98c4dbc43 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:38.607005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 670/1326] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:33:38.613404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f7df7-dc8a-4dbd-9b76-14ebe0bd8e14 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:38.613997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f7df7-dc8a-4dbd-9b76-14ebe0bd8e14 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:38.613997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f7df7-dc8a-4dbd-9b76-14ebe0bd8e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:38.674117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:38.697362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-544f7df7-dc8a-4dbd-9b76-14ebe0bd8e14 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:38.698502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-544f7df7-dc8a-4dbd-9b76-14ebe0bd8e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:38.867809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 657/1327] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:39.219369 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e92608-5097-4628-834e-14e98c4dbc43 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:39.220956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-03e92608-5097-4628-834e-14e98c4dbc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:39.354507 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e92608-5097-4628-834e-14e98c4dbc43 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:39.446278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0ddc8-a79d-4743-b8ac-d3b582b4abe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:39.446902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0ddc8-a79d-4743-b8ac-d3b582b4abe8 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:39.447185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0ddc8-a79d-4743-b8ac-d3b582b4abe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:39.447457 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0ddc8-a79d-4743-b8ac-d3b582b4abe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:39.449175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e5d0ddc8-a79d-4743-b8ac-d3b582b4abe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:39.470239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:39.583966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0ddc8-a79d-4743-b8ac-d3b582b4abe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:39.585510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0ddc8-a79d-4743-b8ac-d3b582b4abe8 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:39.608477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 671/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:42.030080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a08e7-016e-457c-964b-386e9cdc59ab None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:42.030851 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a08e7-016e-457c-964b-386e9cdc59ab None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:42.031253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a08e7-016e-457c-964b-386e9cdc59ab None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:42.033743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 658/1329] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:33:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:33:42.042876 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8a008-b10e-402d-b4b2-b3d5071d160c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:42.043506 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8a008-b10e-402d-b4b2-b3d5071d160c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:42.043881 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8a008-b10e-402d-b4b2-b3d5071d160c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:42.134499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-6aa8a008-b10e-402d-b4b2-b3d5071d160c None None] MFA Rules not processed for user `997f08f01dbe4348bbce534fb3b4be8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:42.135773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6aa8a008-b10e-402d-b4b2-b3d5071d160c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:42.223030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:42.267677 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 672/1330] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:33:42 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:42.598812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a08e7-016e-457c-964b-386e9cdc59ab None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:42.601774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-951a08e7-016e-457c-964b-386e9cdc59ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:42.768918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a08e7-016e-457c-964b-386e9cdc59ab None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:42.795951 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:42.865912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2eb345-9e98-4d29-88e3-c5c4b26d084a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:42.866546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eb345-9e98-4d29-88e3-c5c4b26d084a service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:42.866835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eb345-9e98-4d29-88e3-c5c4b26d084a service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:42.867111 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2eb345-9e98-4d29-88e3-c5c4b26d084a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:42.868862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4b2eb345-9e98-4d29-88e3-c5c4b26d084a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:43.018254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eb345-9e98-4d29-88e3-c5c4b26d084a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:43.019663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2eb345-9e98-4d29-88e3-c5c4b26d084a service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:43.041613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 659/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:42 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:45.958220 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb43151-cc9f-4c9a-b224-2e26258bafba None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:45.958829 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb43151-cc9f-4c9a-b224-2e26258bafba None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:45.959202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb43151-cc9f-4c9a-b224-2e26258bafba None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:45.961938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 673/1332] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:33:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:33:45.969850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b46d64-83e8-4912-8faf-2a5db94f0a81 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:45.970586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b46d64-83e8-4912-8faf-2a5db94f0a81 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:45.971060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b46d64-83e8-4912-8faf-2a5db94f0a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:46.053398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:46.056700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-85b46d64-83e8-4912-8faf-2a5db94f0a81 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:46.057993 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-85b46d64-83e8-4912-8faf-2a5db94f0a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:46.182307 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 660/1333] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:46.478028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb43151-cc9f-4c9a-b224-2e26258bafba None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:46.479620 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2bb43151-cc9f-4c9a-b224-2e26258bafba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:46.605980 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb43151-cc9f-4c9a-b224-2e26258bafba None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:46.695566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6a5b5-b6d7-44ee-9769-b70ab45cd919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:46.696333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6a5b5-b6d7-44ee-9769-b70ab45cd919 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:46.696522 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6a5b5-b6d7-44ee-9769-b70ab45cd919 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:46.696738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6a5b5-b6d7-44ee-9769-b70ab45cd919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:46.698489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-bae6a5b5-b6d7-44ee-9769-b70ab45cd919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:46.734667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:46.834835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6a5b5-b6d7-44ee-9769-b70ab45cd919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:46.836316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6a5b5-b6d7-44ee-9769-b70ab45cd919 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:46.864090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 674/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:48.951140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06ff86-6b2e-4e37-9d89-3c77489eb6f4 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:48.951728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06ff86-6b2e-4e37-9d89-3c77489eb6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:48.951728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06ff86-6b2e-4e37-9d89-3c77489eb6f4 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:48.953075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 661/1335] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:33:48.959079 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed025a5-df02-4cb5-90fe-583c5dcdae27 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:48.959695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed025a5-df02-4cb5-90fe-583c5dcdae27 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:48.959695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed025a5-df02-4cb5-90fe-583c5dcdae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:49.038086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-8ed025a5-df02-4cb5-90fe-583c5dcdae27 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:49.039361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8ed025a5-df02-4cb5-90fe-583c5dcdae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:49.136351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:49.162949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 675/1336] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:49.457098 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06ff86-6b2e-4e37-9d89-3c77489eb6f4 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:49.458740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9c06ff86-6b2e-4e37-9d89-3c77489eb6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:49.581688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06ff86-6b2e-4e37-9d89-3c77489eb6f4 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:49.614494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:49.674153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac060de-f644-4da4-8368-63652ff26b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:49.674776 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac060de-f644-4da4-8368-63652ff26b20 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:49.675058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac060de-f644-4da4-8368-63652ff26b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:49.675336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac060de-f644-4da4-8368-63652ff26b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:49.677040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bac060de-f644-4da4-8368-63652ff26b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:49.831824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac060de-f644-4da4-8368-63652ff26b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:49.833398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac060de-f644-4da4-8368-63652ff26b20 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:49.855499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 662/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:33:52.788729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea22c1-582c-4ba7-a6c4-ff59dfbdbf53 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:52.823923 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea22c1-582c-4ba7-a6c4-ff59dfbdbf53 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:52.823923 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea22c1-582c-4ba7-a6c4-ff59dfbdbf53 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:52.823923 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 676/1338] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:33:52.825213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74403d9-fdca-4bea-a2d9-ca144611a8e8 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:52.825213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74403d9-fdca-4bea-a2d9-ca144611a8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:52.825213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74403d9-fdca-4bea-a2d9-ca144611a8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:52.881628 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b74403d9-fdca-4bea-a2d9-ca144611a8e8 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:52.882929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b74403d9-fdca-4bea-a2d9-ca144611a8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:52.896831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:53.001578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 663/1339] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:33:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:33:53.296407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea22c1-582c-4ba7-a6c4-ff59dfbdbf53 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:53.297994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-92ea22c1-582c-4ba7-a6c4-ff59dfbdbf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:53.424980 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea22c1-582c-4ba7-a6c4-ff59dfbdbf53 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:53.529296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd304b-03e5-468f-9eef-1d33e8ad0dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:53.530094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd304b-03e5-468f-9eef-1d33e8ad0dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:53.530479 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd304b-03e5-468f-9eef-1d33e8ad0dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:53.530850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd304b-03e5-468f-9eef-1d33e8ad0dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:53.532736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-cccd304b-03e5-468f-9eef-1d33e8ad0dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:53.577713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:53.669748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd304b-03e5-468f-9eef-1d33e8ad0dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:53.671626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd304b-03e5-468f-9eef-1d33e8ad0dcf service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:53.693995 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 677/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:33:58.681673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b67e1b-31a6-404a-8565-5fb77050d8f0 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:58.682456 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b67e1b-31a6-404a-8565-5fb77050d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:58.682456 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b67e1b-31a6-404a-8565-5fb77050d8f0 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:58.684416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 664/1341] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:33:58.690148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b9413-7803-4640-a063-1720435c3681 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:58.691100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b9413-7803-4640-a063-1720435c3681 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:58.691100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b9413-7803-4640-a063-1720435c3681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:58.769955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-866b9413-7803-4640-a063-1720435c3681 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:33:58.771151 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-866b9413-7803-4640-a063-1720435c3681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:58.933089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:58.958118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 678/1342] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:33:59.402213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b67e1b-31a6-404a-8565-5fb77050d8f0 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:33:59.403963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-50b67e1b-31a6-404a-8565-5fb77050d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:59.538057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b67e1b-31a6-404a-8565-5fb77050d8f0 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:33:59.586510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:33:59.630235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aea90c-92c0-4ac1-9e29-36ad81eb461d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:33:59.630864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea90c-92c0-4ac1-9e29-36ad81eb461d service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:33:59.631144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea90c-92c0-4ac1-9e29-36ad81eb461d service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:33:59.631415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea90c-92c0-4ac1-9e29-36ad81eb461d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:33:59.633820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e9aea90c-92c0-4ac1-9e29-36ad81eb461d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:33:59.778812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aea90c-92c0-4ac1-9e29-36ad81eb461d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:33:59.780252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aea90c-92c0-4ac1-9e29-36ad81eb461d service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:33:59.805095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 665/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:03.532807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010356cc-cde3-476b-a4ad-441d2e755f8e None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:03.533637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010356cc-cde3-476b-a4ad-441d2e755f8e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:03.533908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010356cc-cde3-476b-a4ad-441d2e755f8e None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:03.536499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 679/1344] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:34:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:03.544477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b5412-6d73-40f6-8e8b-ba0af6bc4d81 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:03.545108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b5412-6d73-40f6-8e8b-ba0af6bc4d81 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:03.545570 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b5412-6d73-40f6-8e8b-ba0af6bc4d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:03.654351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-1d3b5412-6d73-40f6-8e8b-ba0af6bc4d81 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:03.656525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1d3b5412-6d73-40f6-8e8b-ba0af6bc4d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:03.692203 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:03.843071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 666/1345] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:34:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:04.366481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010356cc-cde3-476b-a4ad-441d2e755f8e None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:04.369357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-010356cc-cde3-476b-a4ad-441d2e755f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:04.558232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010356cc-cde3-476b-a4ad-441d2e755f8e None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:04.688110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9186c96-96e3-40b4-80cf-f856eafefae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:04.688617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9186c96-96e3-40b4-80cf-f856eafefae0 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:04.688915 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9186c96-96e3-40b4-80cf-f856eafefae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:04.689148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9186c96-96e3-40b4-80cf-f856eafefae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:04.690894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b9186c96-96e3-40b4-80cf-f856eafefae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:04.744697 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:04.854256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9186c96-96e3-40b4-80cf-f856eafefae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:04.856916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9186c96-96e3-40b4-80cf-f856eafefae0 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:04.884547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 680/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:09.999023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0fa0d-fae2-4b13-9ccb-9a74c1dcd8a3 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:09.999613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0fa0d-fae2-4b13-9ccb-9a74c1dcd8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:09.999806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0fa0d-fae2-4b13-9ccb-9a74c1dcd8a3 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:10.002519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 667/1347] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:34:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:10.011120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada6457-1cff-42e3-aece-77c6155addbd None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:10.013568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada6457-1cff-42e3-aece-77c6155addbd None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:10.013568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada6457-1cff-42e3-aece-77c6155addbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:10.106349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-0ada6457-1cff-42e3-aece-77c6155addbd None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:10.107650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0ada6457-1cff-42e3-aece-77c6155addbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:10.230770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:10.233770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 681/1348] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:10.578446 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0fa0d-fae2-4b13-9ccb-9a74c1dcd8a3 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:10.580092 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fea0fa0d-fae2-4b13-9ccb-9a74c1dcd8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:10.726285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0fa0d-fae2-4b13-9ccb-9a74c1dcd8a3 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:10.789570 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:10.825673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bb6ef-8eb8-48f3-bb5a-22d69e180ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:10.826442 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bb6ef-8eb8-48f3-bb5a-22d69e180ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:10.826770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bb6ef-8eb8-48f3-bb5a-22d69e180ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:10.827104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bb6ef-8eb8-48f3-bb5a-22d69e180ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:10.828910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a90bb6ef-8eb8-48f3-bb5a-22d69e180ab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:10.985047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bb6ef-8eb8-48f3-bb5a-22d69e180ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:10.986579 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bb6ef-8eb8-48f3-bb5a-22d69e180ab1 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:11.015332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 668/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:16.939323 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bedc87-29ee-41f7-9a7a-384222ba5bc9 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:16.939870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bedc87-29ee-41f7-9a7a-384222ba5bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:16.940298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bedc87-29ee-41f7-9a7a-384222ba5bc9 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:16.947013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 682/1350] 10.222.0.48 () {54 vars in 921 bytes} [Thu Sep 1 05:34:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:16.954695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbef0b-b079-41d5-8c11-52d57e60aae9 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:16.955743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbef0b-b079-41d5-8c11-52d57e60aae9 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:16.956482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbef0b-b079-41d5-8c11-52d57e60aae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:17.083456 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-5dbbef0b-b079-41d5-8c11-52d57e60aae9 None None] MFA Rules not processed for user `055823f7760f485eb91266a0d63db602`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:17.084998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5dbbef0b-b079-41d5-8c11-52d57e60aae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:17.111906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:17.262035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 669/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Sep 1 05:34:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:22.684897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6894a-d1e8-4c3b-ab69-3967d5f95015 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:22.685619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6894a-d1e8-4c3b-ab69-3967d5f95015 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:22.685619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6894a-d1e8-4c3b-ab69-3967d5f95015 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:22.687404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 683/1352] 10.222.0.48 () {54 vars in 921 bytes} [Thu Sep 1 05:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:22.693348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87c0e4-1015-4319-ad67-e19d78b8932b None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:22.693941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87c0e4-1015-4319-ad67-e19d78b8932b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:22.693941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87c0e4-1015-4319-ad67-e19d78b8932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:22.788094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-8b87c0e4-1015-4319-ad67-e19d78b8932b None None] MFA Rules not processed for user `055823f7760f485eb91266a0d63db602`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:22.789472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8b87c0e4-1015-4319-ad67-e19d78b8932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:22.884321 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:22.933530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 670/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Sep 1 05:34:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:24.751554 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37f4d0-83fd-4023-9231-048ea3f8fdbd None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:24.752603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37f4d0-83fd-4023-9231-048ea3f8fdbd None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:24.752603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37f4d0-83fd-4023-9231-048ea3f8fdbd None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:24.754297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 684/1354] 10.222.0.48 () {54 vars in 921 bytes} [Thu Sep 1 05:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:24.760766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f9c68-d759-44ac-ae42-4d633b2b65bc None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:24.761639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f9c68-d759-44ac-ae42-4d633b2b65bc None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:24.761803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f9c68-d759-44ac-ae42-4d633b2b65bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:24.878914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-f31f9c68-d759-44ac-ae42-4d633b2b65bc None None] MFA Rules not processed for user `055823f7760f485eb91266a0d63db602`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:24.880449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f31f9c68-d759-44ac-ae42-4d633b2b65bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:25.029633 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 671/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Sep 1 05:34:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:34:28.987255 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484944d8-d660-4647-894d-7ef9b3b06297 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:28.987981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484944d8-d660-4647-894d-7ef9b3b06297 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:28.988134 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484944d8-d660-4647-894d-7ef9b3b06297 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:28.990664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 685/1356] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:34:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:29.001466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cf39a-ea86-4ec6-a526-c88cbbe8a1c6 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:29.002147 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cf39a-ea86-4ec6-a526-c88cbbe8a1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:29.002420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cf39a-ea86-4ec6-a526-c88cbbe8a1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:29.076663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:29.141338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-056cf39a-ea86-4ec6-a526-c88cbbe8a1c6 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:29.143454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-056cf39a-ea86-4ec6-a526-c88cbbe8a1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:29.328548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 672/1357] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:29.918627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa723c-c685-44ac-a82f-f601df85d714 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:29.919168 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa723c-c685-44ac-a82f-f601df85d714 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:29.919591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa723c-c685-44ac-a82f-f601df85d714 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:29.921609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 686/1358] 10.222.0.48 () {54 vars in 962 bytes} [Thu Sep 1 05:34:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:29.939348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dd5a7-9c82-4de5-98c0-b9f197730cec None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:29.940488 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dd5a7-9c82-4de5-98c0-b9f197730cec None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:29.941720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27dd5a7-9c82-4de5-98c0-b9f197730cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:30.125855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b27dd5a7-9c82-4de5-98c0-b9f197730cec None None] MFA Rules not processed for user `b7e84a5652df4d64aa1fd28f3d5383fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:30.128281 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b27dd5a7-9c82-4de5-98c0-b9f197730cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:30.237597 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:30.382592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 673/1359] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Sep 1 05:34:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:30.395338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa723c-c685-44ac-a82f-f601df85d714 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:30.399199 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-87aa723c-c685-44ac-a82f-f601df85d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:30.725690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa723c-c685-44ac-a82f-f601df85d714 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:30.904980 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:30.993184 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b38b6-ef41-4a44-b051-c130a78f9ba0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:30.995306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b38b6-ef41-4a44-b051-c130a78f9ba0 service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:30.995897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b38b6-ef41-4a44-b051-c130a78f9ba0 service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:30.996529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b38b6-ef41-4a44-b051-c130a78f9ba0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:30.999763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-223b38b6-ef41-4a44-b051-c130a78f9ba0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:31.168908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b38b6-ef41-4a44-b051-c130a78f9ba0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:31.172050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b38b6-ef41-4a44-b051-c130a78f9ba0 service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:31.215550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 687/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 821 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:33.687757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7559-97b9-4655-9f7a-c3d8bfe32e62 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:33.688290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7559-97b9-4655-9f7a-c3d8bfe32e62 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:33.688376 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b7559-97b9-4655-9f7a-c3d8bfe32e62 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:33.690259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 674/1361] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:34:33.695568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dc169-9c22-46df-8634-7fd7aa48bbcc None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:33.696194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dc169-9c22-46df-8634-7fd7aa48bbcc None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:33.696194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dc169-9c22-46df-8634-7fd7aa48bbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:33.781389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-275dc169-9c22-46df-8634-7fd7aa48bbcc None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:33.782698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-275dc169-9c22-46df-8634-7fd7aa48bbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:33.846475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:33.928473 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 688/1362] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:34:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:34.491838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b7559-97b9-4655-9f7a-c3d8bfe32e62 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:34.495672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e08b7559-97b9-4655-9f7a-c3d8bfe32e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:34.770153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b7559-97b9-4655-9f7a-c3d8bfe32e62 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:34.785129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:34.925005 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cdb38-d61d-4d0d-98dd-bf06d2f244c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:34.925674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cdb38-d61d-4d0d-98dd-bf06d2f244c3 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:34.925946 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cdb38-d61d-4d0d-98dd-bf06d2f244c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:34.926223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cdb38-d61d-4d0d-98dd-bf06d2f244c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:34.927955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2d2cdb38-d61d-4d0d-98dd-bf06d2f244c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:35.062159 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cdb38-d61d-4d0d-98dd-bf06d2f244c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:35.065209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cdb38-d61d-4d0d-98dd-bf06d2f244c3 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:35.103459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 675/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:38.085818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb229-fb00-4873-826c-855433524954 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.086680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb229-fb00-4873-826c-855433524954 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.086680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eb229-fb00-4873-826c-855433524954 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:38.089293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 689/1364] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:34:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:38.096483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c2bb3-14a2-4169-8d9b-97f1e0600247 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.102444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c2bb3-14a2-4169-8d9b-97f1e0600247 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.102444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c2bb3-14a2-4169-8d9b-97f1e0600247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:38.132400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:38.241864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-244c2bb3-14a2-4169-8d9b-97f1e0600247 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:38.244691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-244c2bb3-14a2-4169-8d9b-97f1e0600247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:38.426620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 676/1365] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:38.848219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a78f9-5f66-4625-98a7-99a6df97b564 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.848548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a78f9-5f66-4625-98a7-99a6df97b564 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.848912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a78f9-5f66-4625-98a7-99a6df97b564 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:38.850580 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 690/1366] 10.222.0.48 () {54 vars in 962 bytes} [Thu Sep 1 05:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:34:38.860496 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2863923-3f2a-4627-8b2f-a9362f8e944e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:38.862143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2863923-3f2a-4627-8b2f-a9362f8e944e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:38.863610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2863923-3f2a-4627-8b2f-a9362f8e944e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:39.055550 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b2863923-3f2a-4627-8b2f-a9362f8e944e None None] MFA Rules not processed for user `b7e84a5652df4d64aa1fd28f3d5383fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:39.059380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b2863923-3f2a-4627-8b2f-a9362f8e944e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:39.140583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2a03e-007b-4dd4-a2ca-927757982a14 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:39.141313 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:39.142266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2a03e-007b-4dd4-a2ca-927757982a14 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:39.142600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2a03e-007b-4dd4-a2ca-927757982a14 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:39.145114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 691/1367] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:34:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:34:39.153964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfe882-0cf3-47c2-8aee-efb248b12425 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:39.154422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfe882-0cf3-47c2-8aee-efb248b12425 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:39.154873 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfe882-0cf3-47c2-8aee-efb248b12425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:39.271502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-0bbfe882-0cf3-47c2-8aee-efb248b12425 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:39.273686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0bbfe882-0cf3-47c2-8aee-efb248b12425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:39.319796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 677/1368] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Sep 1 05:34:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:39.329106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2863923-3f2a-4627-8b2f-a9362f8e944e None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:39.347806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2863923-3f2a-4627-8b2f-a9362f8e944e None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:39.446719 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 692/1369] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:34:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:39.618939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7222b-881a-4e36-9ee0-05b30c238c22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:39.620049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7222b-881a-4e36-9ee0-05b30c238c22 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:39.620560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7222b-881a-4e36-9ee0-05b30c238c22 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:39.621049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7222b-881a-4e36-9ee0-05b30c238c22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:39.624863 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-36d7222b-881a-4e36-9ee0-05b30c238c22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:39.664654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:39.850865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7222b-881a-4e36-9ee0-05b30c238c22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:39.854933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7222b-881a-4e36-9ee0-05b30c238c22 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:39.910302 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 678/1370] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:34:40.105403 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe067c3-51b5-4694-95b1-dde90735fdbc None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:40.105875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe067c3-51b5-4694-95b1-dde90735fdbc None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:40.106328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe067c3-51b5-4694-95b1-dde90735fdbc None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:40.108151 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 693/1371] 10.222.0.48 () {54 vars in 964 bytes} [Thu Sep 1 05:34:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:40.115250 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c092ce-ba11-43f5-913a-2a105b57a214 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:40.115871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c092ce-ba11-43f5-913a-2a105b57a214 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:40.116497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c092ce-ba11-43f5-913a-2a105b57a214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:40.261282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-99c092ce-ba11-43f5-913a-2a105b57a214 None None] MFA Rules not processed for user `e03daa3b2e334436ad4d0b2915a61aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:40.262685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-99c092ce-ba11-43f5-913a-2a105b57a214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:40.372080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 679/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Sep 1 05:34:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:40.380249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe067c3-51b5-4694-95b1-dde90735fdbc None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:40.381836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1fe067c3-51b5-4694-95b1-dde90735fdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:40.418611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:40.638966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe067c3-51b5-4694-95b1-dde90735fdbc None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:40.795105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665f593-674d-4775-8091-53bc0b350a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:40.796310 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665f593-674d-4775-8091-53bc0b350a2a service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:40.796688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665f593-674d-4775-8091-53bc0b350a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:40.797185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665f593-674d-4775-8091-53bc0b350a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:40.803875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3665f593-674d-4775-8091-53bc0b350a2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:40.952919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:41.003802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665f593-674d-4775-8091-53bc0b350a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:41.006103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665f593-674d-4775-8091-53bc0b350a2a service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:41.031951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 694/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:42.898590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be851b-a04d-484a-a8cb-ee930388984d None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.899216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be851b-a04d-484a-a8cb-ee930388984d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.899216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be851b-a04d-484a-a8cb-ee930388984d None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:42.901088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 680/1374] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:42.907669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932f1ea-e37f-43e2-b0be-8c31885fb26b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:42.908586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932f1ea-e37f-43e2-b0be-8c31885fb26b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:42.908766 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932f1ea-e37f-43e2-b0be-8c31885fb26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:43.003838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-8932f1ea-e37f-43e2-b0be-8c31885fb26b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:43.005266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8932f1ea-e37f-43e2-b0be-8c31885fb26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:43.177005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 695/1375] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:34:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:43.511916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be851b-a04d-484a-a8cb-ee930388984d None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:43.514306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c3be851b-a04d-484a-a8cb-ee930388984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:43.527134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:43.743380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be851b-a04d-484a-a8cb-ee930388984d None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:43.901598 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:43.968357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f63fe-7b68-4c55-8f04-90e5be262148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:43.969475 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f63fe-7b68-4c55-8f04-90e5be262148 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:43.969898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f63fe-7b68-4c55-8f04-90e5be262148 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:43.970347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f63fe-7b68-4c55-8f04-90e5be262148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:43.973645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fa2f63fe-7b68-4c55-8f04-90e5be262148 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:44.122434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f63fe-7b68-4c55-8f04-90e5be262148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:44.122434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f63fe-7b68-4c55-8f04-90e5be262148 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:44.145871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 681/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:34:46.637897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6967b-135e-427d-9a8c-c2f513dee196 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:46.638476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6967b-135e-427d-9a8c-c2f513dee196 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:46.638476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6967b-135e-427d-9a8c-c2f513dee196 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:46.640192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 696/1377] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:46.646021 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b4a85-2d30-4381-90d7-1e4e605d7951 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:46.646624 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b4a85-2d30-4381-90d7-1e4e605d7951 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:46.646624 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b4a85-2d30-4381-90d7-1e4e605d7951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:46.775939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-bb4b4a85-2d30-4381-90d7-1e4e605d7951 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:46.778755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bb4b4a85-2d30-4381-90d7-1e4e605d7951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:46.887346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:46.967076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 682/1378] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:34:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:47.280715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6967b-135e-427d-9a8c-c2f513dee196 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:47.282690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-72b6967b-135e-427d-9a8c-c2f513dee196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:47.320767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:47.505282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6967b-135e-427d-9a8c-c2f513dee196 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:47.727571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:47.752547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ada053-9a0c-4a1b-8c83-509c934e850a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:47.753531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ada053-9a0c-4a1b-8c83-509c934e850a service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:47.754024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ada053-9a0c-4a1b-8c83-509c934e850a service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:47.754516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ada053-9a0c-4a1b-8c83-509c934e850a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:47.758017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-78ada053-9a0c-4a1b-8c83-509c934e850a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:47.948651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ada053-9a0c-4a1b-8c83-509c934e850a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:47.950599 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ada053-9a0c-4a1b-8c83-509c934e850a service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:47.975088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 697/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:50.679377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4feb-7dd4-4ee4-9a20-182c506e3332 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:50.679854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4feb-7dd4-4ee4-9a20-182c506e3332 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:50.681781 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff4feb-7dd4-4ee4-9a20-182c506e3332 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:50.684743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 683/1380] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:34:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:50.690698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700dc9f-7db6-4729-bb60-c95071fe73f9 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:50.691145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700dc9f-7db6-4729-bb60-c95071fe73f9 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:50.691337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700dc9f-7db6-4729-bb60-c95071fe73f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:50.807270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-6700dc9f-7db6-4729-bb60-c95071fe73f9 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:50.809037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6700dc9f-7db6-4729-bb60-c95071fe73f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:50.931400 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:50.982628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 698/1381] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:51.379332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff4feb-7dd4-4ee4-9a20-182c506e3332 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:51.381694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bdff4feb-7dd4-4ee4-9a20-182c506e3332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:51.596253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff4feb-7dd4-4ee4-9a20-182c506e3332 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:51.640938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:51.797530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121668f-1596-46a2-bf39-820d5d472665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:51.798601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121668f-1596-46a2-bf39-820d5d472665 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:51.799068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121668f-1596-46a2-bf39-820d5d472665 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:51.799513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121668f-1596-46a2-bf39-820d5d472665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:51.802623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d121668f-1596-46a2-bf39-820d5d472665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:51.926073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121668f-1596-46a2-bf39-820d5d472665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:51.927636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121668f-1596-46a2-bf39-820d5d472665 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:51.951513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 684/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:34:54.726281 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1809685-e411-4f60-967e-48ab6c952c77 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:54.728725 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1809685-e411-4f60-967e-48ab6c952c77 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:54.728725 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1809685-e411-4f60-967e-48ab6c952c77 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:54.728725 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 699/1383] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:34:54.736541 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b78200-9fb9-4475-b7ca-be2f044832a8 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:54.737328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b78200-9fb9-4475-b7ca-be2f044832a8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:54.737958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b78200-9fb9-4475-b7ca-be2f044832a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:54.804890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:54.854599 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-16b78200-9fb9-4475-b7ca-be2f044832a8 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:54.856176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-16b78200-9fb9-4475-b7ca-be2f044832a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:55.057671 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 685/1384] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:34:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:55.386188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1809685-e411-4f60-967e-48ab6c952c77 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:55.389142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d1809685-e411-4f60-967e-48ab6c952c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:55.666081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1809685-e411-4f60-967e-48ab6c952c77 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:55.733644 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:55.862696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3a596-a373-45a5-830e-e6d20bcb5f01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:55.862696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3a596-a373-45a5-830e-e6d20bcb5f01 service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:55.862696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3a596-a373-45a5-830e-e6d20bcb5f01 service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:55.862696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3a596-a373-45a5-830e-e6d20bcb5f01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:55.864103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-10b3a596-a373-45a5-830e-e6d20bcb5f01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:56.035600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3a596-a373-45a5-830e-e6d20bcb5f01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:56.038617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3a596-a373-45a5-830e-e6d20bcb5f01 service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:56.070592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 700/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:58.305222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f70622-144c-44b8-a606-19e2a9d74478 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:58.306682 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f70622-144c-44b8-a606-19e2a9d74478 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:58.307149 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f70622-144c-44b8-a606-19e2a9d74478 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:58.310210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 686/1386] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:34:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:58.317222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e877-5328-484d-ab1c-0c7320ce4138 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:58.317822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e877-5328-484d-ab1c-0c7320ce4138 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:58.318231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967e877-5328-484d-ab1c-0c7320ce4138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:58.413125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-7967e877-5328-484d-ab1c-0c7320ce4138 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:58.414442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7967e877-5328-484d-ab1c-0c7320ce4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:58.417109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:58.558021 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eae32-3bca-4b38-9b20-3f777ec17aac None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:58.558309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eae32-3bca-4b38-9b20-3f777ec17aac None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:58.558468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2eae32-3bca-4b38-9b20-3f777ec17aac None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:58.559848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 687/1387] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:34:58.565710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee1cc-9c63-40d9-a62e-bf360aebbfb9 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:58.566003 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee1cc-9c63-40d9-a62e-bf360aebbfb9 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:58.566265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eee1cc-9c63-40d9-a62e-bf360aebbfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:58.567229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 701/1388] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:34:58.657550 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-00eee1cc-9c63-40d9-a62e-bf360aebbfb9 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:58.658805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-00eee1cc-9c63-40d9-a62e-bf360aebbfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:58.734550 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:58.783992 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 688/1389] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:34:58.979973 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e877-5328-484d-ab1c-0c7320ce4138 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:58.982249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7967e877-5328-484d-ab1c-0c7320ce4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:59.152707 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967e877-5328-484d-ab1c-0c7320ce4138 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:59.172231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6afa7f-bdce-444d-b08f-b6cb82207ecc None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:59.172563 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6afa7f-bdce-444d-b08f-b6cb82207ecc None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:59.172823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6afa7f-bdce-444d-b08f-b6cb82207ecc None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:59.174296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 689/1390] 10.222.0.48 () {54 vars in 967 bytes} [Thu Sep 1 05:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:34:59.179829 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84dec2-f7a7-4743-9a0a-ece651b19dab None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:59.180133 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84dec2-f7a7-4743-9a0a-ece651b19dab None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:59.180921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84dec2-f7a7-4743-9a0a-ece651b19dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:59.182475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:59.273631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-2d84dec2-f7a7-4743-9a0a-ece651b19dab None None] MFA Rules not processed for user `c596e424ab8e4637bae1721488c9fcc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:34:59.275397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2d84dec2-f7a7-4743-9a0a-ece651b19dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:59.337828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f3b69-e84d-4242-b97e-aec247694c82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:59.338736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f3b69-e84d-4242-b97e-aec247694c82 service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:59.338736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f3b69-e84d-4242-b97e-aec247694c82 service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:59.339070 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f3b69-e84d-4242-b97e-aec247694c82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:59.341097 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c76f3b69-e84d-4242-b97e-aec247694c82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:59.389513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 690/1391] 10.222.0.48 () {58 vars in 1064 bytes} [Thu Sep 1 05:34:59 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:34:59.397450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84dec2-f7a7-4743-9a0a-ece651b19dab None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:34:59.406584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84dec2-f7a7-4743-9a0a-ece651b19dab None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:34:59.477077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:34:59.484437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f3b69-e84d-4242-b97e-aec247694c82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:59.486519 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f3b69-e84d-4242-b97e-aec247694c82 service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:59.507428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb730ee-01e0-482b-bc52-711f05f98c23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c596e424ab8e4637bae1721488c9fcc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:34:59.508046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb730ee-01e0-482b-bc52-711f05f98c23 service glance] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:34:59.508318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb730ee-01e0-482b-bc52-711f05f98c23 service glance] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:34:59.508686 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb730ee-01e0-482b-bc52-711f05f98c23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:34:59.510499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9bb730ee-01e0-482b-bc52-711f05f98c23 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:34:59.515245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 702/1392] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:34:59.650290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb730ee-01e0-482b-bc52-711f05f98c23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:34:59.651868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb730ee-01e0-482b-bc52-711f05f98c23 service glance] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:34:59.675370 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 691/1393] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:35:00.957299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42a83-577d-44f8-afb1-63ee6bed1620 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:00.957973 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42a83-577d-44f8-afb1-63ee6bed1620 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:00.958277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42a83-577d-44f8-afb1-63ee6bed1620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:01.024564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:01.082796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-44c42a83-577d-44f8-afb1-63ee6bed1620 None None] MFA Rules not processed for user `eb75c0fb10484f3d80813962a4283b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:01.084230 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-44c42a83-577d-44f8-afb1-63ee6bed1620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:01.198452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 703/1394] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:35:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:01.271736 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35916a61-b790-41e7-8ad1-8a87eb98520c None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:01.272630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35916a61-b790-41e7-8ad1-8a87eb98520c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:01.272870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35916a61-b790-41e7-8ad1-8a87eb98520c None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:01.275102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 692/1395] 10.222.0.48 () {54 vars in 943 bytes} [Thu Sep 1 05:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:01.283844 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d849-ef99-4667-9899-ef1c726767fc None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:01.284332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d849-ef99-4667-9899-ef1c726767fc None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:01.284809 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801d849-ef99-4667-9899-ef1c726767fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:01.399587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-2801d849-ef99-4667-9899-ef1c726767fc None None] MFA Rules not processed for user `8a0d07b79212443480c87f4a4ff3ca00`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:01.400832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2801d849-ef99-4667-9899-ef1c726767fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:01.490320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:01.563589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 704/1396] 10.222.0.48 () {58 vars in 1040 bytes} [Thu Sep 1 05:35:01 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:01.576127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35916a61-b790-41e7-8ad1-8a87eb98520c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:01.577902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-35916a61-b790-41e7-8ad1-8a87eb98520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:01.692206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:01.773570 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35916a61-b790-41e7-8ad1-8a87eb98520c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:01.816447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6780fbf-0202-4008-a0cb-34650f44b9b3 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:01.817275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6780fbf-0202-4008-a0cb-34650f44b9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:01.817918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6780fbf-0202-4008-a0cb-34650f44b9b3 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:01.821965 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 705/1397] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:35:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:01.828579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f77c99-87f0-4310-96fd-59c4140d5d3a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:01.834247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f77c99-87f0-4310-96fd-59c4140d5d3a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:01.834247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f77c99-87f0-4310-96fd-59c4140d5d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:01.930149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-55f77c99-87f0-4310-96fd-59c4140d5d3a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:01.932084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-55f77c99-87f0-4310-96fd-59c4140d5d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:01.935883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a107a71-7e96-4c49-8d41-b8c774d0da5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a0d07b79212443480c87f4a4ff3ca00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:01.936806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a107a71-7e96-4c49-8d41-b8c774d0da5c service swift] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:01.937265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a107a71-7e96-4c49-8d41-b8c774d0da5c service swift] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:01.937720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a107a71-7e96-4c49-8d41-b8c774d0da5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:01.940576 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4a107a71-7e96-4c49-8d41-b8c774d0da5c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:02.036622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:02.061004 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a107a71-7e96-4c49-8d41-b8c774d0da5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:02.062853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a107a71-7e96-4c49-8d41-b8c774d0da5c service swift] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:02.068339 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 706/1398] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:35:02.077695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 693/1399] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Sep 1 05:35:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:35:02.402896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f77c99-87f0-4310-96fd-59c4140d5d3a None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:02.404155 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-55f77c99-87f0-4310-96fd-59c4140d5d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:02.439780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:02.531214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f77c99-87f0-4310-96fd-59c4140d5d3a None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:02.689331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae9867-4684-426b-a21e-7b4992571cae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:02.690761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae9867-4684-426b-a21e-7b4992571cae service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:02.691055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae9867-4684-426b-a21e-7b4992571cae service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:02.691328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae9867-4684-426b-a21e-7b4992571cae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:02.693066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-bdae9867-4684-426b-a21e-7b4992571cae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:02.723392 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:02.860196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae9867-4684-426b-a21e-7b4992571cae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:02.861894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae9867-4684-426b-a21e-7b4992571cae service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:02.889173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 707/1400] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:35:05.459257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd806f0-12a7-4e50-bff1-9b0d7c2736df None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:05.459891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd806f0-12a7-4e50-bff1-9b0d7c2736df None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:05.460288 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd806f0-12a7-4e50-bff1-9b0d7c2736df None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:05.468090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 694/1401] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:35:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:05.470455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13fe69-5ae5-4012-9200-98bb33d77861 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:05.471419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13fe69-5ae5-4012-9200-98bb33d77861 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:05.471822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b13fe69-5ae5-4012-9200-98bb33d77861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:05.604335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-7b13fe69-5ae5-4012-9200-98bb33d77861 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:05.606321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7b13fe69-5ae5-4012-9200-98bb33d77861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:05.747978 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:05.750893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 708/1402] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:06.074600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd806f0-12a7-4e50-bff1-9b0d7c2736df None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:06.077605 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1bd806f0-12a7-4e50-bff1-9b0d7c2736df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:06.361298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd806f0-12a7-4e50-bff1-9b0d7c2736df None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:06.471855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:06.547552 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c052b10-c183-4ee4-863d-3b9083d3f412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:06.548655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c052b10-c183-4ee4-863d-3b9083d3f412 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:06.549110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c052b10-c183-4ee4-863d-3b9083d3f412 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:06.549591 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c052b10-c183-4ee4-863d-3b9083d3f412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:06.551497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2c052b10-c183-4ee4-863d-3b9083d3f412 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:06.681414 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c052b10-c183-4ee4-863d-3b9083d3f412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:06.683220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c052b10-c183-4ee4-863d-3b9083d3f412 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:06.708119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 695/1403] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:35:09.202228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412480b-bb02-46ce-a891-f44901163dc1 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:09.202843 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412480b-bb02-46ce-a891-f44901163dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:09.202843 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412480b-bb02-46ce-a891-f44901163dc1 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:09.205765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 709/1404] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:09.210168 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7db8-3cee-4c54-ad8c-eebf031ad764 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:09.210745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7db8-3cee-4c54-ad8c-eebf031ad764 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:09.210745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb7db8-3cee-4c54-ad8c-eebf031ad764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:09.328186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-5feb7db8-3cee-4c54-ad8c-eebf031ad764 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:09.330382 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5feb7db8-3cee-4c54-ad8c-eebf031ad764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:09.366905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:09.506367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 696/1405] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:09.966681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412480b-bb02-46ce-a891-f44901163dc1 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:09.973789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2412480b-bb02-46ce-a891-f44901163dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:10.252888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412480b-bb02-46ce-a891-f44901163dc1 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:10.390835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:10.474283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0edfcd-1828-45b9-8626-c103612f655d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:10.475598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0edfcd-1828-45b9-8626-c103612f655d service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:10.476321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0edfcd-1828-45b9-8626-c103612f655d service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:10.478037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0edfcd-1828-45b9-8626-c103612f655d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:10.479637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-4c0edfcd-1828-45b9-8626-c103612f655d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:10.619246 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0edfcd-1828-45b9-8626-c103612f655d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:10.621134 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0edfcd-1828-45b9-8626-c103612f655d service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:10.647309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 710/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:35:13.408422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b2c38-083a-4a48-a934-d20ab2f599f8 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:13.409032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b2c38-083a-4a48-a934-d20ab2f599f8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:13.409630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b2c38-083a-4a48-a934-d20ab2f599f8 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:13.412889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 697/1407] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:35:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:13.419995 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b8dda-2e9f-4609-8d3a-d54f40af3d67 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:13.420569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b8dda-2e9f-4609-8d3a-d54f40af3d67 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:13.421008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b8dda-2e9f-4609-8d3a-d54f40af3d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:13.575416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-2f7b8dda-2e9f-4609-8d3a-d54f40af3d67 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:13.577619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2f7b8dda-2e9f-4609-8d3a-d54f40af3d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:13.657681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:13.794623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 711/1408] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:35:14.093711 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b2c38-083a-4a48-a934-d20ab2f599f8 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:14.096379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f61b2c38-083a-4a48-a934-d20ab2f599f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:14.395565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b2c38-083a-4a48-a934-d20ab2f599f8 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:14.423487 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:14.742088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090153c2-68d6-4c03-b9be-716904a4c288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:14.744207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090153c2-68d6-4c03-b9be-716904a4c288 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:14.745103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090153c2-68d6-4c03-b9be-716904a4c288 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:14.745907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090153c2-68d6-4c03-b9be-716904a4c288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:14.750476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-090153c2-68d6-4c03-b9be-716904a4c288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:14.982549 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090153c2-68d6-4c03-b9be-716904a4c288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:14.987127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090153c2-68d6-4c03-b9be-716904a4c288 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:15.037846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 698/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 944 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:35:23.783793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=27 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:25.032072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=98 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:29.689131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f043cf8-3d4a-4b2c-9a79-e8180644d1ea None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:29.689760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f043cf8-3d4a-4b2c-9a79-e8180644d1ea None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:29.689760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f043cf8-3d4a-4b2c-9a79-e8180644d1ea None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:29.691101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 712/1410] 10.222.0.48 () {54 vars in 918 bytes} [Thu Sep 1 05:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:29.698418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb89e9f-ab88-4e34-8715-1295ddadbf8a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:29.699329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb89e9f-ab88-4e34-8715-1295ddadbf8a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:29.699329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb89e9f-ab88-4e34-8715-1295ddadbf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:29.798680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-fcb89e9f-ab88-4e34-8715-1295ddadbf8a None None] MFA Rules not processed for user `055823f7760f485eb91266a0d63db602`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:29.799935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fcb89e9f-ab88-4e34-8715-1295ddadbf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:29.929808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 699/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Sep 1 05:35:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:29.945557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ec111-3f3b-46af-9096-2bf123d7edaf None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:29.945748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ec111-3f3b-46af-9096-2bf123d7edaf None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:29.946024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ec111-3f3b-46af-9096-2bf123d7edaf None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:29.947379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 713/1412] 10.222.0.48 () {54 vars in 918 bytes} [Thu Sep 1 05:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:29.952593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e7c98-954a-496b-8678-e3423ae1e953 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:29.952920 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e7c98-954a-496b-8678-e3423ae1e953 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:29.953198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e7c98-954a-496b-8678-e3423ae1e953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:30.041549 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:30.044850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-198e7c98-954a-496b-8678-e3423ae1e953 None None] MFA Rules not processed for user `b7e84a5652df4d64aa1fd28f3d5383fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:30.046119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-198e7c98-954a-496b-8678-e3423ae1e953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:30.209894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 700/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Sep 1 05:35:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:32.766149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5a5c6-4146-4ba3-87a2-74275e44b7be None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:32.766780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5a5c6-4146-4ba3-87a2-74275e44b7be None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:32.766780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5a5c6-4146-4ba3-87a2-74275e44b7be None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:32.768521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:32.775137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083ef75-e345-4dba-843e-09b0d5c956fe None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:32.775762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083ef75-e345-4dba-843e-09b0d5c956fe None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:32.775762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083ef75-e345-4dba-843e-09b0d5c956fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:32.866846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-7083ef75-e345-4dba-843e-09b0d5c956fe None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:32.868104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7083ef75-e345-4dba-843e-09b0d5c956fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:32.938111 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:32.989908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:33.309402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5a5c6-4146-4ba3-87a2-74275e44b7be None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:33.310988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-cbd5a5c6-4146-4ba3-87a2-74275e44b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:33.483459 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5a5c6-4146-4ba3-87a2-74275e44b7be None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:33.578813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:33.626335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db74e31-9116-4c0a-9470-f0a556283008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:33.626949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74e31-9116-4c0a-9470-f0a556283008 service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:33.627227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74e31-9116-4c0a-9470-f0a556283008 service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:33.627495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db74e31-9116-4c0a-9470-f0a556283008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:33.629188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5db74e31-9116-4c0a-9470-f0a556283008 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:33.735214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db74e31-9116-4c0a-9470-f0a556283008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:33.736864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db74e31-9116-4c0a-9470-f0a556283008 service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:33.756919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 715/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:35:34.737700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928c2bf-d61d-4f75-9c66-379589c1ae04 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:34.738323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928c2bf-d61d-4f75-9c66-379589c1ae04 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:34.738323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928c2bf-d61d-4f75-9c66-379589c1ae04 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:34.739642 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:34.746232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d0898-759b-400d-9add-65c334966f97 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:34.746979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d0898-759b-400d-9add-65c334966f97 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:34.746979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d0898-759b-400d-9add-65c334966f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:34.843989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-365d0898-759b-400d-9add-65c334966f97 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:34.845301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-365d0898-759b-400d-9add-65c334966f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:34.881347 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:34.970210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:35.134910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928c2bf-d61d-4f75-9c66-379589c1ae04 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:35.136457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d928c2bf-d61d-4f75-9c66-379589c1ae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:35.368890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928c2bf-d61d-4f75-9c66-379589c1ae04 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:35.433042 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:35.523146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549662f7-ce13-4d26-82ca-e397e4465fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:35.523770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549662f7-ce13-4d26-82ca-e397e4465fa4 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:35.524047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549662f7-ce13-4d26-82ca-e397e4465fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:35.524312 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549662f7-ce13-4d26-82ca-e397e4465fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:35.526093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-549662f7-ce13-4d26-82ca-e397e4465fa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:35.636839 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549662f7-ce13-4d26-82ca-e397e4465fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:35.638858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549662f7-ce13-4d26-82ca-e397e4465fa4 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:35.660362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 703/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:35:36.655902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e094b-8b7a-485d-867a-44c8f29333d8 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:36.656794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e094b-8b7a-485d-867a-44c8f29333d8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:36.656969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e094b-8b7a-485d-867a-44c8f29333d8 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:36.659499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:35:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:36.665303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c16ed-82d2-46a2-bb11-972f921f5cf1 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:36.665907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c16ed-82d2-46a2-bb11-972f921f5cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:36.665907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c16ed-82d2-46a2-bb11-972f921f5cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:36.730235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:36.755913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-049c16ed-82d2-46a2-bb11-972f921f5cf1 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:36.758124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-049c16ed-82d2-46a2-bb11-972f921f5cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:36.871351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:35:37.038834 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e094b-8b7a-485d-867a-44c8f29333d8 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:37.040355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b78e094b-8b7a-485d-867a-44c8f29333d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:37.219361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e094b-8b7a-485d-867a-44c8f29333d8 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:37.234649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:37.370684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c854205-311a-4d7f-a32c-40771e002c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:37.371294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c854205-311a-4d7f-a32c-40771e002c53 service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:37.371610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c854205-311a-4d7f-a32c-40771e002c53 service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:37.371885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c854205-311a-4d7f-a32c-40771e002c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:37.373638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2c854205-311a-4d7f-a32c-40771e002c53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:37.535737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c854205-311a-4d7f-a32c-40771e002c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:37.540141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c854205-311a-4d7f-a32c-40771e002c53 service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:37.570397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 718/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:35:38.552762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee7b00-8b08-4dce-86e9-4321f0aedebe None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:38.553680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee7b00-8b08-4dce-86e9-4321f0aedebe None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:38.553680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee7b00-8b08-4dce-86e9-4321f0aedebe None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:38.555277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:35:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:38.563472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ea0d8-69a3-4eb2-93a3-d2b1587cda4b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:38.564077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ea0d8-69a3-4eb2-93a3-d2b1587cda4b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:38.564077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0ea0d8-69a3-4eb2-93a3-d2b1587cda4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:38.588331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:38.679109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-3a0ea0d8-69a3-4eb2-93a3-d2b1587cda4b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:38.680418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3a0ea0d8-69a3-4eb2-93a3-d2b1587cda4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:38.803528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:38.961803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee7b00-8b08-4dce-86e9-4321f0aedebe None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:38.963466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4aee7b00-8b08-4dce-86e9-4321f0aedebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:39.113168 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:39.160157 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee7b00-8b08-4dce-86e9-4321f0aedebe None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:39.306032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5abdd7-3519-4cb4-882c-2de799e6dc64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:39.306658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5abdd7-3519-4cb4-882c-2de799e6dc64 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:39.306938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5abdd7-3519-4cb4-882c-2de799e6dc64 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:39.307215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5abdd7-3519-4cb4-882c-2de799e6dc64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:39.308904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-cc5abdd7-3519-4cb4-882c-2de799e6dc64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:39.398218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:39.414175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5abdd7-3519-4cb4-882c-2de799e6dc64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:39.415891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5abdd7-3519-4cb4-882c-2de799e6dc64 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:39.437939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 706/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:35:40.456137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0add2-f67d-4063-acf7-4f313621183f None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:40.456733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0add2-f67d-4063-acf7-4f313621183f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:40.456733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0add2-f67d-4063-acf7-4f313621183f None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:40.458204 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:40.467296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba91c-8d57-4a1c-8ad2-3a0cdf1826a1 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:40.467880 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba91c-8d57-4a1c-8ad2-3a0cdf1826a1 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:40.468010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defba91c-8d57-4a1c-8ad2-3a0cdf1826a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:40.568305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-defba91c-8d57-4a1c-8ad2-3a0cdf1826a1 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:40.570539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-defba91c-8d57-4a1c-8ad2-3a0cdf1826a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:40.686498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:40.847289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0add2-f67d-4063-acf7-4f313621183f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:40.849104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0ac0add2-f67d-4063-acf7-4f313621183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:40.958317 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:41.032208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0add2-f67d-4063-acf7-4f313621183f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:41.172992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08052069-9e7a-43f9-8e99-69170a8ad55f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:41.173635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08052069-9e7a-43f9-8e99-69170a8ad55f service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:41.173917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08052069-9e7a-43f9-8e99-69170a8ad55f service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:41.174187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08052069-9e7a-43f9-8e99-69170a8ad55f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:41.175889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-08052069-9e7a-43f9-8e99-69170a8ad55f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:41.237708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:41.287611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08052069-9e7a-43f9-8e99-69170a8ad55f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:41.289471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08052069-9e7a-43f9-8e99-69170a8ad55f service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:41.311321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 721/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:35:42.262334 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbcc5c-2bf2-4e2a-b764-768b7aef5482 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:42.263241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbcc5c-2bf2-4e2a-b764-768b7aef5482 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:42.263241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbcc5c-2bf2-4e2a-b764-768b7aef5482 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:42.265056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:35:42.270670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8af34-cbb2-474a-85f2-b2a5f2dd2245 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:42.271263 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8af34-cbb2-474a-85f2-b2a5f2dd2245 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:42.271263 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8af34-cbb2-474a-85f2-b2a5f2dd2245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:42.358455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-3bc8af34-cbb2-474a-85f2-b2a5f2dd2245 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:42.359682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3bc8af34-cbb2-474a-85f2-b2a5f2dd2245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:42.474491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:35:42.636332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbcc5c-2bf2-4e2a-b764-768b7aef5482 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:42.639263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7ccbcc5c-2bf2-4e2a-b764-768b7aef5482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:42.736674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:42.859722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbcc5c-2bf2-4e2a-b764-768b7aef5482 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:43.044888 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d691f-2b9c-4e0d-9e4d-e4fb3af0fec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:43.045551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d691f-2b9c-4e0d-9e4d-e4fb3af0fec1 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:43.048696 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d691f-2b9c-4e0d-9e4d-e4fb3af0fec1 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:43.048696 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d691f-2b9c-4e0d-9e4d-e4fb3af0fec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:43.048696 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c57d691f-2b9c-4e0d-9e4d-e4fb3af0fec1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:43.060959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:43.166607 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d691f-2b9c-4e0d-9e4d-e4fb3af0fec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:43.168537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d691f-2b9c-4e0d-9e4d-e4fb3af0fec1 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:43.190289 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 709/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:35:44.187498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ef82b-ac34-4f7a-8546-aba92a175fba None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:44.188070 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ef82b-ac34-4f7a-8546-aba92a175fba None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:44.188070 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ef82b-ac34-4f7a-8546-aba92a175fba None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:44.189541 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:44.196454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b7781-f04e-4d03-958d-d10df4d9615b None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:44.197029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b7781-f04e-4d03-958d-d10df4d9615b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:44.197029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b7781-f04e-4d03-958d-d10df4d9615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:44.288547 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-358b7781-f04e-4d03-958d-d10df4d9615b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:44.289831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-358b7781-f04e-4d03-958d-d10df4d9615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:44.379386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:44.419544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:35:44.588442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ef82b-ac34-4f7a-8546-aba92a175fba None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:44.590654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-778ef82b-ac34-4f7a-8546-aba92a175fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:44.614099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:44.803291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ef82b-ac34-4f7a-8546-aba92a175fba None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:44.934773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:44.967395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd62eba-033d-4ee5-b67f-685b663d9f2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:44.968073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd62eba-033d-4ee5-b67f-685b663d9f2f service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:44.968398 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd62eba-033d-4ee5-b67f-685b663d9f2f service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:44.968714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd62eba-033d-4ee5-b67f-685b663d9f2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:44.970617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8cd62eba-033d-4ee5-b67f-685b663d9f2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:45.100635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd62eba-033d-4ee5-b67f-685b663d9f2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:45.102006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd62eba-033d-4ee5-b67f-685b663d9f2f service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:45.123162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 724/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:35:46.078461 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb042cea-a544-403c-b07e-c6124559937f None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:46.079432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb042cea-a544-403c-b07e-c6124559937f None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:46.079432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb042cea-a544-403c-b07e-c6124559937f None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:46.081114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:46.086965 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c6a62-3596-4af4-82e9-ff1f84991ea5 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:46.087538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c6a62-3596-4af4-82e9-ff1f84991ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:46.087538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c6a62-3596-4af4-82e9-ff1f84991ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:46.179071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-699c6a62-3596-4af4-82e9-ff1f84991ea5 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:46.180509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-699c6a62-3596-4af4-82e9-ff1f84991ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:46.229226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:46.316261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:35:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:46.487020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb042cea-a544-403c-b07e-c6124559937f None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:46.488613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-eb042cea-a544-403c-b07e-c6124559937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:46.670647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb042cea-a544-403c-b07e-c6124559937f None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:46.740903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:46.832729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de883db-2523-46d1-a396-c425d6817bd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:46.833350 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de883db-2523-46d1-a396-c425d6817bd6 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:46.833654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de883db-2523-46d1-a396-c425d6817bd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:46.833927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de883db-2523-46d1-a396-c425d6817bd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:46.836201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8de883db-2523-46d1-a396-c425d6817bd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:46.948763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de883db-2523-46d1-a396-c425d6817bd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:46.950448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de883db-2523-46d1-a396-c425d6817bd6 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:46.972230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 712/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:35:47.933117 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad792c62-7a3f-42ec-b01a-3a1fd6bc8f74 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:47.933834 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad792c62-7a3f-42ec-b01a-3a1fd6bc8f74 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:47.933834 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad792c62-7a3f-42ec-b01a-3a1fd6bc8f74 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:47.935110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:35:47.941208 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142954b6-dbd9-455f-9e5c-47f4a78f025e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:47.942123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142954b6-dbd9-455f-9e5c-47f4a78f025e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:47.942318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142954b6-dbd9-455f-9e5c-47f4a78f025e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:48.041150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-142954b6-dbd9-455f-9e5c-47f4a78f025e None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:48.042349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-142954b6-dbd9-455f-9e5c-47f4a78f025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:48.044823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:48.197701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:48.440618 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad792c62-7a3f-42ec-b01a-3a1fd6bc8f74 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:48.442278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ad792c62-7a3f-42ec-b01a-3a1fd6bc8f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:48.638579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad792c62-7a3f-42ec-b01a-3a1fd6bc8f74 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:48.678064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:48.808755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13aa1f2-5ad7-4b07-91b0-be077b34968a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:48.809818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13aa1f2-5ad7-4b07-91b0-be077b34968a service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:48.810454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13aa1f2-5ad7-4b07-91b0-be077b34968a service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:48.811890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13aa1f2-5ad7-4b07-91b0-be077b34968a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:48.814366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c13aa1f2-5ad7-4b07-91b0-be077b34968a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:48.931661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13aa1f2-5ad7-4b07-91b0-be077b34968a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:48.933576 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13aa1f2-5ad7-4b07-91b0-be077b34968a service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:48.957736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 727/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:35:50.919097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cecf3e-7d98-4fcf-a0b0-65f55516facf None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:50.919758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cecf3e-7d98-4fcf-a0b0-65f55516facf None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:50.920021 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cecf3e-7d98-4fcf-a0b0-65f55516facf None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:50.922667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:35:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:50.929364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb985ff2-e22b-4671-820a-64a00f62cf24 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:50.930003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb985ff2-e22b-4671-820a-64a00f62cf24 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:50.930003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb985ff2-e22b-4671-820a-64a00f62cf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:50.984745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:51.031691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-cb985ff2-e22b-4671-820a-64a00f62cf24 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:51.033756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-cb985ff2-e22b-4671-820a-64a00f62cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:51.142328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:51.433624 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cecf3e-7d98-4fcf-a0b0-65f55516facf None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:51.435469 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-20cecf3e-7d98-4fcf-a0b0-65f55516facf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:51.559214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cecf3e-7d98-4fcf-a0b0-65f55516facf None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:51.594836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:51.654170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26a943-7a3d-4b4f-96f1-faca3184e4af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:51.654787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26a943-7a3d-4b4f-96f1-faca3184e4af service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:51.655066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26a943-7a3d-4b4f-96f1-faca3184e4af service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:51.655338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26a943-7a3d-4b4f-96f1-faca3184e4af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:51.656985 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ac26a943-7a3d-4b4f-96f1-faca3184e4af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:51.799153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26a943-7a3d-4b4f-96f1-faca3184e4af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:51.800534 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26a943-7a3d-4b4f-96f1-faca3184e4af service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:51.823263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 715/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:35:54.093814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20db53-d65f-4a0a-aeae-22659e0ab9c0 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:54.094684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20db53-d65f-4a0a-aeae-22659e0ab9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:54.094962 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20db53-d65f-4a0a-aeae-22659e0ab9c0 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:54.096568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:35:54.105562 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35180751-555e-4014-8106-6213a643ce99 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:54.106420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35180751-555e-4014-8106-6213a643ce99 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:54.106595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35180751-555e-4014-8106-6213a643ce99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:54.182855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-35180751-555e-4014-8106-6213a643ce99 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:54.184094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-35180751-555e-4014-8106-6213a643ce99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:54.199039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:54.296467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:54.618944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20db53-d65f-4a0a-aeae-22659e0ab9c0 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:54.620632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1e20db53-d65f-4a0a-aeae-22659e0ab9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:54.754954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20db53-d65f-4a0a-aeae-22659e0ab9c0 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:54.770514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:54.872158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571c210-2de9-4880-a285-106241741b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:54.873060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571c210-2de9-4880-a285-106241741b31 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:54.873572 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571c210-2de9-4880-a285-106241741b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:54.874220 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571c210-2de9-4880-a285-106241741b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:54.877731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7571c210-2de9-4880-a285-106241741b31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:55.027096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571c210-2de9-4880-a285-106241741b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:55.028703 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571c210-2de9-4880-a285-106241741b31 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:55.051300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 730/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:35:57.672733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e241-7244-47fa-8a8f-72a94aa8d7af None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:57.673330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e241-7244-47fa-8a8f-72a94aa8d7af None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:57.673330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7e241-7244-47fa-8a8f-72a94aa8d7af None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:57.674736 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:35:57.682533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c980e63-32d1-47ed-999d-d874475b4b47 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:57.683060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c980e63-32d1-47ed-999d-d874475b4b47 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:57.683366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c980e63-32d1-47ed-999d-d874475b4b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:57.745405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:57.768732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-6c980e63-32d1-47ed-999d-d874475b4b47 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:35:57.770067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6c980e63-32d1-47ed-999d-d874475b4b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:57.888519 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:35:58.183809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e241-7244-47fa-8a8f-72a94aa8d7af None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:35:58.185896 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-30c7e241-7244-47fa-8a8f-72a94aa8d7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:58.327998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7e241-7244-47fa-8a8f-72a94aa8d7af None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:35:58.384775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:35:58.447574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d72673-ab31-4b16-b381-b554d99f0a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:35:58.448434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d72673-ab31-4b16-b381-b554d99f0a9b service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:35:58.448877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d72673-ab31-4b16-b381-b554d99f0a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:35:58.449315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d72673-ab31-4b16-b381-b554d99f0a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:35:58.452315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-55d72673-ab31-4b16-b381-b554d99f0a9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:35:58.607997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d72673-ab31-4b16-b381-b554d99f0a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:35:58.609466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d72673-ab31-4b16-b381-b554d99f0a9b service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:35:58.632180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 718/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:00.931176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025a4ff-4737-42e7-8cc2-b23672e001c0 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:00.932053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025a4ff-4737-42e7-8cc2-b23672e001c0 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:00.932249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025a4ff-4737-42e7-8cc2-b23672e001c0 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:00.933818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:36:00.940097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed54d3-566f-4bae-a440-4812a690cab6 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:00.945276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed54d3-566f-4bae-a440-4812a690cab6 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:00.945276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed54d3-566f-4bae-a440-4812a690cab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:01.022195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-79ed54d3-566f-4bae-a440-4812a690cab6 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:01.023690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-79ed54d3-566f-4bae-a440-4812a690cab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:01.048184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:01.186243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:36:01.483786 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025a4ff-4737-42e7-8cc2-b23672e001c0 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:01.485542 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1025a4ff-4737-42e7-8cc2-b23672e001c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:01.621172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025a4ff-4737-42e7-8cc2-b23672e001c0 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:01.649899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:01.720030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4fd26b-aa75-4761-b102-63cdcaba295d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:01.720672 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fd26b-aa75-4761-b102-63cdcaba295d service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:01.720939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fd26b-aa75-4761-b102-63cdcaba295d service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:01.721211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fd26b-aa75-4761-b102-63cdcaba295d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:01.723034 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2e4fd26b-aa75-4761-b102-63cdcaba295d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:01.877959 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fd26b-aa75-4761-b102-63cdcaba295d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:01.882109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4fd26b-aa75-4761-b102-63cdcaba295d service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:01.919934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 733/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:04.164940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc86dd-7dd9-4712-baad-0c0a9c6b91d6 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:04.165618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc86dd-7dd9-4712-baad-0c0a9c6b91d6 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:04.165791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc86dd-7dd9-4712-baad-0c0a9c6b91d6 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:04.167134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:04.173323 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14164b-6429-4234-81c6-5c9df915ce1e None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:04.173950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14164b-6429-4234-81c6-5c9df915ce1e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:04.173950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14164b-6429-4234-81c6-5c9df915ce1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:04.251569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:04.256146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5f14164b-6429-4234-81c6-5c9df915ce1e None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:04.258008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5f14164b-6429-4234-81c6-5c9df915ce1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:04.389124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:36:04.683695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc86dd-7dd9-4712-baad-0c0a9c6b91d6 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:04.685255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-75fc86dd-7dd9-4712-baad-0c0a9c6b91d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:04.819377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc86dd-7dd9-4712-baad-0c0a9c6b91d6 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:04.899270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:04.945710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eced13-34ab-4874-9d66-2beb139759a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:04.946674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eced13-34ab-4874-9d66-2beb139759a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:04.947161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eced13-34ab-4874-9d66-2beb139759a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:04.947657 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eced13-34ab-4874-9d66-2beb139759a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:04.950952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d9eced13-34ab-4874-9d66-2beb139759a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:05.123286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eced13-34ab-4874-9d66-2beb139759a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:05.124768 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eced13-34ab-4874-9d66-2beb139759a2 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:05.274335 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 721/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:36:07.429752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ebe51-f016-42ae-b8bb-8523a65b86f1 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:07.430464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ebe51-f016-42ae-b8bb-8523a65b86f1 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:07.430464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ebe51-f016-42ae-b8bb-8523a65b86f1 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:07.431703 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:07.437948 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ea974-5254-4bba-9b63-46e6a9f87dd7 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:07.438510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ea974-5254-4bba-9b63-46e6a9f87dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:07.438510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ea974-5254-4bba-9b63-46e6a9f87dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:07.525680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-4e4ea974-5254-4bba-9b63-46e6a9f87dd7 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:07.527161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4e4ea974-5254-4bba-9b63-46e6a9f87dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:07.563834 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:07.648417 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:36:07.948814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ebe51-f016-42ae-b8bb-8523a65b86f1 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:07.951625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2b7ebe51-f016-42ae-b8bb-8523a65b86f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:08.162016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ebe51-f016-42ae-b8bb-8523a65b86f1 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:08.218882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:08.302920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e54a99-633a-4f1c-9514-0545f5d3a620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:08.303954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e54a99-633a-4f1c-9514-0545f5d3a620 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:08.304385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e54a99-633a-4f1c-9514-0545f5d3a620 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:08.304796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e54a99-633a-4f1c-9514-0545f5d3a620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:08.307833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-25e54a99-633a-4f1c-9514-0545f5d3a620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:08.459808 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e54a99-633a-4f1c-9514-0545f5d3a620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:08.461234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e54a99-633a-4f1c-9514-0545f5d3a620 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:08.483453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 736/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:10.681959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f3920-88b6-4a54-bb6e-f4ab3ef11c41 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:10.682595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f3920-88b6-4a54-bb6e-f4ab3ef11c41 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:10.682595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f3920-88b6-4a54-bb6e-f4ab3ef11c41 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:10.683884 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:10.690226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc0a7a-9778-46c2-bbbb-af199ac304c5 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:10.690913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc0a7a-9778-46c2-bbbb-af199ac304c5 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:10.690913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc0a7a-9778-46c2-bbbb-af199ac304c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:10.767782 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-9ecc0a7a-9778-46c2-bbbb-af199ac304c5 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:10.769128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9ecc0a7a-9778-46c2-bbbb-af199ac304c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:10.779742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:10.896320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:36:11.194567 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f3920-88b6-4a54-bb6e-f4ab3ef11c41 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:11.196214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fa3f3920-88b6-4a54-bb6e-f4ab3ef11c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:11.334341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f3920-88b6-4a54-bb6e-f4ab3ef11c41 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:11.408293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:11.431601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25c16b-a655-4ab9-87e3-7208829089dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:11.432372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25c16b-a655-4ab9-87e3-7208829089dd service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:11.432759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25c16b-a655-4ab9-87e3-7208829089dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:11.433131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25c16b-a655-4ab9-87e3-7208829089dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:11.435223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3f25c16b-a655-4ab9-87e3-7208829089dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:11.578260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25c16b-a655-4ab9-87e3-7208829089dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:11.579797 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25c16b-a655-4ab9-87e3-7208829089dd service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:11.603069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 724/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:13.708173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2ec4a-5233-41f7-baa9-03b5e81b55e7 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:13.708780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2ec4a-5233-41f7-baa9-03b5e81b55e7 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:13.708780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2ec4a-5233-41f7-baa9-03b5e81b55e7 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:13.710175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:13.717538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22c66f-d482-4400-a8f5-918b65c8645b None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:13.718135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22c66f-d482-4400-a8f5-918b65c8645b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:13.718135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22c66f-d482-4400-a8f5-918b65c8645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:13.802294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-0c22c66f-d482-4400-a8f5-918b65c8645b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:13.803994 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0c22c66f-d482-4400-a8f5-918b65c8645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:13.856850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:13.930727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:36:14.234611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2ec4a-5233-41f7-baa9-03b5e81b55e7 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:14.236184 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-23f2ec4a-5233-41f7-baa9-03b5e81b55e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:14.414239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2ec4a-5233-41f7-baa9-03b5e81b55e7 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:14.465932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:14.505969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14b32b-fdf3-4389-ad74-9443310cd244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:14.507536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14b32b-fdf3-4389-ad74-9443310cd244 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:14.507960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14b32b-fdf3-4389-ad74-9443310cd244 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:14.508239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14b32b-fdf3-4389-ad74-9443310cd244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:14.510086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ba14b32b-fdf3-4389-ad74-9443310cd244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:14.652745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14b32b-fdf3-4389-ad74-9443310cd244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:14.654242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14b32b-fdf3-4389-ad74-9443310cd244 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:14.678018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 739/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:36:16.884815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487231fd-d020-49f5-aae0-bf5f846d5c08 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:16.885776 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487231fd-d020-49f5-aae0-bf5f846d5c08 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:16.885956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487231fd-d020-49f5-aae0-bf5f846d5c08 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:16.888416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:36:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:16.899868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fdce1-a684-4d01-8a21-a6bcf76c79df None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:16.900748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fdce1-a684-4d01-8a21-a6bcf76c79df None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:16.900933 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fdce1-a684-4d01-8a21-a6bcf76c79df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:17.012668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-f17fdce1-a684-4d01-8a21-a6bcf76c79df None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:17.014031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f17fdce1-a684-4d01-8a21-a6bcf76c79df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:17.044394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:17.162941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:36:17.478807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487231fd-d020-49f5-aae0-bf5f846d5c08 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:17.480552 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-487231fd-d020-49f5-aae0-bf5f846d5c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:17.635636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487231fd-d020-49f5-aae0-bf5f846d5c08 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:17.754968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:17.762976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a17ce1-3902-4e50-aa02-1dcfa6493436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:17.763596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a17ce1-3902-4e50-aa02-1dcfa6493436 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:17.763874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a17ce1-3902-4e50-aa02-1dcfa6493436 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:17.764300 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a17ce1-3902-4e50-aa02-1dcfa6493436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:17.766121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-26a17ce1-3902-4e50-aa02-1dcfa6493436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:17.893656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a17ce1-3902-4e50-aa02-1dcfa6493436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:17.895407 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a17ce1-3902-4e50-aa02-1dcfa6493436 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:17.917619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 727/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:20.008082 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75887f56-0022-42ef-9f66-07eccbcca71f None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:20.008860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75887f56-0022-42ef-9f66-07eccbcca71f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:20.008860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75887f56-0022-42ef-9f66-07eccbcca71f None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:20.010105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:20.019190 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f64b8-afe5-4b0b-a20e-271c368c3fdd None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:20.020135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f64b8-afe5-4b0b-a20e-271c368c3fdd None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:20.020135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f64b8-afe5-4b0b-a20e-271c368c3fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:20.107380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-d66f64b8-afe5-4b0b-a20e-271c368c3fdd None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:20.108747 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d66f64b8-afe5-4b0b-a20e-271c368c3fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:20.185465 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:20.278243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:36:20.567238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75887f56-0022-42ef-9f66-07eccbcca71f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:20.589450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-75887f56-0022-42ef-9f66-07eccbcca71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:20.695443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75887f56-0022-42ef-9f66-07eccbcca71f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:20.751131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:20.784687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa352c0-15f5-47c6-b019-293ab2f7b14f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:20.785526 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa352c0-15f5-47c6-b019-293ab2f7b14f service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:20.785768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa352c0-15f5-47c6-b019-293ab2f7b14f service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:20.785943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa352c0-15f5-47c6-b019-293ab2f7b14f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:20.788121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5fa352c0-15f5-47c6-b019-293ab2f7b14f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:20.918258 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa352c0-15f5-47c6-b019-293ab2f7b14f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:20.919864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa352c0-15f5-47c6-b019-293ab2f7b14f service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:20.942046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 742/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:30.273860 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=22 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:30.939328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=66 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:42.819484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1500618-088f-4271-80fe-49fbfc6b21c2 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:42.820078 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1500618-088f-4271-80fe-49fbfc6b21c2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:42.820078 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1500618-088f-4271-80fe-49fbfc6b21c2 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:42.821600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 729/1471] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:42.827794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2d50-655d-4710-a5ab-3ce71737fae0 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:42.828435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2d50-655d-4710-a5ab-3ce71737fae0 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:42.828435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec2d50-655d-4710-a5ab-3ce71737fae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:43.035599 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-62ec2d50-655d-4710-a5ab-3ce71737fae0 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:43.036846 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-62ec2d50-655d-4710-a5ab-3ce71737fae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:43.153359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 743/1472] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:36:43.478919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb1c42-3bbf-46e1-b079-4a148b14b105 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:43.479237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb1c42-3bbf-46e1-b079-4a148b14b105 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:43.479510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb1c42-3bbf-46e1-b079-4a148b14b105 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:43.480879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 730/1473] 10.222.0.48 () {54 vars in 967 bytes} [Thu Sep 1 05:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:43.487776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33989990-47d5-4fdb-b5f9-3490bfc9e2e6 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:43.488257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33989990-47d5-4fdb-b5f9-3490bfc9e2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:43.488747 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33989990-47d5-4fdb-b5f9-3490bfc9e2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:43.631950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-33989990-47d5-4fdb-b5f9-3490bfc9e2e6 None None] MFA Rules not processed for user `c596e424ab8e4637bae1721488c9fcc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:43.633224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-33989990-47d5-4fdb-b5f9-3490bfc9e2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:43.656692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:43.732421 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 744/1474] 10.222.0.48 () {58 vars in 1064 bytes} [Thu Sep 1 05:36:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:36:43.741329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb1c42-3bbf-46e1-b079-4a148b14b105 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:43.743093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f8fb1c42-3bbf-46e1-b079-4a148b14b105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:43.871228 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb1c42-3bbf-46e1-b079-4a148b14b105 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:43.970380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77823e6-df9b-46b1-986d-2b32b646a2fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c596e424ab8e4637bae1721488c9fcc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:43.975927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77823e6-df9b-46b1-986d-2b32b646a2fa service glance] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:43.975927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77823e6-df9b-46b1-986d-2b32b646a2fa service glance] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:43.975927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77823e6-df9b-46b1-986d-2b32b646a2fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:43.975927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b77823e6-df9b-46b1-986d-2b32b646a2fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:44.043413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:44.098095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77823e6-df9b-46b1-986d-2b32b646a2fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:44.113345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77823e6-df9b-46b1-986d-2b32b646a2fa service glance] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:44.120916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 731/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:46.387214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975c9f8-e21c-4952-bc3d-4c7d8ebfd876 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:46.387797 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975c9f8-e21c-4952-bc3d-4c7d8ebfd876 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:46.387797 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975c9f8-e21c-4952-bc3d-4c7d8ebfd876 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:46.389115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 745/1476] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:46.396455 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e6a72-596d-4af8-968a-3acecf2dcbd5 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:46.397025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e6a72-596d-4af8-968a-3acecf2dcbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:46.397025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e6a72-596d-4af8-968a-3acecf2dcbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:46.472223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-6d4e6a72-596d-4af8-968a-3acecf2dcbd5 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:46.473531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6d4e6a72-596d-4af8-968a-3acecf2dcbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:46.608708 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 732/1477] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:36:46.894625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975c9f8-e21c-4952-bc3d-4c7d8ebfd876 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:46.896175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3975c9f8-e21c-4952-bc3d-4c7d8ebfd876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:47.030825 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975c9f8-e21c-4952-bc3d-4c7d8ebfd876 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:47.090257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:47.160226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d755a-6e17-4f37-bb46-dba30d222ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:47.161251 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d755a-6e17-4f37-bb46-dba30d222ffc admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:47.161787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d755a-6e17-4f37-bb46-dba30d222ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:47.162266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d755a-6e17-4f37-bb46-dba30d222ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:47.163379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d755a-6e17-4f37-bb46-dba30d222ffc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:47.166850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: WARNING py.warnings [None req-088d755a-6e17-4f37-bb46-dba30d222ffc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:36:47.166850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: warnings.warn(msg) Sep 01 05:36:47.166850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: Sep 01 05:36:47.169137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d755a-6e17-4f37-bb46-dba30d222ffc admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:47.207846 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 746/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Sep 1 05:36:46 2022] GET /identity/v3/projects => generated 2553 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:36:49.231033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555c509-d095-4180-a0e4-d709cc1f2326 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:49.231668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555c509-d095-4180-a0e4-d709cc1f2326 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:49.231668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555c509-d095-4180-a0e4-d709cc1f2326 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:49.232973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 733/1479] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:49.240516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5717-0420-4278-b666-b3bee3e10a53 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:49.241303 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5717-0420-4278-b666-b3bee3e10a53 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:49.241303 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5717-0420-4278-b666-b3bee3e10a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:49.334355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-024c5717-0420-4278-b666-b3bee3e10a53 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:49.335637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-024c5717-0420-4278-b666-b3bee3e10a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:49.448465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 747/1480] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:36:49.760231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555c509-d095-4180-a0e4-d709cc1f2326 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:49.762025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f555c509-d095-4180-a0e4-d709cc1f2326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:49.774588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:49.983021 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555c509-d095-4180-a0e4-d709cc1f2326 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:50.085072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:50.128724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f702a3f1-bf2a-4e2b-ad15-eb0eb4321ec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:50.129341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702a3f1-bf2a-4e2b-ad15-eb0eb4321ec5 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:50.129649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702a3f1-bf2a-4e2b-ad15-eb0eb4321ec5 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:50.129926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f702a3f1-bf2a-4e2b-ad15-eb0eb4321ec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:50.131685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f702a3f1-bf2a-4e2b-ad15-eb0eb4321ec5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:50.252247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702a3f1-bf2a-4e2b-ad15-eb0eb4321ec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:50.254041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f702a3f1-bf2a-4e2b-ad15-eb0eb4321ec5 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:50.277076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 734/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:52.616976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2382-199c-4bf4-87ce-1d921b096679 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:52.617606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2382-199c-4bf4-87ce-1d921b096679 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:52.617606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2382-199c-4bf4-87ce-1d921b096679 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:52.618922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 748/1482] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:52.625048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b899c-131d-4400-824e-cec9bf482274 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:52.625586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b899c-131d-4400-824e-cec9bf482274 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:52.625701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2b899c-131d-4400-824e-cec9bf482274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:52.711473 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-9f2b899c-131d-4400-824e-cec9bf482274 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:52.712730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9f2b899c-131d-4400-824e-cec9bf482274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:52.786764 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:52.842595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 735/1483] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:36:53.137895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc2382-199c-4bf4-87ce-1d921b096679 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:53.139443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-85bc2382-199c-4bf4-87ce-1d921b096679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:53.169314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:53.262449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc2382-199c-4bf4-87ce-1d921b096679 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:53.356642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5fb88-f1f3-42d8-b0a3-4b4dd907de9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:53.357339 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5fb88-f1f3-42d8-b0a3-4b4dd907de9a service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:53.357684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5fb88-f1f3-42d8-b0a3-4b4dd907de9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:53.358008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5fb88-f1f3-42d8-b0a3-4b4dd907de9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:53.360030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-aea5fb88-f1f3-42d8-b0a3-4b4dd907de9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:53.450587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:53.491575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5fb88-f1f3-42d8-b0a3-4b4dd907de9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:53.493422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5fb88-f1f3-42d8-b0a3-4b4dd907de9a service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:53.514351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 749/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:55.598545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e8c15-c0b8-434f-8e3a-89bd47e8dbbb None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:55.599411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e8c15-c0b8-434f-8e3a-89bd47e8dbbb None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:55.599583 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e8c15-c0b8-434f-8e3a-89bd47e8dbbb None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:55.600973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 736/1485] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:55.608733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80aec-4cb5-4935-952f-9adff45987aa None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:55.609296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80aec-4cb5-4935-952f-9adff45987aa None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:55.609296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef80aec-4cb5-4935-952f-9adff45987aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:55.680047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-7ef80aec-4cb5-4935-952f-9adff45987aa None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:55.681272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7ef80aec-4cb5-4935-952f-9adff45987aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:55.789462 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 750/1486] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:36:56.104942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e8c15-c0b8-434f-8e3a-89bd47e8dbbb None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:56.106604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-909e8c15-c0b8-434f-8e3a-89bd47e8dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:56.231904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e8c15-c0b8-434f-8e3a-89bd47e8dbbb None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:56.315788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:56.318220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68e6e2-8249-41aa-a781-a290bc791863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:56.319012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68e6e2-8249-41aa-a781-a290bc791863 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:56.319012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68e6e2-8249-41aa-a781-a290bc791863 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:56.319256 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68e6e2-8249-41aa-a781-a290bc791863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:56.321000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8f68e6e2-8249-41aa-a781-a290bc791863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:56.450511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68e6e2-8249-41aa-a781-a290bc791863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:56.451980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68e6e2-8249-41aa-a781-a290bc791863 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:56.474216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 737/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:36:58.723583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eafd6-caf1-400f-b7ed-1b078e81812c None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:58.724280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eafd6-caf1-400f-b7ed-1b078e81812c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:58.724280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eafd6-caf1-400f-b7ed-1b078e81812c None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:58.725551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 751/1488] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:36:58.731976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec3f92-46ce-4ba0-9b43-2aabed35707d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:58.732815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec3f92-46ce-4ba0-9b43-2aabed35707d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:58.733008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec3f92-46ce-4ba0-9b43-2aabed35707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:58.828888 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-96ec3f92-46ce-4ba0-9b43-2aabed35707d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:36:58.831740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-96ec3f92-46ce-4ba0-9b43-2aabed35707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:58.935325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:59.013910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 738/1489] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:36:59.366741 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eafd6-caf1-400f-b7ed-1b078e81812c None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:36:59.368321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b89eafd6-caf1-400f-b7ed-1b078e81812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:59.412304 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:59.489053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eafd6-caf1-400f-b7ed-1b078e81812c None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:36:59.583740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cca79-bf78-4b7e-9d5a-ba9279b032fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:36:59.584371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cca79-bf78-4b7e-9d5a-ba9279b032fa service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:36:59.585197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cca79-bf78-4b7e-9d5a-ba9279b032fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:36:59.585197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cca79-bf78-4b7e-9d5a-ba9279b032fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:36:59.586728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-078cca79-bf78-4b7e-9d5a-ba9279b032fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:36:59.695404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:36:59.732083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cca79-bf78-4b7e-9d5a-ba9279b032fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:36:59.734067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078cca79-bf78-4b7e-9d5a-ba9279b032fa service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:36:59.756087 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 752/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:37:02.549551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530962-d9a4-4a3e-b488-f8930680c9e4 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:37:02.550125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530962-d9a4-4a3e-b488-f8930680c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:37:02.550125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01530962-d9a4-4a3e-b488-f8930680c9e4 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:37:02.551441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 739/1491] 10.222.0.48 () {54 vars in 927 bytes} [Thu Sep 1 05:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:37:02.557296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488089-e99c-4e9c-aa7f-fae4b4d9719d None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:37:02.557912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488089-e99c-4e9c-aa7f-fae4b4d9719d None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:37:02.557912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16488089-e99c-4e9c-aa7f-fae4b4d9719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:37:02.652830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-16488089-e99c-4e9c-aa7f-fae4b4d9719d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:37:02.654107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-16488089-e99c-4e9c-aa7f-fae4b4d9719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:37:02.766491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 753/1492] 10.222.0.48 () {58 vars in 1024 bytes} [Thu Sep 1 05:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:37:03.079097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01530962-d9a4-4a3e-b488-f8930680c9e4 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:37:03.081613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-01530962-d9a4-4a3e-b488-f8930680c9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:37:03.213317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01530962-d9a4-4a3e-b488-f8930680c9e4 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:37:03.305747 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae8772-4adf-4a1f-ac24-27a9e18f892f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:37:03.306875 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae8772-4adf-4a1f-ac24-27a9e18f892f service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:37:03.307359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae8772-4adf-4a1f-ac24-27a9e18f892f service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:37:03.307868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae8772-4adf-4a1f-ac24-27a9e18f892f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:37:03.311060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-beae8772-4adf-4a1f-ac24-27a9e18f892f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:37:03.328660 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:03.458108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae8772-4adf-4a1f-ac24-27a9e18f892f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:37:03.459607 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae8772-4adf-4a1f-ac24-27a9e18f892f service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:37:03.480897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 740/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:37:12.764569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=82 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:37:13.478206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=50 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:34.869502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b5478-b7cb-418a-8a0f-9c0e9198148d None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:34.870193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b5478-b7cb-418a-8a0f-9c0e9198148d None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:34.870193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b5478-b7cb-418a-8a0f-9c0e9198148d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:34.976206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-6c1b5478-b7cb-418a-8a0f-9c0e9198148d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:38:34.977682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6c1b5478-b7cb-418a-8a0f-9c0e9198148d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:35.107038 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 754/1494] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:38:35.116018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09768e6-2cf7-4e79-a7df-b20d35200487 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:35.116770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09768e6-2cf7-4e79-a7df-b20d35200487 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:35.116770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09768e6-2cf7-4e79-a7df-b20d35200487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:35.139315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-f09768e6-2cf7-4e79-a7df-b20d35200487 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:38:35.142096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f09768e6-2cf7-4e79-a7df-b20d35200487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:35.150537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 741/1495] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:38:35.155503 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b5478-b7cb-418a-8a0f-9c0e9198148d None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:35.166058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b5478-b7cb-418a-8a0f-9c0e9198148d None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:35.171279 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74377521-b531-4410-96e5-ece54a1cb51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:35.172404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74377521-b531-4410-96e5-ece54a1cb51a admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:35.172687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74377521-b531-4410-96e5-ece54a1cb51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:35.172960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74377521-b531-4410-96e5-ece54a1cb51a admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:35.173664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74377521-b531-4410-96e5-ece54a1cb51a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:38:35.173970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74377521-b531-4410-96e5-ece54a1cb51a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:35.175010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: WARNING py.warnings [None req-74377521-b531-4410-96e5-ece54a1cb51a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:38:35.175010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: warnings.warn(msg) Sep 01 05:38:35.175010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: Sep 01 05:38:35.175926 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74377521-b531-4410-96e5-ece54a1cb51a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:35.190679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 755/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:38:35.199524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09768e6-2cf7-4e79-a7df-b20d35200487 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:35.210478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09768e6-2cf7-4e79-a7df-b20d35200487 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:35.215539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233171f-5c9b-493d-8995-4f389ed6c2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:35.216428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233171f-5c9b-493d-8995-4f389ed6c2ed admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:35.216691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233171f-5c9b-493d-8995-4f389ed6c2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:35.216957 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233171f-5c9b-493d-8995-4f389ed6c2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:35.217646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233171f-5c9b-493d-8995-4f389ed6c2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:35.219557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: WARNING py.warnings [None req-9233171f-5c9b-493d-8995-4f389ed6c2ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:38:35.219557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: warnings.warn(msg) Sep 01 05:38:35.219557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: Sep 01 05:38:35.220774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233171f-5c9b-493d-8995-4f389ed6c2ed admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:35.398473 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 742/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:38:35 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:38:35.403187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74377521-b531-4410-96e5-ece54a1cb51a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:35.415132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74377521-b531-4410-96e5-ece54a1cb51a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:35.476361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:35.483568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7286617-5084-4752-9da8-46adb0af38d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:35.491024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7286617-5084-4752-9da8-46adb0af38d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:35.491024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7286617-5084-4752-9da8-46adb0af38d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:35.491024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7286617-5084-4752-9da8-46adb0af38d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:35.491024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7286617-5084-4752-9da8-46adb0af38d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:35.491024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: WARNING py.warnings [None req-b7286617-5084-4752-9da8-46adb0af38d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:38:35.491024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: warnings.warn(msg) Sep 01 05:38:35.491024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: Sep 01 05:38:35.491905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7286617-5084-4752-9da8-46adb0af38d2 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:35.613316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 756/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:38:35 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:38:35.618837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233171f-5c9b-493d-8995-4f389ed6c2ed admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:35.632900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233171f-5c9b-493d-8995-4f389ed6c2ed admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:35.635852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff862b6-eb26-4700-bb8d-a4a6c4aa0728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:35.636509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff862b6-eb26-4700-bb8d-a4a6c4aa0728 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:35.636788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff862b6-eb26-4700-bb8d-a4a6c4aa0728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:35.637068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff862b6-eb26-4700-bb8d-a4a6c4aa0728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:35.637773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff862b6-eb26-4700-bb8d-a4a6c4aa0728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:35.638944 dv-cinder-852208-15-smb devstack@keystone.service[81756]: WARNING py.warnings [None req-fff862b6-eb26-4700-bb8d-a4a6c4aa0728 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:38:35.638944 dv-cinder-852208-15-smb devstack@keystone.service[81756]: warnings.warn(msg) Sep 01 05:38:35.638944 dv-cinder-852208-15-smb devstack@keystone.service[81756]: Sep 01 05:38:35.639843 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff862b6-eb26-4700-bb8d-a4a6c4aa0728 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:35.655232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 743/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:38:35.661498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7286617-5084-4752-9da8-46adb0af38d2 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:35.678763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7286617-5084-4752-9da8-46adb0af38d2 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:35.686567 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c652ad-aab1-49be-8181-bfd347f1d75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:35.688093 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c652ad-aab1-49be-8181-bfd347f1d75a admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:35.688586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c652ad-aab1-49be-8181-bfd347f1d75a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:35.689045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c652ad-aab1-49be-8181-bfd347f1d75a admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:35.690227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c652ad-aab1-49be-8181-bfd347f1d75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:35.692074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: WARNING py.warnings [None req-82c652ad-aab1-49be-8181-bfd347f1d75a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:38:35.692074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: warnings.warn(msg) Sep 01 05:38:35.692074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: Sep 01 05:38:35.693758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c652ad-aab1-49be-8181-bfd347f1d75a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:35.720615 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 757/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:38:35.725110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff862b6-eb26-4700-bb8d-a4a6c4aa0728 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:35.736020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff862b6-eb26-4700-bb8d-a4a6c4aa0728 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:35.741188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c4d09-d1dc-4620-a93c-2abd74b5447b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:35.741956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c4d09-d1dc-4620-a93c-2abd74b5447b admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:35.742239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c4d09-d1dc-4620-a93c-2abd74b5447b admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:35.742519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c4d09-d1dc-4620-a93c-2abd74b5447b admin admin] PATH_INFO: `/v3/projects/515eeb799d5e48c389ad0acf93ff9e49/users/d97b619dce8443519ad0306ad046e774/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:35.761008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c4d09-d1dc-4620-a93c-2abd74b5447b admin admin] RBAC: Authorizing `identity:create_grant(project_id=515eeb799d5e48c389ad0acf93ff9e49, user_id=d97b619dce8443519ad0306ad046e774, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:35.762278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: WARNING py.warnings [None req-935c4d09-d1dc-4620-a93c-2abd74b5447b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:38:35.762278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: warnings.warn(msg) Sep 01 05:38:35.762278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: Sep 01 05:38:35.764728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c4d09-d1dc-4620-a93c-2abd74b5447b admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:35.919042 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 744/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:38:35 2022] PUT /identity/v3/projects/515eeb799d5e48c389ad0acf93ff9e49/users/d97b619dce8443519ad0306ad046e774/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:38:35.927909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6484a-b186-4930-8c9d-dff73c79b4e3 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:35.928667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6484a-b186-4930-8c9d-dff73c79b4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:35.928667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6484a-b186-4930-8c9d-dff73c79b4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:35.963023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-b6f6484a-b186-4930-8c9d-dff73c79b4e3 None None] MFA Rules not processed for user `d97b619dce8443519ad0306ad046e774`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:38:35.964289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b6f6484a-b186-4930-8c9d-dff73c79b4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:36.039197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 758/1502] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:38:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:38:36.053032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2d9ec-88a9-446c-9e14-eb93b8aeba20 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:36.053330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2d9ec-88a9-446c-9e14-eb93b8aeba20 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:36.053648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2d9ec-88a9-446c-9e14-eb93b8aeba20 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:36.055097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 745/1503] 10.222.0.48 () {54 vars in 964 bytes} [Thu Sep 1 05:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:38:36.060526 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efad51-e68b-462d-b3d6-d0dafd0ed0d1 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:36.060813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efad51-e68b-462d-b3d6-d0dafd0ed0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:36.061091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efad51-e68b-462d-b3d6-d0dafd0ed0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:36.130126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c1efad51-e68b-462d-b3d6-d0dafd0ed0d1 None None] MFA Rules not processed for user `e03daa3b2e334436ad4d0b2915a61aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:38:36.131370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c1efad51-e68b-462d-b3d6-d0dafd0ed0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:36.218379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 759/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Sep 1 05:38:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:38:36.227211 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2d9ec-88a9-446c-9e14-eb93b8aeba20 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:36.239786 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2d9ec-88a9-446c-9e14-eb93b8aeba20 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:36.243619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e704-10dc-484e-82b2-3685d8fdc04d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:36.244281 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e704-10dc-484e-82b2-3685d8fdc04d service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:36.244558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e704-10dc-484e-82b2-3685d8fdc04d service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:36.244833 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e478e704-10dc-484e-82b2-3685d8fdc04d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:36.255346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478e704-10dc-484e-82b2-3685d8fdc04d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:36.257012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e478e704-10dc-484e-82b2-3685d8fdc04d service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:36.269194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 746/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:38:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:38:36.329796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abfd09-025e-474d-ac33-018aee7e0206 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:36.330211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abfd09-025e-474d-ac33-018aee7e0206 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:36.330607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80abfd09-025e-474d-ac33-018aee7e0206 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:36.332562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 760/1506] 10.222.0.48 () {52 vars in 830 bytes} [Thu Sep 1 05:38:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:38:36.338442 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e704-10dc-484e-82b2-3685d8fdc04d service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:36.418833 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e478e704-10dc-484e-82b2-3685d8fdc04d service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:36.425477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:36.426162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:36.426446 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:36.426723 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] PATH_INFO: `/v3/users/d97b619dce8443519ad0306ad046e774` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:36.428249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97b619dce8443519ad0306ad046e774)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:36.429938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: WARNING py.warnings [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:38:36.429938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: warnings.warn(msg) Sep 01 05:38:36.429938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: Sep 01 05:38:36.430603 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:36.774598 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97b619dce8443519ad0306ad046e774'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:36.793249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97b619dce8443519ad0306ad046e774'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:36.893226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97b619dce8443519ad0306ad046e774'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:36.893895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97b619dce8443519ad0306ad046e774'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:36.894625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97b619dce8443519ad0306ad046e774'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:36.919151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:36.931492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 747/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:38:36 2022] DELETE /identity/v3/users/d97b619dce8443519ad0306ad046e774 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:38:36.936951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1e463-2edd-430e-a11a-755a18b2bda4 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:36.938287 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1e463-2edd-430e-a11a-755a18b2bda4 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:36.938287 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1e463-2edd-430e-a11a-755a18b2bda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:36.958147 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-40f1e463-2edd-430e-a11a-755a18b2bda4 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:38:36.959460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-40f1e463-2edd-430e-a11a-755a18b2bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:36.972229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:37.030406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 761/1508] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:38:37.041171 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:37.043071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:37.130762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aa776-a781-40fe-b4e5-11ecf94c574b admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:37.134558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89f1fb-8d19-4aed-abff-a7700a6f42a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:37.135243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89f1fb-8d19-4aed-abff-a7700a6f42a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:37.135549 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89f1fb-8d19-4aed-abff-a7700a6f42a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:37.135809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89f1fb-8d19-4aed-abff-a7700a6f42a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:37.146864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89f1fb-8d19-4aed-abff-a7700a6f42a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:37.148351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89f1fb-8d19-4aed-abff-a7700a6f42a0 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:37.159572 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 748/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:38:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:38:37.798550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1e463-2edd-430e-a11a-755a18b2bda4 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:38:37.800433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-40f1e463-2edd-430e-a11a-755a18b2bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:38:37.816582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1e463-2edd-430e-a11a-755a18b2bda4 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:38:37.823721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:38:37.824279 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:38:37.824584 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:38:37.824916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] PATH_INFO: `/v3/projects/515eeb799d5e48c389ad0acf93ff9e49` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:38:37.826312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=515eeb799d5e48c389ad0acf93ff9e49)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:38:37.828515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: WARNING py.warnings [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:38:37.828515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: warnings.warn(msg) Sep 01 05:38:37.828515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: Sep 01 05:38:37.830963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:38:38.116086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '515eeb799d5e48c389ad0acf93ff9e49', 'request_id': 'req-19b31bed-1683-46e9-87a0-73a05cc695a3'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.194970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '515eeb799d5e48c389ad0acf93ff9e49', 'request_id': 'req-19b31bed-1683-46e9-87a0-73a05cc695a3'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.203889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '515eeb799d5e48c389ad0acf93ff9e49', 'request_id': 'req-19b31bed-1683-46e9-87a0-73a05cc695a3'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.225183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] The token cache is being invalidate because project 515eeb799d5e48c389ad0acf93ff9e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:38:38.225515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.226319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-19b31bed-1683-46e9-87a0-73a05cc695a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:38:38.227908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 762/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:38:37 2022] DELETE /identity/v3/projects/515eeb799d5e48c389ad0acf93ff9e49 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:38:47.161002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:38:48.221720 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:14.470033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508df7c-0afd-45d9-a276-d511db39f498 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:14.477659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508df7c-0afd-45d9-a276-d511db39f498 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:14.477659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508df7c-0afd-45d9-a276-d511db39f498 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:14.477659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:40:14.477970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ddf0e-b968-4ca8-b8b4-eeec6984283c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:14.477970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ddf0e-b968-4ca8-b8b4-eeec6984283c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:14.477970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ddf0e-b968-4ca8-b8b4-eeec6984283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:14.499788 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-296ddf0e-b968-4ca8-b8b4-eeec6984283c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:40:14.501052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-296ddf0e-b968-4ca8-b8b4-eeec6984283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:14.571421 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:40:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:40:14.731627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508df7c-0afd-45d9-a276-d511db39f498 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:40:14.734189 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8508df7c-0afd-45d9-a276-d511db39f498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:14.846722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508df7c-0afd-45d9-a276-d511db39f498 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:40:14.852526 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94e72a-68f6-4de6-8a27-ad70b3d5f24f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:40:14.853137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e72a-68f6-4de6-8a27-ad70b3d5f24f service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:14.853453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e72a-68f6-4de6-8a27-ad70b3d5f24f service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:14.853733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e72a-68f6-4de6-8a27-ad70b3d5f24f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:14.863532 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94e72a-68f6-4de6-8a27-ad70b3d5f24f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:40:14.865132 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94e72a-68f6-4de6-8a27-ad70b3d5f24f service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:40:14.875220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 750/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:40:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:40:15.739720 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19762058-735e-4e01-ac2e-3d00b9726d2f None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:15.740351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19762058-735e-4e01-ac2e-3d00b9726d2f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:15.740351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19762058-735e-4e01-ac2e-3d00b9726d2f None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:15.741685 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:40:15.747372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736e6eb-77ce-4bbe-b5a8-91400fff928d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:15.748477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736e6eb-77ce-4bbe-b5a8-91400fff928d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:15.748477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736e6eb-77ce-4bbe-b5a8-91400fff928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:15.769466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-8736e6eb-77ce-4bbe-b5a8-91400fff928d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:40:15.770758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8736e6eb-77ce-4bbe-b5a8-91400fff928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:15.778749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:40:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:40:15.932461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19762058-735e-4e01-ac2e-3d00b9726d2f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:40:15.947765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19762058-735e-4e01-ac2e-3d00b9726d2f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:40:15.953637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227a6f9-58ac-40bb-81e8-258497f67c5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:40:15.954253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227a6f9-58ac-40bb-81e8-258497f67c5d service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:15.954528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227a6f9-58ac-40bb-81e8-258497f67c5d service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:15.954796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227a6f9-58ac-40bb-81e8-258497f67c5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:15.964090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227a6f9-58ac-40bb-81e8-258497f67c5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:40:15.965750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227a6f9-58ac-40bb-81e8-258497f67c5d service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:40:15.976681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 765/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:40:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:40:16.126054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a926-fb26-478c-a947-0b17ed23dfb7 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:16.126342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a926-fb26-478c-a947-0b17ed23dfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:16.126619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a926-fb26-478c-a947-0b17ed23dfb7 None None] PATH_INFO: `/v3` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:16.128217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 752/1517] 10.222.0.61 () {54 vars in 925 bytes} [Thu Sep 1 05:40:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:40:16.135226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd574a58-ce7d-4d40-af15-1a3c8d707ec3 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:16.135649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd574a58-ce7d-4d40-af15-1a3c8d707ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:16.135901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd574a58-ce7d-4d40-af15-1a3c8d707ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:16.193044 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-fd574a58-ce7d-4d40-af15-1a3c8d707ec3 None None] MFA Rules not processed for user `055823f7760f485eb91266a0d63db602`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:40:16.194361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-fd574a58-ce7d-4d40-af15-1a3c8d707ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:16.285985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 766/1518] 10.222.0.61 () {58 vars in 1015 bytes} [Thu Sep 1 05:40:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:40:25.602741 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f0e5d-9426-46c4-b8b7-0b44cc5e507c None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:25.603358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f0e5d-9426-46c4-b8b7-0b44cc5e507c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:25.603358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f0e5d-9426-46c4-b8b7-0b44cc5e507c None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:25.604641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 753/1519] 10.222.0.48 () {54 vars in 961 bytes} [Thu Sep 1 05:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:40:25.612244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edc0fa-97af-4de4-8b25-6da23f4e1770 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:25.612856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edc0fa-97af-4de4-8b25-6da23f4e1770 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:25.613223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edc0fa-97af-4de4-8b25-6da23f4e1770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:25.637085 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-79edc0fa-97af-4de4-8b25-6da23f4e1770 None None] MFA Rules not processed for user `055823f7760f485eb91266a0d63db602`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:40:25.638454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-79edc0fa-97af-4de4-8b25-6da23f4e1770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:25.647426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 767/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Sep 1 05:40:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:40:25.656252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f0e5d-9426-46c4-b8b7-0b44cc5e507c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:40:25.672260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f0e5d-9426-46c4-b8b7-0b44cc5e507c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:40:25.681867 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caec26a-4f29-427c-ad73-91db9ee13503 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055823f7760f485eb91266a0d63db602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:40:25.682477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec26a-4f29-427c-ad73-91db9ee13503 service placement] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:25.682753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec26a-4f29-427c-ad73-91db9ee13503 service placement] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:25.683031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caec26a-4f29-427c-ad73-91db9ee13503 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:25.692898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caec26a-4f29-427c-ad73-91db9ee13503 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:40:25.694550 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caec26a-4f29-427c-ad73-91db9ee13503 service placement] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:40:25.705206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 754/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:40:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:40:27.271889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ae35-680c-4fa8-a99a-d15ff1e5333d None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:27.272452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ae35-680c-4fa8-a99a-d15ff1e5333d None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:27.272452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6ae35-680c-4fa8-a99a-d15ff1e5333d None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:27.273878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:40:27.279609 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d363f31-6727-4925-84ea-a84e26a31c56 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:27.280206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d363f31-6727-4925-84ea-a84e26a31c56 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:27.280206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d363f31-6727-4925-84ea-a84e26a31c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:27.300956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-9d363f31-6727-4925-84ea-a84e26a31c56 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:40:27.302237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9d363f31-6727-4925-84ea-a84e26a31c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:27.310502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:40:27.469633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6ae35-680c-4fa8-a99a-d15ff1e5333d None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:40:27.484635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6ae35-680c-4fa8-a99a-d15ff1e5333d None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:40:27.490061 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a4062-eae4-4315-970d-3afa59315a32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:40:27.490710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a4062-eae4-4315-970d-3afa59315a32 service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:27.490985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a4062-eae4-4315-970d-3afa59315a32 service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:27.491340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a4062-eae4-4315-970d-3afa59315a32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:27.501330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a4062-eae4-4315-970d-3afa59315a32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:40:27.502984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a4062-eae4-4315-970d-3afa59315a32 service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:40:27.514336 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 769/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:40:28.360977 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6920a-1b58-45d5-b831-1c96847abb16 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:28.361568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6920a-1b58-45d5-b831-1c96847abb16 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:28.361568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6920a-1b58-45d5-b831-1c96847abb16 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:28.362902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:40:28.367944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c36dd-5fb2-4541-b892-4de49f26d93f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:28.368401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c36dd-5fb2-4541-b892-4de49f26d93f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:28.368623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c36dd-5fb2-4541-b892-4de49f26d93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:28.390147 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-009c36dd-5fb2-4541-b892-4de49f26d93f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:40:28.391424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-009c36dd-5fb2-4541-b892-4de49f26d93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:28.399465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:40:28.555892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6920a-1b58-45d5-b831-1c96847abb16 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:40:28.572695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6920a-1b58-45d5-b831-1c96847abb16 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:40:28.579116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e69fd-0033-4aec-8eaa-019396639bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:40:28.579763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e69fd-0033-4aec-8eaa-019396639bfb service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:28.580050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e69fd-0033-4aec-8eaa-019396639bfb service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:28.580369 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e69fd-0033-4aec-8eaa-019396639bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:28.589760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e69fd-0033-4aec-8eaa-019396639bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:40:28.591407 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e69fd-0033-4aec-8eaa-019396639bfb service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:40:28.602517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 757/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:40:32.558131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda37f5-3cc0-4da6-a0b9-c59db052bf1b None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:32.558827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda37f5-3cc0-4da6-a0b9-c59db052bf1b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:32.558827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda37f5-3cc0-4da6-a0b9-c59db052bf1b None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:32.560795 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:40:32.566558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f2742-b538-4757-8896-0f4a7213e916 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:32.567110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f2742-b538-4757-8896-0f4a7213e916 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:32.567262 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f2742-b538-4757-8896-0f4a7213e916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:32.589869 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ee3f2742-b538-4757-8896-0f4a7213e916 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:40:32.591113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ee3f2742-b538-4757-8896-0f4a7213e916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:32.599267 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:40:32.892416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda37f5-3cc0-4da6-a0b9-c59db052bf1b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:40:32.894260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6cda37f5-3cc0-4da6-a0b9-c59db052bf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:32.926651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:32.958954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda37f5-3cc0-4da6-a0b9-c59db052bf1b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:40:32.980675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501757c-9a8b-4005-b660-ea3cd427e328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:40:32.980675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501757c-9a8b-4005-b660-ea3cd427e328 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:32.980675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501757c-9a8b-4005-b660-ea3cd427e328 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:32.980675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501757c-9a8b-4005-b660-ea3cd427e328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:32.981042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501757c-9a8b-4005-b660-ea3cd427e328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:40:32.981042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501757c-9a8b-4005-b660-ea3cd427e328 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:40:32.986489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 772/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:40:35.036533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc67300-000c-48a0-8277-9e1dd431b22e None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:35.037103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc67300-000c-48a0-8277-9e1dd431b22e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:35.037103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc67300-000c-48a0-8277-9e1dd431b22e None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:35.038448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:40:35.043901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c235a0-cad2-4105-bfaf-3b35c98f483c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:35.044486 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c235a0-cad2-4105-bfaf-3b35c98f483c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:35.044486 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c235a0-cad2-4105-bfaf-3b35c98f483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:35.068565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-e0c235a0-cad2-4105-bfaf-3b35c98f483c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:40:35.069905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e0c235a0-cad2-4105-bfaf-3b35c98f483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:35.078990 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:40:35.373648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc67300-000c-48a0-8277-9e1dd431b22e None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:40:35.385230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc67300-000c-48a0-8277-9e1dd431b22e None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:40:35.388869 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4bf20-6b68-45f1-b872-a1f252aa295f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:40:35.389504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4bf20-6b68-45f1-b872-a1f252aa295f service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:35.389814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4bf20-6b68-45f1-b872-a1f252aa295f service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:35.390056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4bf20-6b68-45f1-b872-a1f252aa295f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:35.399807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4bf20-6b68-45f1-b872-a1f252aa295f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:40:35.401257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4bf20-6b68-45f1-b872-a1f252aa295f service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:40:35.411625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 760/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:40:39.010796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff0316-ffe3-4450-a0dd-d9739870b872 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:39.011486 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff0316-ffe3-4450-a0dd-d9739870b872 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:39.011486 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff0316-ffe3-4450-a0dd-d9739870b872 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:39.013167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:40:39.019697 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ff67e-641b-46c1-a202-599c175350f9 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:39.020370 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ff67e-641b-46c1-a202-599c175350f9 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:39.020370 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ff67e-641b-46c1-a202-599c175350f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:39.028040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=74 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:39.041965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-089ff67e-641b-46c1-a202-599c175350f9 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:40:39.045489 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-089ff67e-641b-46c1-a202-599c175350f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:39.053132 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:40:39.653175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff0316-ffe3-4450-a0dd-d9739870b872 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:40:39.656053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6dff0316-ffe3-4450-a0dd-d9739870b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:39.726545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff0316-ffe3-4450-a0dd-d9739870b872 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:40:39.730683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824a150-a8a6-4b18-b00b-d7ff4bd8d73f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:40:39.731322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824a150-a8a6-4b18-b00b-d7ff4bd8d73f service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:39.732178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824a150-a8a6-4b18-b00b-d7ff4bd8d73f service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:39.732497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824a150-a8a6-4b18-b00b-d7ff4bd8d73f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:39.742989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824a150-a8a6-4b18-b00b-d7ff4bd8d73f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:40:39.744499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824a150-a8a6-4b18-b00b-d7ff4bd8d73f service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:40:39.756257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 775/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:40:41.788114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096125e-595a-4208-9670-85851a8befdc None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:41.788741 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096125e-595a-4208-9670-85851a8befdc None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:41.788741 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096125e-595a-4208-9670-85851a8befdc None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:41.790041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:40:41.796699 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccff00-3ce6-480e-bc9a-3d3e10bbc768 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:41.797293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccff00-3ce6-480e-bc9a-3d3e10bbc768 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:41.797293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccff00-3ce6-480e-bc9a-3d3e10bbc768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:41.818918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-41ccff00-3ce6-480e-bc9a-3d3e10bbc768 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:40:41.820159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-41ccff00-3ce6-480e-bc9a-3d3e10bbc768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:41.829281 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:40:42.402424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096125e-595a-4208-9670-85851a8befdc None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:40:42.404759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4096125e-595a-4208-9670-85851a8befdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:40:42.417940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096125e-595a-4208-9670-85851a8befdc None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:40:42.425517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32bd53-c3bb-4d87-9339-1a7204cd1a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:40:42.427078 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32bd53-c3bb-4d87-9339-1a7204cd1a73 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:40:42.427357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32bd53-c3bb-4d87-9339-1a7204cd1a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:40:42.427628 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32bd53-c3bb-4d87-9339-1a7204cd1a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:40:42.437990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32bd53-c3bb-4d87-9339-1a7204cd1a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:40:42.469385 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32bd53-c3bb-4d87-9339-1a7204cd1a73 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:40:42.469385 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 763/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:40:51.812511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=47 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:40:52.445294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=8 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:15.952252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aa5e1-e91b-4743-8515-8b681d447e92 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:15.952939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aa5e1-e91b-4743-8515-8b681d447e92 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:15.952939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17aa5e1-e91b-4743-8515-8b681d447e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:15.984298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-d17aa5e1-e91b-4743-8515-8b681d447e92 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:15.986382 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d17aa5e1-e91b-4743-8515-8b681d447e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:15.998291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 777/1540] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:16.008494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61950-2fb0-4c81-b1bf-141f45f3f483 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.009194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61950-2fb0-4c81-b1bf-141f45f3f483 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.009194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61950-2fb0-4c81-b1bf-141f45f3f483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.039584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-4ed61950-2fb0-4c81-b1bf-141f45f3f483 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.041088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4ed61950-2fb0-4c81-b1bf-141f45f3f483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.057552 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 764/1541] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:42:16.063185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17aa5e1-e91b-4743-8515-8b681d447e92 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:16.091853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500706e-c07b-41fe-bcb9-6b3341d96ced None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.092077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500706e-c07b-41fe-bcb9-6b3341d96ced None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.092325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500706e-c07b-41fe-bcb9-6b3341d96ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.093917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17aa5e1-e91b-4743-8515-8b681d447e92 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:16.130642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a4e13-c50b-4856-ac8f-a9d2d4f0d682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:16.131708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a4e13-c50b-4856-ac8f-a9d2d4f0d682 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.132205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a4e13-c50b-4856-ac8f-a9d2d4f0d682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.132682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a4e13-c50b-4856-ac8f-a9d2d4f0d682 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.133943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a4e13-c50b-4856-ac8f-a9d2d4f0d682 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:16.134493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a4e13-c50b-4856-ac8f-a9d2d4f0d682 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:16.143825 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a4e13-c50b-4856-ac8f-a9d2d4f0d682 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:16.162923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-3500706e-c07b-41fe-bcb9-6b3341d96ced None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.164417 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3500706e-c07b-41fe-bcb9-6b3341d96ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.169491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 778/1542] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:16.178320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a4e13-c50b-4856-ac8f-a9d2d4f0d682 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:16.182984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 765/1543] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:42:16.196212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649dab0-5d35-4a81-a84d-cb7d7f095875 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.196569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649dab0-5d35-4a81-a84d-cb7d7f095875 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.196954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649dab0-5d35-4a81-a84d-cb7d7f095875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.202036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a4e13-c50b-4856-ac8f-a9d2d4f0d682 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:16.219291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6d70d-b35c-4e9d-aac8-c6f2f54a85f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:16.220317 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6d70d-b35c-4e9d-aac8-c6f2f54a85f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.220749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6d70d-b35c-4e9d-aac8-c6f2f54a85f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.221145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6d70d-b35c-4e9d-aac8-c6f2f54a85f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.222639 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6d70d-b35c-4e9d-aac8-c6f2f54a85f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:16.224608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: WARNING py.warnings [None req-aea6d70d-b35c-4e9d-aac8-c6f2f54a85f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:42:16.224608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: warnings.warn(msg) Sep 01 05:42:16.224608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: Sep 01 05:42:16.226173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6d70d-b35c-4e9d-aac8-c6f2f54a85f4 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:16.252409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-e649dab0-5d35-4a81-a84d-cb7d7f095875 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.253863 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e649dab0-5d35-4a81-a84d-cb7d7f095875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.272527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 766/1544] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:42:16.273986 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83018620-7ede-4c9c-9330-24c6dde93a42 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.274273 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83018620-7ede-4c9c-9330-24c6dde93a42 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.274547 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83018620-7ede-4c9c-9330-24c6dde93a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.318755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-83018620-7ede-4c9c-9330-24c6dde93a42 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.320010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-83018620-7ede-4c9c-9330-24c6dde93a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.329007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 767/1545] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:16.330465 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c198d2b-9950-440e-b4ff-07f026c8e463 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.330759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c198d2b-9950-440e-b4ff-07f026c8e463 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.331029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c198d2b-9950-440e-b4ff-07f026c8e463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.356007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-1c198d2b-9950-440e-b4ff-07f026c8e463 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.357706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1c198d2b-9950-440e-b4ff-07f026c8e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.364319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 779/1546] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/projects => generated 359 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:16.366010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0927199-7800-412a-978b-8e67f22a0055 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.366010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0927199-7800-412a-978b-8e67f22a0055 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.366271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0927199-7800-412a-978b-8e67f22a0055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.366955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 768/1547] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:16.368480 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d2dbb-530f-414a-88d9-c6f8c71ddc62 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.368683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d2dbb-530f-414a-88d9-c6f8c71ddc62 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.368963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d2dbb-530f-414a-88d9-c6f8c71ddc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.391803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-c85d2dbb-530f-414a-88d9-c6f8c71ddc62 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.393175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c85d2dbb-530f-414a-88d9-c6f8c71ddc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.417671 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-e0927199-7800-412a-978b-8e67f22a0055 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.423509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e0927199-7800-412a-978b-8e67f22a0055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.529275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 780/1548] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:16.530904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0927199-7800-412a-978b-8e67f22a0055 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:16.538141 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 769/1549] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:16.543380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d2dbb-530f-414a-88d9-c6f8c71ddc62 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:16.549285 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0927199-7800-412a-978b-8e67f22a0055 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:16.560353 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d2dbb-530f-414a-88d9-c6f8c71ddc62 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:16.561264 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3f24e-36b4-4f90-859b-2c9a69ec06ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:16.561925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3f24e-36b4-4f90-859b-2c9a69ec06ea admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.562206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3f24e-36b4-4f90-859b-2c9a69ec06ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.562476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3f24e-36b4-4f90-859b-2c9a69ec06ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.563127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3f24e-36b4-4f90-859b-2c9a69ec06ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:16.563430 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3f24e-36b4-4f90-859b-2c9a69ec06ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:16.566108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3f24e-36b4-4f90-859b-2c9a69ec06ea admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:16.568721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfeb3d-f72b-475c-ac92-591cc92048a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:16.569829 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfeb3d-f72b-475c-ac92-591cc92048a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.570311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfeb3d-f72b-475c-ac92-591cc92048a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.570608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfeb3d-f72b-475c-ac92-591cc92048a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.571955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfeb3d-f72b-475c-ac92-591cc92048a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:16.574468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: WARNING py.warnings [None req-7ebfeb3d-f72b-475c-ac92-591cc92048a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:42:16.574468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: warnings.warn(msg) Sep 01 05:42:16.574468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: Sep 01 05:42:16.576849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfeb3d-f72b-475c-ac92-591cc92048a3 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:16.579565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 781/1550] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:16.586761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73179b1-1084-49e8-90d9-a33d6468b528 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.587091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73179b1-1084-49e8-90d9-a33d6468b528 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.587328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73179b1-1084-49e8-90d9-a33d6468b528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.613308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c73179b1-1084-49e8-90d9-a33d6468b528 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.613308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c73179b1-1084-49e8-90d9-a33d6468b528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.620343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 782/1551] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:16.621649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead437-baed-4a37-8ab2-1fb42939ed70 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.621930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead437-baed-4a37-8ab2-1fb42939ed70 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.622202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ead437-baed-4a37-8ab2-1fb42939ed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.643907 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-23ead437-baed-4a37-8ab2-1fb42939ed70 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.645174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-23ead437-baed-4a37-8ab2-1fb42939ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.655001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 783/1552] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:16.655827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ead437-baed-4a37-8ab2-1fb42939ed70 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:16.667434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ead437-baed-4a37-8ab2-1fb42939ed70 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:16.681060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7e7eb-13b8-4f71-bca5-499747342db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:16.681060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7e7eb-13b8-4f71-bca5-499747342db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.681060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7e7eb-13b8-4f71-bca5-499747342db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.681060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7e7eb-13b8-4f71-bca5-499747342db4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.681565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7e7eb-13b8-4f71-bca5-499747342db4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:16.681565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7e7eb-13b8-4f71-bca5-499747342db4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:16.681565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7e7eb-13b8-4f71-bca5-499747342db4 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:16.689516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 784/1553] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:16.690879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06d270-6d2a-4e65-9dce-bbe089c249e9 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.691133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06d270-6d2a-4e65-9dce-bbe089c249e9 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.691401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06d270-6d2a-4e65-9dce-bbe089c249e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.712886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5e06d270-6d2a-4e65-9dce-bbe089c249e9 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.715388 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5e06d270-6d2a-4e65-9dce-bbe089c249e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.719587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 770/1554] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/users => generated 280 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:16.719587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae846e7-d2f8-4cb5-b8d5-0b15bd6eaef6 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.719587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae846e7-d2f8-4cb5-b8d5-0b15bd6eaef6 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.719587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae846e7-d2f8-4cb5-b8d5-0b15bd6eaef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.731309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 785/1555] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:16.732452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06d270-6d2a-4e65-9dce-bbe089c249e9 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:16.740652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-cae846e7-d2f8-4cb5-b8d5-0b15bd6eaef6 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.742372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-cae846e7-d2f8-4cb5-b8d5-0b15bd6eaef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.743384 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06d270-6d2a-4e65-9dce-bbe089c249e9 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:16.748976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a87f7c-f9ec-4404-a5ed-b4f3d095520f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:16.749672 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a87f7c-f9ec-4404-a5ed-b4f3d095520f admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.749953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a87f7c-f9ec-4404-a5ed-b4f3d095520f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.750227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a87f7c-f9ec-4404-a5ed-b4f3d095520f admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.760648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 771/1556] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:16.760823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a87f7c-f9ec-4404-a5ed-b4f3d095520f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:16.760943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae846e7-d2f8-4cb5-b8d5-0b15bd6eaef6 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:16.761038 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a87f7c-f9ec-4404-a5ed-b4f3d095520f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:16.770767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae846e7-d2f8-4cb5-b8d5-0b15bd6eaef6 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:16.776619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d95d2-5adf-4731-8d36-4a02a58f3355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:16.777971 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d95d2-5adf-4731-8d36-4a02a58f3355 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.778354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d95d2-5adf-4731-8d36-4a02a58f3355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.778664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d95d2-5adf-4731-8d36-4a02a58f3355 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.779397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d95d2-5adf-4731-8d36-4a02a58f3355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:16.779742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d95d2-5adf-4731-8d36-4a02a58f3355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:16.781511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: WARNING py.warnings [None req-ac1d95d2-5adf-4731-8d36-4a02a58f3355 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:42:16.781511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: warnings.warn(msg) Sep 01 05:42:16.781511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: Sep 01 05:42:16.782491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d95d2-5adf-4731-8d36-4a02a58f3355 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:16.795663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 772/1557] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:16.797215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f0e1e-d723-4366-a2b7-29a216b76a23 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.797537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f0e1e-d723-4366-a2b7-29a216b76a23 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.797840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f0e1e-d723-4366-a2b7-29a216b76a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.819325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a68f0e1e-d723-4366-a2b7-29a216b76a23 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.820068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a68f0e1e-d723-4366-a2b7-29a216b76a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.828906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 773/1558] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:16.830366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23508580-67cb-4dc9-9b01-d997c208e916 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.830658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23508580-67cb-4dc9-9b01-d997c208e916 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.830931 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23508580-67cb-4dc9-9b01-d997c208e916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.851750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-23508580-67cb-4dc9-9b01-d997c208e916 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:16.852990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-23508580-67cb-4dc9-9b01-d997c208e916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:16.861569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 774/1559] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:16.862546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23508580-67cb-4dc9-9b01-d997c208e916 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:16.873590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23508580-67cb-4dc9-9b01-d997c208e916 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:16.878457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a309b-e34a-4d6b-aca7-36c9352e80e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:16.879090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a309b-e34a-4d6b-aca7-36c9352e80e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.879370 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a309b-e34a-4d6b-aca7-36c9352e80e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.879643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a309b-e34a-4d6b-aca7-36c9352e80e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.880293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a309b-e34a-4d6b-aca7-36c9352e80e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:16.882278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a309b-e34a-4d6b-aca7-36c9352e80e8 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:16.896853 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 786/1560] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:16.898518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a87f7c-f9ec-4404-a5ed-b4f3d095520f admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:16.970690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:16.982974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a87f7c-f9ec-4404-a5ed-b4f3d095520f admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:16.988119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe0b84-0e14-419d-9451-2c7672acd0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:16.988739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe0b84-0e14-419d-9451-2c7672acd0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:16.989022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe0b84-0e14-419d-9451-2c7672acd0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:16.989299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe0b84-0e14-419d-9451-2c7672acd0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:16.990008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe0b84-0e14-419d-9451-2c7672acd0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:16.991632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe0b84-0e14-419d-9451-2c7672acd0a4 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.005076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 787/1561] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:17.011296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 775/1562] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:16 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:17.012212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb344-3b83-4db1-915b-76441c2155ca None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.012212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb344-3b83-4db1-915b-76441c2155ca None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.012212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb344-3b83-4db1-915b-76441c2155ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.012673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a309b-e34a-4d6b-aca7-36c9352e80e8 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.029447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-25aeb344-3b83-4db1-915b-76441c2155ca None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:17.030763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-25aeb344-3b83-4db1-915b-76441c2155ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:17.085650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:17.091284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a309b-e34a-4d6b-aca7-36c9352e80e8 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.097949 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfc973-38f0-4f5f-8474-cec319ce495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.098161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 788/1563] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:17.099035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfc973-38f0-4f5f-8474-cec319ce495f admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.099524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfc973-38f0-4f5f-8474-cec319ce495f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.100009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfc973-38f0-4f5f-8474-cec319ce495f admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.101305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfc973-38f0-4f5f-8474-cec319ce495f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:17.102730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfc973-38f0-4f5f-8474-cec319ce495f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.102920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aeb344-3b83-4db1-915b-76441c2155ca None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.106854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfc973-38f0-4f5f-8474-cec319ce495f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.115223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aeb344-3b83-4db1-915b-76441c2155ca None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.120293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996be6c3-da2c-43cd-8728-761c681ee732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.120905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996be6c3-da2c-43cd-8728-761c681ee732 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.121180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996be6c3-da2c-43cd-8728-761c681ee732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.121487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996be6c3-da2c-43cd-8728-761c681ee732 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.122139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996be6c3-da2c-43cd-8728-761c681ee732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.122809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 776/1564] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:17.124181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996be6c3-da2c-43cd-8728-761c681ee732 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.124402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecf35e-3c25-4448-85c2-2bfed8d91561 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.124511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecf35e-3c25-4448-85c2-2bfed8d91561 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.124743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecf35e-3c25-4448-85c2-2bfed8d91561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.159772 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b8ecf35e-3c25-4448-85c2-2bfed8d91561 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:17.161054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b8ecf35e-3c25-4448-85c2-2bfed8d91561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:17.170019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 777/1565] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:17.170904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecf35e-3c25-4448-85c2-2bfed8d91561 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.180916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecf35e-3c25-4448-85c2-2bfed8d91561 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.187699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc9b9e-646c-4c5c-896e-f2edfda3d5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.188471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc9b9e-646c-4c5c-896e-f2edfda3d5ff admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.188850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc9b9e-646c-4c5c-896e-f2edfda3d5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.189230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc9b9e-646c-4c5c-896e-f2edfda3d5ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.190079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc9b9e-646c-4c5c-896e-f2edfda3d5ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:17.190481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc9b9e-646c-4c5c-896e-f2edfda3d5ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.192338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc9b9e-646c-4c5c-896e-f2edfda3d5ff admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.207153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 778/1566] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:17.208192 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc9b9e-646c-4c5c-896e-f2edfda3d5ff admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.220972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc9b9e-646c-4c5c-896e-f2edfda3d5ff admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.226331 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00606c-db9a-4977-aacf-9b1cde438caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.226966 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00606c-db9a-4977-aacf-9b1cde438caf admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.227249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00606c-db9a-4977-aacf-9b1cde438caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.227525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00606c-db9a-4977-aacf-9b1cde438caf admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.228307 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00606c-db9a-4977-aacf-9b1cde438caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.230350 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00606c-db9a-4977-aacf-9b1cde438caf admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.286502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 789/1567] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:17 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:17.286502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996be6c3-da2c-43cd-8728-761c681ee732 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.360213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996be6c3-da2c-43cd-8728-761c681ee732 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.368021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8b496-2974-4b24-a1f6-459dcb9bca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.368403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 779/1568] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:17 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:17.368805 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8b496-2974-4b24-a1f6-459dcb9bca00 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.369392 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8b496-2974-4b24-a1f6-459dcb9bca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.369840 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8b496-2974-4b24-a1f6-459dcb9bca00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.370024 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00606c-db9a-4977-aacf-9b1cde438caf admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.370872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8b496-2974-4b24-a1f6-459dcb9bca00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.373115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8b496-2974-4b24-a1f6-459dcb9bca00 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.387926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00606c-db9a-4977-aacf-9b1cde438caf admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.388560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 790/1569] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:17.390893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8b496-2974-4b24-a1f6-459dcb9bca00 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.400001 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b3fac-d24a-4150-b84e-e64f0e4ceeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.402120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b3fac-d24a-4150-b84e-e64f0e4ceeb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.402409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b3fac-d24a-4150-b84e-e64f0e4ceeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.402690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b3fac-d24a-4150-b84e-e64f0e4ceeb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.403548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b3fac-d24a-4150-b84e-e64f0e4ceeb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.405616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b3fac-d24a-4150-b84e-e64f0e4ceeb1 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.410210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8b496-2974-4b24-a1f6-459dcb9bca00 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.417540 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb897b-9760-4137-a651-ceb019cc051a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.422397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb897b-9760-4137-a651-ceb019cc051a admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.422397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb897b-9760-4137-a651-ceb019cc051a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.422397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb897b-9760-4137-a651-ceb019cc051a admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.422397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb897b-9760-4137-a651-ceb019cc051a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:17.422397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb897b-9760-4137-a651-ceb019cc051a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.422397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb897b-9760-4137-a651-ceb019cc051a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.436419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 791/1570] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:17.437554 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb897b-9760-4137-a651-ceb019cc051a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.450080 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb897b-9760-4137-a651-ceb019cc051a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.455246 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b7041-0942-4a36-9e35-ee7e864d46a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.455991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b7041-0942-4a36-9e35-ee7e864d46a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.456244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b7041-0942-4a36-9e35-ee7e864d46a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.456526 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b7041-0942-4a36-9e35-ee7e864d46a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.457177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b7041-0942-4a36-9e35-ee7e864d46a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.459182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b7041-0942-4a36-9e35-ee7e864d46a3 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.521455 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 780/1571] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:17 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:17.522606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b3fac-d24a-4150-b84e-e64f0e4ceeb1 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.533855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b3fac-d24a-4150-b84e-e64f0e4ceeb1 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.538964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9629cd-dce0-4298-ad94-dde677417407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.539592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9629cd-dce0-4298-ad94-dde677417407 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.539874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9629cd-dce0-4298-ad94-dde677417407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.540148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9629cd-dce0-4298-ad94-dde677417407 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.540809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9629cd-dce0-4298-ad94-dde677417407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:17.542437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9629cd-dce0-4298-ad94-dde677417407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.544365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9629cd-dce0-4298-ad94-dde677417407 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.558177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 781/1572] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:17.559218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9629cd-dce0-4298-ad94-dde677417407 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.569561 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9629cd-dce0-4298-ad94-dde677417407 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.574762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76548a-b008-4369-8a0b-cd9d425ec03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.575415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76548a-b008-4369-8a0b-cd9d425ec03e admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.575696 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76548a-b008-4369-8a0b-cd9d425ec03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.575972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76548a-b008-4369-8a0b-cd9d425ec03e admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.576618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76548a-b008-4369-8a0b-cd9d425ec03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.578623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76548a-b008-4369-8a0b-cd9d425ec03e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.700827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 792/1573] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:17 2022] POST /identity/v3/projects => generated 409 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:17.701940 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b7041-0942-4a36-9e35-ee7e864d46a3 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.738732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:17.762259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 782/1574] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:17 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:17.764038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76548a-b008-4369-8a0b-cd9d425ec03e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.796239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b7041-0942-4a36-9e35-ee7e864d46a3 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.848315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76548a-b008-4369-8a0b-cd9d425ec03e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.855867 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7792c93-f113-41a7-9b12-8b9e3ac38b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.856512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7792c93-f113-41a7-9b12-8b9e3ac38b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.856965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7792c93-f113-41a7-9b12-8b9e3ac38b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.857233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7792c93-f113-41a7-9b12-8b9e3ac38b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.857931 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7792c93-f113-41a7-9b12-8b9e3ac38b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.859819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7792c93-f113-41a7-9b12-8b9e3ac38b9a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.865412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca047a-5b56-46a1-a91f-b0f6def287ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.866055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca047a-5b56-46a1-a91f-b0f6def287ff admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.866340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca047a-5b56-46a1-a91f-b0f6def287ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.866619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca047a-5b56-46a1-a91f-b0f6def287ff admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.867923 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca047a-5b56-46a1-a91f-b0f6def287ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.872260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca047a-5b56-46a1-a91f-b0f6def287ff admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:17.882247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 783/1575] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:17.885325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7792c93-f113-41a7-9b12-8b9e3ac38b9a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:17.898744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7792c93-f113-41a7-9b12-8b9e3ac38b9a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:17.905244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a766bad-51fd-4d29-b5a5-9071c67c9368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:17.906025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a766bad-51fd-4d29-b5a5-9071c67c9368 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:17.906303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a766bad-51fd-4d29-b5a5-9071c67c9368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:17.906572 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a766bad-51fd-4d29-b5a5-9071c67c9368 admin admin] PATH_INFO: `/v3/projects/6bd439d1269740029a3bb623b0b2adab/users/a23e62b60327455bb078b9cf29ad7032/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:17.929052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a766bad-51fd-4d29-b5a5-9071c67c9368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd439d1269740029a3bb623b0b2adab, user_id=a23e62b60327455bb078b9cf29ad7032, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:17.935002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a766bad-51fd-4d29-b5a5-9071c67c9368 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.052987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 793/1576] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:17 2022] POST /identity/v3/users => generated 294 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:18.053916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca047a-5b56-46a1-a91f-b0f6def287ff admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.065721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca047a-5b56-46a1-a91f-b0f6def287ff admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.071413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac6a0f-e731-4df6-84e8-9bc2d16ec486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.072100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac6a0f-e731-4df6-84e8-9bc2d16ec486 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.073216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac6a0f-e731-4df6-84e8-9bc2d16ec486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.073424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac6a0f-e731-4df6-84e8-9bc2d16ec486 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.074125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac6a0f-e731-4df6-84e8-9bc2d16ec486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.076319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac6a0f-e731-4df6-84e8-9bc2d16ec486 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.102355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 784/1577] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:17 2022] PUT /identity/v3/projects/6bd439d1269740029a3bb623b0b2adab/users/a23e62b60327455bb078b9cf29ad7032/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:18.104366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a766bad-51fd-4d29-b5a5-9071c67c9368 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.155833 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:18.188980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a766bad-51fd-4d29-b5a5-9071c67c9368 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.193979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc82ff1-d548-417b-a228-b2e07e43c816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.194612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc82ff1-d548-417b-a228-b2e07e43c816 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.194887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc82ff1-d548-417b-a228-b2e07e43c816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.195156 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc82ff1-d548-417b-a228-b2e07e43c816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.195794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc82ff1-d548-417b-a228-b2e07e43c816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.197995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc82ff1-d548-417b-a228-b2e07e43c816 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.211712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 794/1578] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:18 2022] POST /identity/v3/projects => generated 391 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:18.212802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac6a0f-e731-4df6-84e8-9bc2d16ec486 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.220595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 785/1579] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:18.220595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc82ff1-d548-417b-a228-b2e07e43c816 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.234387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc82ff1-d548-417b-a228-b2e07e43c816 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.305968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac6a0f-e731-4df6-84e8-9bc2d16ec486 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.309116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b0f80-88e0-4246-af23-993e5ec44282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.309876 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b0f80-88e0-4246-af23-993e5ec44282 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.310220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b0f80-88e0-4246-af23-993e5ec44282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.310559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b0f80-88e0-4246-af23-993e5ec44282 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.311303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b0f80-88e0-4246-af23-993e5ec44282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.313504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b0f80-88e0-4246-af23-993e5ec44282 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.314504 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f758d-422d-4b93-a6ee-265ab0c0f78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.315574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f758d-422d-4b93-a6ee-265ab0c0f78e admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.316077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f758d-422d-4b93-a6ee-265ab0c0f78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.316559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f758d-422d-4b93-a6ee-265ab0c0f78e admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.317777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f758d-422d-4b93-a6ee-265ab0c0f78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.321522 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f758d-422d-4b93-a6ee-265ab0c0f78e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.437346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 786/1580] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:18 2022] POST /identity/v3/users => generated 305 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:18.438843 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b0f80-88e0-4246-af23-993e5ec44282 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.452147 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b0f80-88e0-4246-af23-993e5ec44282 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.457753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6da2-2f3e-492d-addf-6312586edad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.458852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6da2-2f3e-492d-addf-6312586edad0 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.459237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6da2-2f3e-492d-addf-6312586edad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.459568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca6da2-2f3e-492d-addf-6312586edad0 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.460317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca6da2-2f3e-492d-addf-6312586edad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.462514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca6da2-2f3e-492d-addf-6312586edad0 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.485039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 795/1581] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:18 2022] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:18.486011 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f758d-422d-4b93-a6ee-265ab0c0f78e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.520768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:18.562722 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f758d-422d-4b93-a6ee-265ab0c0f78e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.567768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6434c94-fde4-4051-8459-f70e4a04940c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.568392 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6434c94-fde4-4051-8459-f70e4a04940c admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.568833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6434c94-fde4-4051-8459-f70e4a04940c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.569111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6434c94-fde4-4051-8459-f70e4a04940c admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.569817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6434c94-fde4-4051-8459-f70e4a04940c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.571478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6434c94-fde4-4051-8459-f70e4a04940c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.576206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 787/1582] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:18 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:18.577471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6da2-2f3e-492d-addf-6312586edad0 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.583558 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 796/1583] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:18.584975 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70466f0-0403-45d0-8e9a-8163b3b79c46 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.585261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70466f0-0403-45d0-8e9a-8163b3b79c46 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.585559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70466f0-0403-45d0-8e9a-8163b3b79c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.597499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca6da2-2f3e-492d-addf-6312586edad0 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.603778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504330f-141d-4145-93b8-2f6c21b88b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.604811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504330f-141d-4145-93b8-2f6c21b88b07 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.605266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504330f-141d-4145-93b8-2f6c21b88b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.605788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504330f-141d-4145-93b8-2f6c21b88b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.606798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504330f-141d-4145-93b8-2f6c21b88b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.608955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504330f-141d-4145-93b8-2f6c21b88b07 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.624398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 788/1584] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:18.625179 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504330f-141d-4145-93b8-2f6c21b88b07 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.627372 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-e70466f0-0403-45d0-8e9a-8163b3b79c46 None None] MFA Rules not processed for user `a23e62b60327455bb078b9cf29ad7032`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:18.628714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e70466f0-0403-45d0-8e9a-8163b3b79c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:18.637885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504330f-141d-4145-93b8-2f6c21b88b07 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.643756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98609082-8990-4638-9a0a-3d58e3435317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.644964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98609082-8990-4638-9a0a-3d58e3435317 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.646079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98609082-8990-4638-9a0a-3d58e3435317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.646079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98609082-8990-4638-9a0a-3d58e3435317 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.647120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98609082-8990-4638-9a0a-3d58e3435317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.651728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98609082-8990-4638-9a0a-3d58e3435317 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.709150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 797/1585] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:18.709806 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70466f0-0403-45d0-8e9a-8163b3b79c46 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.724531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70466f0-0403-45d0-8e9a-8163b3b79c46 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.732787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b542ef-6e5f-44b4-a5e0-ddc1d5327c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.733912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b542ef-6e5f-44b4-a5e0-ddc1d5327c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.734392 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b542ef-6e5f-44b4-a5e0-ddc1d5327c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.734886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b542ef-6e5f-44b4-a5e0-ddc1d5327c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.736107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b542ef-6e5f-44b4-a5e0-ddc1d5327c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.739303 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b542ef-6e5f-44b4-a5e0-ddc1d5327c88 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.761579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 798/1586] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:18.763174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b542ef-6e5f-44b4-a5e0-ddc1d5327c88 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.781800 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b542ef-6e5f-44b4-a5e0-ddc1d5327c88 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.790006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e337744-dd0f-447b-8203-90fccb5f3d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.791089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e337744-dd0f-447b-8203-90fccb5f3d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.791695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e337744-dd0f-447b-8203-90fccb5f3d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.792190 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e337744-dd0f-447b-8203-90fccb5f3d09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.793399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e337744-dd0f-447b-8203-90fccb5f3d09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.796631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e337744-dd0f-447b-8203-90fccb5f3d09 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.817119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 799/1587] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:18.817119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e337744-dd0f-447b-8203-90fccb5f3d09 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.817586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 789/1588] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:18 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:18.819073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98609082-8990-4638-9a0a-3d58e3435317 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.832315 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e337744-dd0f-447b-8203-90fccb5f3d09 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.837475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a235eba-fc89-4be2-bdbc-4de4bc3de168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.838642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a235eba-fc89-4be2-bdbc-4de4bc3de168 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.838959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98609082-8990-4638-9a0a-3d58e3435317 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.839142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a235eba-fc89-4be2-bdbc-4de4bc3de168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.839318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a235eba-fc89-4be2-bdbc-4de4bc3de168 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.839960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a235eba-fc89-4be2-bdbc-4de4bc3de168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.842186 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a235eba-fc89-4be2-bdbc-4de4bc3de168 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.848298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5623c1-af78-468a-a687-928c6c6c6f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.849258 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5623c1-af78-468a-a687-928c6c6c6f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.849779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5623c1-af78-468a-a687-928c6c6c6f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.850217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5623c1-af78-468a-a687-928c6c6c6f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.851313 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5623c1-af78-468a-a687-928c6c6c6f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.855000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5623c1-af78-468a-a687-928c6c6c6f22 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.868787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 790/1589] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:18.870456 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5623c1-af78-468a-a687-928c6c6c6f22 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:18.883155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5623c1-af78-468a-a687-928c6c6c6f22 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:18.889014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c464d15-34ab-48b5-885d-8df4777b437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:18.889813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c464d15-34ab-48b5-885d-8df4777b437d admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:18.890130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c464d15-34ab-48b5-885d-8df4777b437d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:18.890472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c464d15-34ab-48b5-885d-8df4777b437d admin admin] PATH_INFO: `/v3/projects/4a761955aa144c94be98a565c938ba86/users/e349427373054c7f872fdee48129473b/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:18.912639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c464d15-34ab-48b5-885d-8df4777b437d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a761955aa144c94be98a565c938ba86, user_id=e349427373054c7f872fdee48129473b, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:18.915690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c464d15-34ab-48b5-885d-8df4777b437d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:18.997819 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 800/1590] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:18 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:18.999021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a235eba-fc89-4be2-bdbc-4de4bc3de168 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:19.011540 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a235eba-fc89-4be2-bdbc-4de4bc3de168 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:19.018578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b472b7-19b4-4aff-a190-189d0fa14a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:19.019889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b472b7-19b4-4aff-a190-189d0fa14a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:19.020381 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b472b7-19b4-4aff-a190-189d0fa14a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:19.020857 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b472b7-19b4-4aff-a190-189d0fa14a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:19.022074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b472b7-19b4-4aff-a190-189d0fa14a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:19.025267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b472b7-19b4-4aff-a190-189d0fa14a10 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:19.047769 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 801/1591] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:19.050438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b472b7-19b4-4aff-a190-189d0fa14a10 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:19.061080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 791/1592] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:18 2022] PUT /identity/v3/projects/4a761955aa144c94be98a565c938ba86/users/e349427373054c7f872fdee48129473b/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:19.061080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c464d15-34ab-48b5-885d-8df4777b437d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:19.137779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:19.156441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b472b7-19b4-4aff-a190-189d0fa14a10 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:19.169239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c464d15-34ab-48b5-885d-8df4777b437d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:19.176842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e459fd-8ac4-4aa2-b3ea-f029d5b072f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:19.177946 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e459fd-8ac4-4aa2-b3ea-f029d5b072f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:19.178406 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e459fd-8ac4-4aa2-b3ea-f029d5b072f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:19.178898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e459fd-8ac4-4aa2-b3ea-f029d5b072f9 admin admin] PATH_INFO: `/v3/projects/a2369179eaa44d23bed423a8603730f6/users/2954a215b049442cbd481f1f3ecab1db/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:19.180635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:19.200616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e459fd-8ac4-4aa2-b3ea-f029d5b072f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2369179eaa44d23bed423a8603730f6, user_id=2954a215b049442cbd481f1f3ecab1db, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:19.204151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e459fd-8ac4-4aa2-b3ea-f029d5b072f9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:19.226522 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeca6e-2725-437c-af3f-7ab4fed4709d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:19.227215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeca6e-2725-437c-af3f-7ab4fed4709d service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:19.227488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeca6e-2725-437c-af3f-7ab4fed4709d service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:19.227877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efeca6e-2725-437c-af3f-7ab4fed4709d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:19.294290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efeca6e-2725-437c-af3f-7ab4fed4709d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:19.295856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efeca6e-2725-437c-af3f-7ab4fed4709d service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:19.308565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 802/1593] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:19.310104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeca6e-2725-437c-af3f-7ab4fed4709d service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:19.315573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 792/1594] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:19 2022] PUT /identity/v3/projects/a2369179eaa44d23bed423a8603730f6/users/2954a215b049442cbd481f1f3ecab1db/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:19.317035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e459fd-8ac4-4aa2-b3ea-f029d5b072f9 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:19.322102 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efeca6e-2725-437c-af3f-7ab4fed4709d service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:19.405981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec03be-5cd9-4442-bfd0-c64c4eb1d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:19.406514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec03be-5cd9-4442-bfd0-c64c4eb1d4ee admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:19.406799 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec03be-5cd9-4442-bfd0-c64c4eb1d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:19.407090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec03be-5cd9-4442-bfd0-c64c4eb1d4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:19.407725 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec03be-5cd9-4442-bfd0-c64c4eb1d4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:19.409631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec03be-5cd9-4442-bfd0-c64c4eb1d4ee admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:19.430636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 803/1595] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:19.430636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec03be-5cd9-4442-bfd0-c64c4eb1d4ee admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:19.435839 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e459fd-8ac4-4aa2-b3ea-f029d5b072f9 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:19.439579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec03be-5cd9-4442-bfd0-c64c4eb1d4ee admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:19.444707 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70618a-66b6-431e-ad31-09efc29a6c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:19.445322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70618a-66b6-431e-ad31-09efc29a6c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:19.445530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd789b-0e8c-43c2-aaa8-ab7dfda89b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:19.445693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70618a-66b6-431e-ad31-09efc29a6c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:19.445893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70618a-66b6-431e-ad31-09efc29a6c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:19.446403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd789b-0e8c-43c2-aaa8-ab7dfda89b7f admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:19.446566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70618a-66b6-431e-ad31-09efc29a6c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:19.447054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd789b-0e8c-43c2-aaa8-ab7dfda89b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:19.447895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd789b-0e8c-43c2-aaa8-ab7dfda89b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:19.448981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70618a-66b6-431e-ad31-09efc29a6c0e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:19.449428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd789b-0e8c-43c2-aaa8-ab7dfda89b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:19.452673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd789b-0e8c-43c2-aaa8-ab7dfda89b7f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:19.464015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 804/1596] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:19.465865 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70618a-66b6-431e-ad31-09efc29a6c0e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:19.475820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 793/1597] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:19.477309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd789b-0e8c-43c2-aaa8-ab7dfda89b7f admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:19.495566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70618a-66b6-431e-ad31-09efc29a6c0e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:19.502941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d285b-7a20-486b-a7ab-75edc9624d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:19.504416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d285b-7a20-486b-a7ab-75edc9624d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:19.505606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd789b-0e8c-43c2-aaa8-ab7dfda89b7f admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:19.506196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d285b-7a20-486b-a7ab-75edc9624d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:19.506729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d285b-7a20-486b-a7ab-75edc9624d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:19.507932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d285b-7a20-486b-a7ab-75edc9624d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:19.512324 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d285b-7a20-486b-a7ab-75edc9624d9c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:19.515659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588921a6-094c-414f-8546-1b1e6a45424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:19.516923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588921a6-094c-414f-8546-1b1e6a45424e admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:19.517456 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588921a6-094c-414f-8546-1b1e6a45424e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:19.517957 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588921a6-094c-414f-8546-1b1e6a45424e admin admin] PATH_INFO: `/v3/projects/4676205a65474ae69b02d925b4a28248/users/bc8972d8bcec4e779a95a3b698641198/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:19.540023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 805/1598] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:19.540023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faa32e-ff08-4f8d-85d6-38f473785b09 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:19.540023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faa32e-ff08-4f8d-85d6-38f473785b09 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:19.540438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61faa32e-ff08-4f8d-85d6-38f473785b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:19.543854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588921a6-094c-414f-8546-1b1e6a45424e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4676205a65474ae69b02d925b4a28248, user_id=bc8972d8bcec4e779a95a3b698641198, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:19.546915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588921a6-094c-414f-8546-1b1e6a45424e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:19.591633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-61faa32e-ff08-4f8d-85d6-38f473785b09 None None] MFA Rules not processed for user `e349427373054c7f872fdee48129473b`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:19.593870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-61faa32e-ff08-4f8d-85d6-38f473785b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:19.651285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 794/1599] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:19 2022] PUT /identity/v3/projects/4676205a65474ae69b02d925b4a28248/users/bc8972d8bcec4e779a95a3b698641198/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:19.659949 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8947d8-0571-4639-b184-f47a31ed2cd6 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:19.660489 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8947d8-0571-4639-b184-f47a31ed2cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:19.661688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8947d8-0571-4639-b184-f47a31ed2cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:19.662274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:19.700617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-aa8947d8-0571-4639-b184-f47a31ed2cd6 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:19.702248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-aa8947d8-0571-4639-b184-f47a31ed2cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:19.715114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 806/1600] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:19.721202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faa32e-ff08-4f8d-85d6-38f473785b09 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:19.732949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61faa32e-ff08-4f8d-85d6-38f473785b09 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:19.795278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 795/1601] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:19.796710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8947d8-0571-4639-b184-f47a31ed2cd6 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:19.826381 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8947d8-0571-4639-b184-f47a31ed2cd6 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:19.834793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec0673-da64-40f1-b1e3-adea9d876ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:19.836237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec0673-da64-40f1-b1e3-adea9d876ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:19.836978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec0673-da64-40f1-b1e3-adea9d876ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:19.837556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec0673-da64-40f1-b1e3-adea9d876ddc admin admin] PATH_INFO: `/v3/projects/bd64a5d521704c46b89c6e7a7adde71a/users/84835f1dbde4440e82ff4c3e183d9249/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:19.849361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759db976-aa40-4b53-831b-897617d641a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:19.851266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759db976-aa40-4b53-831b-897617d641a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:19.851266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759db976-aa40-4b53-831b-897617d641a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:19.851266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759db976-aa40-4b53-831b-897617d641a3 admin admin] PATH_INFO: `/v3/projects/015981bd28fa41d7b31536f8a0ca9fdd/users/a73ccaf0509d4354bb038dea3d1fb40c/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:19.862792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec0673-da64-40f1-b1e3-adea9d876ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd64a5d521704c46b89c6e7a7adde71a, user_id=84835f1dbde4440e82ff4c3e183d9249, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:19.868088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec0673-da64-40f1-b1e3-adea9d876ddc admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:19.875736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759db976-aa40-4b53-831b-897617d641a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015981bd28fa41d7b31536f8a0ca9fdd, user_id=a73ccaf0509d4354bb038dea3d1fb40c, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:19.876874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: WARNING py.warnings [None req-759db976-aa40-4b53-831b-897617d641a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:42:19.876874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: warnings.warn(msg) Sep 01 05:42:19.876874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: Sep 01 05:42:19.879221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759db976-aa40-4b53-831b-897617d641a3 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:19.991077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 796/1602] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:19 2022] PUT /identity/v3/projects/bd64a5d521704c46b89c6e7a7adde71a/users/84835f1dbde4440e82ff4c3e183d9249/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:19.992885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec0673-da64-40f1-b1e3-adea9d876ddc admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:20.015410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:20.026228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 807/1603] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:19 2022] PUT /identity/v3/projects/015981bd28fa41d7b31536f8a0ca9fdd/users/a73ccaf0509d4354bb038dea3d1fb40c/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:20.029017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759db976-aa40-4b53-831b-897617d641a3 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:20.105116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec0673-da64-40f1-b1e3-adea9d876ddc admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:20.161584 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759db976-aa40-4b53-831b-897617d641a3 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:20.167819 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f7160-5969-42a1-a823-818e686d2d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:20.168589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f7160-5969-42a1-a823-818e686d2d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:20.168871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f7160-5969-42a1-a823-818e686d2d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:20.169151 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f7160-5969-42a1-a823-818e686d2d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:20.169856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f7160-5969-42a1-a823-818e686d2d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:20.171528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f7160-5969-42a1-a823-818e686d2d1e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:20.183954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 808/1604] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:20.185299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b5b40-4997-4533-af61-632ad95272be None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:20.185615 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b5b40-4997-4533-af61-632ad95272be None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:20.185892 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b5b40-4997-4533-af61-632ad95272be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:20.193094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba023b-af2a-48de-a2db-d58aff857321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:20.194003 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba023b-af2a-48de-a2db-d58aff857321 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:20.194272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba023b-af2a-48de-a2db-d58aff857321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:20.194724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba023b-af2a-48de-a2db-d58aff857321 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:20.195802 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba023b-af2a-48de-a2db-d58aff857321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:20.198232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba023b-af2a-48de-a2db-d58aff857321 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:20.212703 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-1e8b5b40-4997-4533-af61-632ad95272be None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:20.214476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 797/1605] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:20.220269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1e8b5b40-4997-4533-af61-632ad95272be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:20.220403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba023b-af2a-48de-a2db-d58aff857321 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:20.227616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 809/1606] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:20.228268 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b5b40-4997-4533-af61-632ad95272be None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:20.228389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba023b-af2a-48de-a2db-d58aff857321 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:20.237425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38374eb4-b6ee-41e1-847a-a42eb8deea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:20.238064 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38374eb4-b6ee-41e1-847a-a42eb8deea1b admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:20.238422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38374eb4-b6ee-41e1-847a-a42eb8deea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:20.238782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38374eb4-b6ee-41e1-847a-a42eb8deea1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:20.239318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38374eb4-b6ee-41e1-847a-a42eb8deea1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:20.241787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38374eb4-b6ee-41e1-847a-a42eb8deea1b admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:20.320975 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:20.329747 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b5b40-4997-4533-af61-632ad95272be None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:20.336611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62709651-f244-4acf-a907-128c2b31dc86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:20.337700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62709651-f244-4acf-a907-128c2b31dc86 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:20.339642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62709651-f244-4acf-a907-128c2b31dc86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:20.340147 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62709651-f244-4acf-a907-128c2b31dc86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:20.358267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62709651-f244-4acf-a907-128c2b31dc86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:20.361086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62709651-f244-4acf-a907-128c2b31dc86 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:20.384476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 798/1607] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:20 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:20.384476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67838cf4-dc26-4faf-8ba1-f501e664d176 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:20.384476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67838cf4-dc26-4faf-8ba1-f501e664d176 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:20.384476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67838cf4-dc26-4faf-8ba1-f501e664d176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:20.389783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 810/1608] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:20.402263 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eb625-ef1c-4540-a4fd-a774f1603bc8 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:20.408623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eb625-ef1c-4540-a4fd-a774f1603bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:20.408623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212eb625-ef1c-4540-a4fd-a774f1603bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:20.435358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-67838cf4-dc26-4faf-8ba1-f501e664d176 None None] MFA Rules not processed for user `84835f1dbde4440e82ff4c3e183d9249`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:20.441999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-67838cf4-dc26-4faf-8ba1-f501e664d176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:20.466103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-212eb625-ef1c-4540-a4fd-a774f1603bc8 None None] MFA Rules not processed for user `a73ccaf0509d4354bb038dea3d1fb40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:20.469367 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-212eb625-ef1c-4540-a4fd-a774f1603bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:20.542342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 799/1609] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:20.542342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67838cf4-dc26-4faf-8ba1-f501e664d176 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:20.595214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:20.638073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 811/1610] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:20 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:20.639076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eb625-ef1c-4540-a4fd-a774f1603bc8 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:20.698573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67838cf4-dc26-4faf-8ba1-f501e664d176 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:20.711796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac36d9-9a3a-49da-a66f-6d4b35cbc365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:20.713924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac36d9-9a3a-49da-a66f-6d4b35cbc365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:20.714435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac36d9-9a3a-49da-a66f-6d4b35cbc365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:20.715013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac36d9-9a3a-49da-a66f-6d4b35cbc365 admin admin] PATH_INFO: `/v3/projects/11177b3ce5b847939ccc95b45005a671/users/8e6fef07913146ab8531d97525b3c782/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:20.732608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212eb625-ef1c-4540-a4fd-a774f1603bc8 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:20.740602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd2b31-92fc-4626-8dbe-da8a7581c853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:20.741751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd2b31-92fc-4626-8dbe-da8a7581c853 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:20.742187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd2b31-92fc-4626-8dbe-da8a7581c853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:20.742672 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd2b31-92fc-4626-8dbe-da8a7581c853 admin admin] PATH_INFO: `/v3/projects/5bacd190ec2c4f18867c4ef10b5c3f7b/users/5b1e6a1c0fe345bbbbe9c4a4a91f355a/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:20.746935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac36d9-9a3a-49da-a66f-6d4b35cbc365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11177b3ce5b847939ccc95b45005a671, user_id=8e6fef07913146ab8531d97525b3c782, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:20.751414 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac36d9-9a3a-49da-a66f-6d4b35cbc365 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:20.767593 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd2b31-92fc-4626-8dbe-da8a7581c853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bacd190ec2c4f18867c4ef10b5c3f7b, user_id=5b1e6a1c0fe345bbbbe9c4a4a91f355a, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:20.771134 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd2b31-92fc-4626-8dbe-da8a7581c853 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:20.900253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 812/1611] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:20 2022] PUT /identity/v3/projects/5bacd190ec2c4f18867c4ef10b5c3f7b/users/5b1e6a1c0fe345bbbbe9c4a4a91f355a/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:20.900253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd2b31-92fc-4626-8dbe-da8a7581c853 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:20.911445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 800/1612] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:20 2022] PUT /identity/v3/projects/11177b3ce5b847939ccc95b45005a671/users/8e6fef07913146ab8531d97525b3c782/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:20.911445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac36d9-9a3a-49da-a66f-6d4b35cbc365 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:21.020917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd2b31-92fc-4626-8dbe-da8a7581c853 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:21.027965 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae06b1-6415-42a7-a19e-d88ae0d1555b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:21.030016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae06b1-6415-42a7-a19e-d88ae0d1555b service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:21.037169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae06b1-6415-42a7-a19e-d88ae0d1555b service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:21.037169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae06b1-6415-42a7-a19e-d88ae0d1555b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:21.037451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac36d9-9a3a-49da-a66f-6d4b35cbc365 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:21.068473 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:21.142452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c179a23-7928-4734-986e-aa4541091538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:21.143100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c179a23-7928-4734-986e-aa4541091538 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:21.143422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c179a23-7928-4734-986e-aa4541091538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:21.143719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c179a23-7928-4734-986e-aa4541091538 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:21.144364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c179a23-7928-4734-986e-aa4541091538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:21.146378 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c179a23-7928-4734-986e-aa4541091538 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:21.149708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae06b1-6415-42a7-a19e-d88ae0d1555b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:21.151629 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae06b1-6415-42a7-a19e-d88ae0d1555b service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:21.162358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 813/1613] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:21.163250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae06b1-6415-42a7-a19e-d88ae0d1555b service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:21.174877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae06b1-6415-42a7-a19e-d88ae0d1555b service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:21.180186 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae7940-024f-407d-b5c4-84ee3c50eb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:21.180817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae7940-024f-407d-b5c4-84ee3c50eb5e admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:21.181131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae7940-024f-407d-b5c4-84ee3c50eb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:21.181417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae7940-024f-407d-b5c4-84ee3c50eb5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:21.182330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae7940-024f-407d-b5c4-84ee3c50eb5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:21.184691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae7940-024f-407d-b5c4-84ee3c50eb5e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:21.303781 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 801/1614] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:20 2022] POST /identity/v3/users => generated 293 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:21.303781 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c179a23-7928-4734-986e-aa4541091538 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:21.323353 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c179a23-7928-4734-986e-aa4541091538 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:21.328304 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e0d41-47ab-4496-b1d5-d09cb0fcb44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:21.328935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e0d41-47ab-4496-b1d5-d09cb0fcb44d admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:21.329211 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e0d41-47ab-4496-b1d5-d09cb0fcb44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:21.329510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e0d41-47ab-4496-b1d5-d09cb0fcb44d admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:21.330238 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e0d41-47ab-4496-b1d5-d09cb0fcb44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:21.332177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26e0d41-47ab-4496-b1d5-d09cb0fcb44d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:21.387505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 814/1615] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:21 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:21.388878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab44f41-27af-493b-8602-7422c2d8c4ac None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:21.389297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab44f41-27af-493b-8602-7422c2d8c4ac None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:21.389527 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab44f41-27af-493b-8602-7422c2d8c4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:21.412778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-9ab44f41-27af-493b-8602-7422c2d8c4ac None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:21.414169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9ab44f41-27af-493b-8602-7422c2d8c4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:21.492541 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 815/1616] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:21.494538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126d8cd-c791-46fe-a3ea-0c981c75303a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:21.495027 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126d8cd-c791-46fe-a3ea-0c981c75303a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:21.495515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126d8cd-c791-46fe-a3ea-0c981c75303a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:21.506141 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 802/1617] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:21 2022] POST /identity/v3/projects => generated 409 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:21.506141 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e0d41-47ab-4496-b1d5-d09cb0fcb44d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:21.525915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:22.269296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-0126d8cd-c791-46fe-a3ea-0c981c75303a None None] MFA Rules not processed for user `8e6fef07913146ab8531d97525b3c782`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:22.269296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0126d8cd-c791-46fe-a3ea-0c981c75303a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:22.275356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e0d41-47ab-4496-b1d5-d09cb0fcb44d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:22.275356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fffef-53e0-4120-92fa-f77a5d478853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:22.275356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fffef-53e0-4120-92fa-f77a5d478853 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:22.275356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fffef-53e0-4120-92fa-f77a5d478853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:22.276459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66fffef-53e0-4120-92fa-f77a5d478853 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:22.276459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fffef-53e0-4120-92fa-f77a5d478853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:22.276459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66fffef-53e0-4120-92fa-f77a5d478853 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:22.279221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 816/1618] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:22.279221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126d8cd-c791-46fe-a3ea-0c981c75303a None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:22.280036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 803/1619] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:22.280036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fffef-53e0-4120-92fa-f77a5d478853 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:22.280036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d66fffef-53e0-4120-92fa-f77a5d478853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:22.280664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126d8cd-c791-46fe-a3ea-0c981c75303a None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:22.280664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6f185-3d85-4af4-8cd4-97e7a6d0b4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:22.280664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6f185-3d85-4af4-8cd4-97e7a6d0b4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:22.280664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6f185-3d85-4af4-8cd4-97e7a6d0b4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:22.281283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6f185-3d85-4af4-8cd4-97e7a6d0b4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:22.281283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6f185-3d85-4af4-8cd4-97e7a6d0b4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:22.281283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6f185-3d85-4af4-8cd4-97e7a6d0b4d5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:22.285142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66fffef-53e0-4120-92fa-f77a5d478853 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:22.285142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fde90-09da-47db-a52e-5c3a648f42ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:22.285142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fde90-09da-47db-a52e-5c3a648f42ad service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:22.285142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fde90-09da-47db-a52e-5c3a648f42ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:22.286186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fde90-09da-47db-a52e-5c3a648f42ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:22.286186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fde90-09da-47db-a52e-5c3a648f42ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:22.286186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fde90-09da-47db-a52e-5c3a648f42ad service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:22.286186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 804/1620] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:22.286186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fde90-09da-47db-a52e-5c3a648f42ad service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:22.286186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fde90-09da-47db-a52e-5c3a648f42ad service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:22.286885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43268a55-1852-42c8-9342-361f2fb7db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:22.286885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43268a55-1852-42c8-9342-361f2fb7db6d admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:22.286885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43268a55-1852-42c8-9342-361f2fb7db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:22.286885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43268a55-1852-42c8-9342-361f2fb7db6d admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:22.287366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43268a55-1852-42c8-9342-361f2fb7db6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:22.287366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43268a55-1852-42c8-9342-361f2fb7db6d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:22.287606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 817/1621] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:21 2022] POST /identity/v3/users => generated 293 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:22.287606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6f185-3d85-4af4-8cd4-97e7a6d0b4d5 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:22.287606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:22.290113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 805/1622] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:21 2022] POST /identity/v3/users => generated 311 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:22.290113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afea9d-bd43-4eb3-b605-bf1c714c5da0 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:22.290113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afea9d-bd43-4eb3-b605-bf1c714c5da0 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:22.290113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afea9d-bd43-4eb3-b605-bf1c714c5da0 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:22.290507 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6f185-3d85-4af4-8cd4-97e7a6d0b4d5 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:22.290621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 806/1623] 10.222.0.48 () {54 vars in 962 bytes} [Thu Sep 1 05:42:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:42:22.290621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afea9d-bd43-4eb3-b605-bf1c714c5da0 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:22.290875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9db88-0cd8-4a2f-87dd-370e781a540c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:22.290875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9db88-0cd8-4a2f-87dd-370e781a540c admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:22.290875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9db88-0cd8-4a2f-87dd-370e781a540c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:22.291888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9db88-0cd8-4a2f-87dd-370e781a540c admin admin] PATH_INFO: `/v3/projects/c18414ce188a4276b24d7a3f35b429ed/users/e1372ed02b5c4a1088a4383e2d194faa/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:22.292955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afea9d-bd43-4eb3-b605-bf1c714c5da0 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:22.303693 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe96c-72a9-4b73-9558-d8c91e1264ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:22.303886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe96c-72a9-4b73-9558-d8c91e1264ca admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:22.304418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe96c-72a9-4b73-9558-d8c91e1264ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:22.304728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe96c-72a9-4b73-9558-d8c91e1264ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:22.306203 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fe96c-72a9-4b73-9558-d8c91e1264ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:22.309122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fe96c-72a9-4b73-9558-d8c91e1264ca admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:22.312447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9db88-0cd8-4a2f-87dd-370e781a540c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18414ce188a4276b24d7a3f35b429ed, user_id=e1372ed02b5c4a1088a4383e2d194faa, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:22.315774 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9db88-0cd8-4a2f-87dd-370e781a540c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:22.330738 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 807/1624] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:22.330738 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe96c-72a9-4b73-9558-d8c91e1264ca admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:22.342470 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe96c-72a9-4b73-9558-d8c91e1264ca admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:22.348622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8281ac-7652-4e80-9b38-fc168e0d1168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:22.349255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8281ac-7652-4e80-9b38-fc168e0d1168 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:22.349569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8281ac-7652-4e80-9b38-fc168e0d1168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:22.349874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8281ac-7652-4e80-9b38-fc168e0d1168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:22.350501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8281ac-7652-4e80-9b38-fc168e0d1168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:22.352103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8281ac-7652-4e80-9b38-fc168e0d1168 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:22.363928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 808/1625] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:22.367512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5ccc1-b040-4a64-b70d-869fecc5cd52 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:22.367512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5ccc1-b040-4a64-b70d-869fecc5cd52 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:22.367512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5ccc1-b040-4a64-b70d-869fecc5cd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:22.412788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ced5ccc1-b040-4a64-b70d-869fecc5cd52 None None] MFA Rules not processed for user `b7e84a5652df4d64aa1fd28f3d5383fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:22.414220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ced5ccc1-b040-4a64-b70d-869fecc5cd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:22.490629 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 818/1626] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:22 2022] PUT /identity/v3/projects/c18414ce188a4276b24d7a3f35b429ed/users/e1372ed02b5c4a1088a4383e2d194faa/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:22.491227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9db88-0cd8-4a2f-87dd-370e781a540c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:22.525920 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 809/1627] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Sep 1 05:42:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:22.526822 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5ccc1-b040-4a64-b70d-869fecc5cd52 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:22.538496 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5ccc1-b040-4a64-b70d-869fecc5cd52 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:22.574275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9db88-0cd8-4a2f-87dd-370e781a540c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:22.580041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a827e-a170-4952-a84d-1e692a2992a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:22.580832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a827e-a170-4952-a84d-1e692a2992a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:22.581434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a827e-a170-4952-a84d-1e692a2992a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:22.581677 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a827e-a170-4952-a84d-1e692a2992a2 admin admin] PATH_INFO: `/v3/projects/c70f5dbadebc41b1bdaa527280f8e677/users/415a127791c5438d9f9ddcf6ad3cd6b2/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:22.604716 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c32db-0a33-4bb4-9400-e0dc56358ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:22.605455 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c32db-0a33-4bb4-9400-e0dc56358ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:22.605741 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c32db-0a33-4bb4-9400-e0dc56358ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:22.606019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c32db-0a33-4bb4-9400-e0dc56358ce9 admin admin] PATH_INFO: `/v3/projects/029f9834e81149c596375a1c3f0788f6/users/d8bb2d6c402049898afd3505fff61cd4/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:22.608346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a827e-a170-4952-a84d-1e692a2992a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70f5dbadebc41b1bdaa527280f8e677, user_id=415a127791c5438d9f9ddcf6ad3cd6b2, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:22.611106 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a827e-a170-4952-a84d-1e692a2992a2 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:22.623598 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c32db-0a33-4bb4-9400-e0dc56358ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029f9834e81149c596375a1c3f0788f6, user_id=d8bb2d6c402049898afd3505fff61cd4, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:22.626309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c32db-0a33-4bb4-9400-e0dc56358ce9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:22.782422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 819/1628] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:22 2022] PUT /identity/v3/projects/c70f5dbadebc41b1bdaa527280f8e677/users/415a127791c5438d9f9ddcf6ad3cd6b2/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:22.784783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a827e-a170-4952-a84d-1e692a2992a2 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:22.827323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:22.833950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 810/1629] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:22 2022] PUT /identity/v3/projects/029f9834e81149c596375a1c3f0788f6/users/d8bb2d6c402049898afd3505fff61cd4/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:22.834913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c32db-0a33-4bb4-9400-e0dc56358ce9 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:22.967423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a827e-a170-4952-a84d-1e692a2992a2 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:23.058948 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c32db-0a33-4bb4-9400-e0dc56358ce9 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:23.071056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d080c-6db5-4472-9b5a-35bd751015ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:23.071701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d080c-6db5-4472-9b5a-35bd751015ea service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.071982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d080c-6db5-4472-9b5a-35bd751015ea service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.072380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d080c-6db5-4472-9b5a-35bd751015ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.176877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bae07-49e3-42aa-8b68-345cde816b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:23.177967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bae07-49e3-42aa-8b68-345cde816b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.178208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bae07-49e3-42aa-8b68-345cde816b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.178613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bae07-49e3-42aa-8b68-345cde816b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.179441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bae07-49e3-42aa-8b68-345cde816b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:23.183558 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bae07-49e3-42aa-8b68-345cde816b83 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:23.205708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 820/1630] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:23.210095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bae07-49e3-42aa-8b68-345cde816b83 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:23.214958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d080c-6db5-4472-9b5a-35bd751015ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:23.214958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d080c-6db5-4472-9b5a-35bd751015ea service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:23.223525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bae07-49e3-42aa-8b68-345cde816b83 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:23.224041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 811/1631] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:23.225225 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d080c-6db5-4472-9b5a-35bd751015ea service nova] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:23.228338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d2773-a7a1-403f-bf69-7232493e2717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:23.229898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2773-a7a1-403f-bf69-7232493e2717 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.230439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2773-a7a1-403f-bf69-7232493e2717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.230820 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d2773-a7a1-403f-bf69-7232493e2717 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.231593 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d2773-a7a1-403f-bf69-7232493e2717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:23.236587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d2773-a7a1-403f-bf69-7232493e2717 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:23.243704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d080c-6db5-4472-9b5a-35bd751015ea service nova] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:23.252135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640e74f-d6fe-4b07-9cfd-8c2729e4a156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:23.253088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640e74f-d6fe-4b07-9cfd-8c2729e4a156 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.253584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640e74f-d6fe-4b07-9cfd-8c2729e4a156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.254027 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640e74f-d6fe-4b07-9cfd-8c2729e4a156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.255080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640e74f-d6fe-4b07-9cfd-8c2729e4a156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:23.255990 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 821/1632] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:23.258083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4787e9-536c-4432-813d-8dbff1a52a18 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.258703 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4787e9-536c-4432-813d-8dbff1a52a18 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.259187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4787e9-536c-4432-813d-8dbff1a52a18 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.262668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 822/1633] 10.222.0.48 () {54 vars in 962 bytes} [Thu Sep 1 05:42:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:42:23.266136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4787e9-536c-4432-813d-8dbff1a52a18 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:23.270853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640e74f-d6fe-4b07-9cfd-8c2729e4a156 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:23.287566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4787e9-536c-4432-813d-8dbff1a52a18 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:23.297840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 812/1634] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:23.297840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640e74f-d6fe-4b07-9cfd-8c2729e4a156 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:23.298938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615409b-7263-4a4d-8b51-bdeef40b3015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:23.299861 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615409b-7263-4a4d-8b51-bdeef40b3015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.300357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615409b-7263-4a4d-8b51-bdeef40b3015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.300838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615409b-7263-4a4d-8b51-bdeef40b3015 admin admin] PATH_INFO: `/v3/projects/c18414ce188a4276b24d7a3f35b429ed/users/e1372ed02b5c4a1088a4383e2d194faa/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.303511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615409b-7263-4a4d-8b51-bdeef40b3015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18414ce188a4276b24d7a3f35b429ed, user_id=e1372ed02b5c4a1088a4383e2d194faa, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:23.307373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615409b-7263-4a4d-8b51-bdeef40b3015 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:23.321242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640e74f-d6fe-4b07-9cfd-8c2729e4a156 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:23.333202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 823/1635] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:23 2022] PUT /identity/v3/projects/c18414ce188a4276b24d7a3f35b429ed/users/e1372ed02b5c4a1088a4383e2d194faa/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:23.335077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9792ee-aa95-4313-abc2-cb68124a993e None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.335634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9792ee-aa95-4313-abc2-cb68124a993e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.336123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9792ee-aa95-4313-abc2-cb68124a993e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.364282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-6a9792ee-aa95-4313-abc2-cb68124a993e None None] MFA Rules not processed for user `b7e84a5652df4d64aa1fd28f3d5383fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:23.366729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6a9792ee-aa95-4313-abc2-cb68124a993e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:23.442250 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cee5b-dc4d-41be-8bb3-5df8fa5b0194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:23.443010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cee5b-dc4d-41be-8bb3-5df8fa5b0194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.443282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cee5b-dc4d-41be-8bb3-5df8fa5b0194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.443560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cee5b-dc4d-41be-8bb3-5df8fa5b0194 admin admin] PATH_INFO: `/v3/projects/c70f5dbadebc41b1bdaa527280f8e677/users/415a127791c5438d9f9ddcf6ad3cd6b2/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.446157 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cee5b-dc4d-41be-8bb3-5df8fa5b0194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70f5dbadebc41b1bdaa527280f8e677, user_id=415a127791c5438d9f9ddcf6ad3cd6b2, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:23.462921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cee5b-dc4d-41be-8bb3-5df8fa5b0194 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:23.500578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 813/1636] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:23 2022] PUT /identity/v3/projects/c70f5dbadebc41b1bdaa527280f8e677/users/415a127791c5438d9f9ddcf6ad3cd6b2/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:23.501661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cee5b-dc4d-41be-8bb3-5df8fa5b0194 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:23.504706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 824/1637] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Sep 1 05:42:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:23.506460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d980ba-47f7-4645-b474-baadeb6dd139 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.506892 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d980ba-47f7-4645-b474-baadeb6dd139 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.507619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d980ba-47f7-4645-b474-baadeb6dd139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.574058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-f8d980ba-47f7-4645-b474-baadeb6dd139 None None] MFA Rules not processed for user `e1372ed02b5c4a1088a4383e2d194faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:23.576145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f8d980ba-47f7-4645-b474-baadeb6dd139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:23.611743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:23.616242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cee5b-dc4d-41be-8bb3-5df8fa5b0194 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:23.622553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f9cb0-4499-45e0-b5e5-b140ba211a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:23.625713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f9cb0-4499-45e0-b5e5-b140ba211a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.625713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f9cb0-4499-45e0-b5e5-b140ba211a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.625713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f9cb0-4499-45e0-b5e5-b140ba211a41 admin admin] PATH_INFO: `/v3/projects/029f9834e81149c596375a1c3f0788f6/users/d8bb2d6c402049898afd3505fff61cd4/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.625947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f9cb0-4499-45e0-b5e5-b140ba211a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029f9834e81149c596375a1c3f0788f6, user_id=d8bb2d6c402049898afd3505fff61cd4, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:23.628737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f9cb0-4499-45e0-b5e5-b140ba211a41 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:23.649719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 814/1638] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:23 2022] PUT /identity/v3/projects/029f9834e81149c596375a1c3f0788f6/users/d8bb2d6c402049898afd3505fff61cd4/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:23.649719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b691a-0497-4a84-8e1f-af08167316b0 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.649719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b691a-0497-4a84-8e1f-af08167316b0 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.649719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b691a-0497-4a84-8e1f-af08167316b0 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.649719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 815/1639] 10.222.0.48 () {54 vars in 912 bytes} [Thu Sep 1 05:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:42:23.649719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d070ec-6d9b-4812-8dbb-cc9af5301235 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.651852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d070ec-6d9b-4812-8dbb-cc9af5301235 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.651852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d070ec-6d9b-4812-8dbb-cc9af5301235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.686535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-27d070ec-6d9b-4812-8dbb-cc9af5301235 None None] MFA Rules not processed for user `415a127791c5438d9f9ddcf6ad3cd6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:23.687980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-27d070ec-6d9b-4812-8dbb-cc9af5301235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:23.747639 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 825/1640] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:23.749559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160101c-a2a6-45d3-bd9e-ea70aa8c8153 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.750107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160101c-a2a6-45d3-bd9e-ea70aa8c8153 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.750787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160101c-a2a6-45d3-bd9e-ea70aa8c8153 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.758184 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 826/1641] 10.222.0.48 () {54 vars in 912 bytes} [Thu Sep 1 05:42:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:42:23.758184 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2141b6-ecab-4daf-806a-100426740e0a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.758184 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2141b6-ecab-4daf-806a-100426740e0a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.758184 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2141b6-ecab-4daf-806a-100426740e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.796898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-7d2141b6-ecab-4daf-806a-100426740e0a None None] MFA Rules not processed for user `d8bb2d6c402049898afd3505fff61cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:23.798602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7d2141b6-ecab-4daf-806a-100426740e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:23.803690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 816/1642] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:23.805625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee828be0-f275-4d9d-bd94-3bf271223e01 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.806233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee828be0-f275-4d9d-bd94-3bf271223e01 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.806338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee828be0-f275-4d9d-bd94-3bf271223e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.836439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ee828be0-f275-4d9d-bd94-3bf271223e01 None None] MFA Rules not processed for user `b7e84a5652df4d64aa1fd28f3d5383fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:23.838164 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ee828be0-f275-4d9d-bd94-3bf271223e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:23.915182 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 817/1643] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:42:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:23.917292 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2fd6d-9bc8-4fa4-ba01-91d168399d20 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:23.917649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2fd6d-9bc8-4fa4-ba01-91d168399d20 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:23.917922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2fd6d-9bc8-4fa4-ba01-91d168399d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:23.938999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 827/1644] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:23 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:23.939950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-8aa2fd6d-9bc8-4fa4-ba01-91d168399d20 None None] MFA Rules not processed for user `b7e84a5652df4d64aa1fd28f3d5383fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:23.940065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2141b6-ecab-4daf-806a-100426740e0a None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:23.941357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8aa2fd6d-9bc8-4fa4-ba01-91d168399d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:23.962272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 818/1645] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:42:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:23.963442 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2fd6d-9bc8-4fa4-ba01-91d168399d20 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:24.051782 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2141b6-ecab-4daf-806a-100426740e0a None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:24.058364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c450f-34a9-4512-b044-1a162fa73143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:24.060145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c450f-34a9-4512-b044-1a162fa73143 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:24.060591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c450f-34a9-4512-b044-1a162fa73143 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:24.061026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c450f-34a9-4512-b044-1a162fa73143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:24.063362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2fd6d-9bc8-4fa4-ba01-91d168399d20 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:24.076738 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfceedde-015c-4033-ad49-e4879ff3751c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:24.078261 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfceedde-015c-4033-ad49-e4879ff3751c service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:24.080165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfceedde-015c-4033-ad49-e4879ff3751c service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:24.080165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfceedde-015c-4033-ad49-e4879ff3751c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:24.100847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfceedde-015c-4033-ad49-e4879ff3751c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:24.106817 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfceedde-015c-4033-ad49-e4879ff3751c service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:24.144558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 819/1646] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:24.154763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c450f-34a9-4512-b044-1a162fa73143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:24.157402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c450f-34a9-4512-b044-1a162fa73143 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:24.176899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 828/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:24.381610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfceedde-015c-4033-ad49-e4879ff3751c service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:24.392815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfceedde-015c-4033-ad49-e4879ff3751c service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:24.398981 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73539b-cb25-4dc9-8c0a-9bfbe8556d6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:24.402637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73539b-cb25-4dc9-8c0a-9bfbe8556d6e service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:24.402637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73539b-cb25-4dc9-8c0a-9bfbe8556d6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:24.402637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c73539b-cb25-4dc9-8c0a-9bfbe8556d6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:24.405947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c450f-34a9-4512-b044-1a162fa73143 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:24.428038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73539b-cb25-4dc9-8c0a-9bfbe8556d6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:24.428731 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c73539b-cb25-4dc9-8c0a-9bfbe8556d6e service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:24.430205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c450f-34a9-4512-b044-1a162fa73143 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:24.445013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 820/1648] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:24.452100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd171d-815d-4aac-b700-ca903f86ff86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:24.452100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd171d-815d-4aac-b700-ca903f86ff86 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:24.452100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd171d-815d-4aac-b700-ca903f86ff86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:24.452100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd171d-815d-4aac-b700-ca903f86ff86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:24.472716 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd171d-815d-4aac-b700-ca903f86ff86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:24.475633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd171d-815d-4aac-b700-ca903f86ff86 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:24.509817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 829/1649] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:24 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:42:24.566731 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73539b-cb25-4dc9-8c0a-9bfbe8556d6e service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:24.591361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:24.595041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c73539b-cb25-4dc9-8c0a-9bfbe8556d6e service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:24.620203 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7e721-082d-49c4-b1e9-3f762890c521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:24.621415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7e721-082d-49c4-b1e9-3f762890c521 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:24.621901 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7e721-082d-49c4-b1e9-3f762890c521 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:24.622358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7e721-082d-49c4-b1e9-3f762890c521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:24.665727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7e721-082d-49c4-b1e9-3f762890c521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:24.667905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7e721-082d-49c4-b1e9-3f762890c521 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:24.685616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 821/1650] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:26.770369 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:26.961981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd171d-815d-4aac-b700-ca903f86ff86 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:26.982007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd171d-815d-4aac-b700-ca903f86ff86 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:27.001768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20564-b555-4394-b980-8ebab4e7fd0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:27.005102 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20564-b555-4394-b980-8ebab4e7fd0a service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:27.006039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20564-b555-4394-b980-8ebab4e7fd0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:27.006890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d20564-b555-4394-b980-8ebab4e7fd0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:27.233452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d20564-b555-4394-b980-8ebab4e7fd0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:27.235700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d20564-b555-4394-b980-8ebab4e7fd0a service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:27.263074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 830/1651] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:27.301197 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7e721-082d-49c4-b1e9-3f762890c521 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:27.316215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7e721-082d-49c4-b1e9-3f762890c521 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:27.321523 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b562957-386d-4149-af54-a7d77994e3de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:27.322595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b562957-386d-4149-af54-a7d77994e3de service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:27.323234 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b562957-386d-4149-af54-a7d77994e3de service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:27.323759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b562957-386d-4149-af54-a7d77994e3de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:27.372882 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:27.474716 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b562957-386d-4149-af54-a7d77994e3de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:27.476361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b562957-386d-4149-af54-a7d77994e3de service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:27.495757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 822/1652] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:27 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:33.551043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20564-b555-4394-b980-8ebab4e7fd0a service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:33.587742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:33.725228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d20564-b555-4394-b980-8ebab4e7fd0a service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:33.735947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:33.737957 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:33.739330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:33.739330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] PATH_INFO: `/v3/users/84835f1dbde4440e82ff4c3e183d9249` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:33.745465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84835f1dbde4440e82ff4c3e183d9249)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:33.747322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: WARNING py.warnings [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:42:33.747322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: warnings.warn(msg) Sep 01 05:42:33.747322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: Sep 01 05:42:33.750399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:33.768037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25affd16-69ed-45c8-a821-d6eae20fab94 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:33.768636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25affd16-69ed-45c8-a821-d6eae20fab94 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:33.768636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25affd16-69ed-45c8-a821-d6eae20fab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:33.862939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-25affd16-69ed-45c8-a821-d6eae20fab94 None None] MFA Rules not processed for user `2954a215b049442cbd481f1f3ecab1db`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:33.864305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-25affd16-69ed-45c8-a821-d6eae20fab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:33.883820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:34.046031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 823/1653] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:42:34.061348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe21045-8d91-4838-ab92-3a4cfa9d7b43 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:34.061887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe21045-8d91-4838-ab92-3a4cfa9d7b43 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:34.063363 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe21045-8d91-4838-ab92-3a4cfa9d7b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:34.132394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-8fe21045-8d91-4838-ab92-3a4cfa9d7b43 None None] MFA Rules not processed for user `2954a215b049442cbd481f1f3ecab1db`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:34.136223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8fe21045-8d91-4838-ab92-3a4cfa9d7b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:34.176952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 824/1654] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:34.193820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe21045-8d91-4838-ab92-3a4cfa9d7b43 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:34.228985 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe21045-8d91-4838-ab92-3a4cfa9d7b43 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:34.241330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33a122-88e6-4de9-b6c1-b2bd53767dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:34.242220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33a122-88e6-4de9-b6c1-b2bd53767dc4 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:34.242771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33a122-88e6-4de9-b6c1-b2bd53767dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:34.243221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33a122-88e6-4de9-b6c1-b2bd53767dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:34.277753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33a122-88e6-4de9-b6c1-b2bd53767dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:34.279397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33a122-88e6-4de9-b6c1-b2bd53767dc4 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:34.294640 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84835f1dbde4440e82ff4c3e183d9249'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:34.317544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 825/1655] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:42:34.363784 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84835f1dbde4440e82ff4c3e183d9249'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:34.395686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84835f1dbde4440e82ff4c3e183d9249'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:34.536675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84835f1dbde4440e82ff4c3e183d9249'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:34.537353 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84835f1dbde4440e82ff4c3e183d9249'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:34.567597 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 831/1656] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:42:33 2022] DELETE /identity/v3/users/84835f1dbde4440e82ff4c3e183d9249 => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:34.575103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ef3a-84e1-47a6-bd12-8a9eacf26614 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:34.575390 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ef3a-84e1-47a6-bd12-8a9eacf26614 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:34.575727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3ef3a-84e1-47a6-bd12-8a9eacf26614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:34.659829 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-15a3ef3a-84e1-47a6-bd12-8a9eacf26614 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:34.661251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-15a3ef3a-84e1-47a6-bd12-8a9eacf26614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:35.063312 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 826/1657] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:35.260518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:35.264760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:35.430561 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a4640-1e3f-4a07-8233-29fa2e6289a4 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:35.435700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095847f6-219e-4df7-991d-00acea0ad4a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:35.437111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095847f6-219e-4df7-991d-00acea0ad4a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:35.437111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095847f6-219e-4df7-991d-00acea0ad4a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:35.437111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095847f6-219e-4df7-991d-00acea0ad4a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:35.448192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095847f6-219e-4df7-991d-00acea0ad4a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:35.449782 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095847f6-219e-4df7-991d-00acea0ad4a5 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:35.463807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 832/1658] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:35.649720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0add1-74b0-4602-b0ec-432aae50e1a8 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:35.651872 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0add1-74b0-4602-b0ec-432aae50e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:35.652474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0add1-74b0-4602-b0ec-432aae50e1a8 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:35.655636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 827/1659] 10.222.0.48 () {54 vars in 912 bytes} [Thu Sep 1 05:42:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:42:35.661033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c010e9-42e2-45ea-bc06-287e2f46125c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:35.661893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c010e9-42e2-45ea-bc06-287e2f46125c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:35.662067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c010e9-42e2-45ea-bc06-287e2f46125c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-43c010e9-42e2-45ea-bc06-287e2f46125c None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:42:35.673532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:42:35.675123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:42:35.680051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 833/1660] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:42:35 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 20 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 01 05:42:35.956039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9188c-fc3c-4721-839e-a80dbfd372ed None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:35.956326 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9188c-fc3c-4721-839e-a80dbfd372ed None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:35.959930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9188c-fc3c-4721-839e-a80dbfd372ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:36.040376 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-9bb9188c-fc3c-4721-839e-a80dbfd372ed None None] MFA Rules not processed for user `bc8972d8bcec4e779a95a3b698641198`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:36.042915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9bb9188c-fc3c-4721-839e-a80dbfd372ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:36.271184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 828/1661] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:36.577080 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c010e9-42e2-45ea-bc06-287e2f46125c None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:36.579502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-43c010e9-42e2-45ea-bc06-287e2f46125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:36.714283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:36.765869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c010e9-42e2-45ea-bc06-287e2f46125c None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:36.778356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eafde-234c-4c56-aecf-e64e8673eaa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:36.779250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eafde-234c-4c56-aecf-e64e8673eaa7 service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:36.779679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eafde-234c-4c56-aecf-e64e8673eaa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:36.780322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eafde-234c-4c56-aecf-e64e8673eaa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:36.792065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eafde-234c-4c56-aecf-e64e8673eaa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:36.794111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eafde-234c-4c56-aecf-e64e8673eaa7 service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:36.805264 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 834/1662] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:37.748820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9188c-fc3c-4721-839e-a80dbfd372ed None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:37.750190 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9bb9188c-fc3c-4721-839e-a80dbfd372ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:37.791278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9188c-fc3c-4721-839e-a80dbfd372ed None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:37.800635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:37.801623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:37.803294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:37.803896 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] PATH_INFO: `/v3/projects/bd64a5d521704c46b89c6e7a7adde71a` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:37.805881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd64a5d521704c46b89c6e7a7adde71a)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:37.807805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: WARNING py.warnings [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:42:37.807805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: warnings.warn(msg) Sep 01 05:42:37.807805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: Sep 01 05:42:37.810260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:37.839788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:37.839950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79229d3-4951-4b40-8618-53d7e9879da5 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:37.839950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79229d3-4951-4b40-8618-53d7e9879da5 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:37.839950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79229d3-4951-4b40-8618-53d7e9879da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:37.928593 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-a79229d3-4951-4b40-8618-53d7e9879da5 None None] MFA Rules not processed for user `5b1e6a1c0fe345bbbbe9c4a4a91f355a`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:37.930650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a79229d3-4951-4b40-8618-53d7e9879da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:38.117204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd64a5d521704c46b89c6e7a7adde71a', 'request_id': 'req-951c7e71-cc7e-42bd-9739-8439765214da'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:38.130921 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 835/1663] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:38.143593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd64a5d521704c46b89c6e7a7adde71a', 'request_id': 'req-951c7e71-cc7e-42bd-9739-8439765214da'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:38.146709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb1e79-f085-40a1-a5d8-3ce301c229aa None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:38.147244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb1e79-f085-40a1-a5d8-3ce301c229aa None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:38.147762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb1e79-f085-40a1-a5d8-3ce301c229aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:38.204624 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-64fb1e79-f085-40a1-a5d8-3ce301c229aa None None] MFA Rules not processed for user `5b1e6a1c0fe345bbbbe9c4a4a91f355a`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:38.207341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-64fb1e79-f085-40a1-a5d8-3ce301c229aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:38.322816 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 836/1664] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:38.325356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd64a5d521704c46b89c6e7a7adde71a', 'request_id': 'req-951c7e71-cc7e-42bd-9739-8439765214da'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:38.336375 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb1e79-f085-40a1-a5d8-3ce301c229aa None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:38.350736 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] The token cache is being invalidate because project bd64a5d521704c46b89c6e7a7adde71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:42:38.354054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:38.355324 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:38.359743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 829/1665] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:42:37 2022] DELETE /identity/v3/projects/bd64a5d521704c46b89c6e7a7adde71a => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:38.361181 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:38.363348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:38.490334 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c7e71-cc7e-42bd-9739-8439765214da admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:38.490752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb1e79-f085-40a1-a5d8-3ce301c229aa None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:38.498859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9112b8-f783-44e4-8532-ab3621387196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:38.500546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9112b8-f783-44e4-8532-ab3621387196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:38.500933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9112b8-f783-44e4-8532-ab3621387196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:38.501470 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9112b8-f783-44e4-8532-ab3621387196 admin admin] PATH_INFO: `/v3/users/415a127791c5438d9f9ddcf6ad3cd6b2` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:38.502803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9112b8-f783-44e4-8532-ab3621387196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=415a127791c5438d9f9ddcf6ad3cd6b2)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:38.502991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b356d-e4e8-4790-a81a-d2fb1eb46507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:38.503636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b356d-e4e8-4790-a81a-d2fb1eb46507 service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:38.503925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b356d-e4e8-4790-a81a-d2fb1eb46507 service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:38.505641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b356d-e4e8-4790-a81a-d2fb1eb46507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:38.506674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9112b8-f783-44e4-8532-ab3621387196 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:38.507700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a58b356d-e4e8-4790-a81a-d2fb1eb46507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:38.527084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b356d-e4e8-4790-a81a-d2fb1eb46507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:38.530165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b356d-e4e8-4790-a81a-d2fb1eb46507 service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:38.549529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 837/1666] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:38.983835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b356d-e4e8-4790-a81a-d2fb1eb46507 service nova] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:38.985508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a58b356d-e4e8-4790-a81a-d2fb1eb46507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:38.988330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1e9112b8-f783-44e4-8532-ab3621387196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '415a127791c5438d9f9ddcf6ad3cd6b2'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:39.012689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1e9112b8-f783-44e4-8532-ab3621387196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '415a127791c5438d9f9ddcf6ad3cd6b2'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:39.035561 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b356d-e4e8-4790-a81a-d2fb1eb46507 service nova] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:39.053030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:39.053722 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:39.054001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:39.054271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] PATH_INFO: `/v3/users/8e6fef07913146ab8531d97525b3c782` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:39.057504 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6fef07913146ab8531d97525b3c782)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:39.059948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:39.130575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1e9112b8-f783-44e4-8532-ab3621387196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '415a127791c5438d9f9ddcf6ad3cd6b2'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:39.153933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1e9112b8-f783-44e4-8532-ab3621387196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '415a127791c5438d9f9ddcf6ad3cd6b2'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:39.153933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1e9112b8-f783-44e4-8532-ab3621387196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '415a127791c5438d9f9ddcf6ad3cd6b2'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:39.194129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 830/1667] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:42:38 2022] DELETE /identity/v3/users/415a127791c5438d9f9ddcf6ad3cd6b2 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:39.427405 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713fd8-3c07-44f8-b068-f7788b19e5ce None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:39.428124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713fd8-3c07-44f8-b068-f7788b19e5ce None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:39.429138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713fd8-3c07-44f8-b068-f7788b19e5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-47713fd8-3c07-44f8-b068-f7788b19e5ce None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:42:39.473337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:42:39.474275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:42:39.483825 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 831/1668] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:42:39 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 58 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 01 05:42:39.522221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6fef07913146ab8531d97525b3c782'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:39.574819 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6fef07913146ab8531d97525b3c782'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:39.596145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6fef07913146ab8531d97525b3c782'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:39.777776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6fef07913146ab8531d97525b3c782'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:39.779559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6fef07913146ab8531d97525b3c782'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:39.818088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 838/1669] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:42:38 2022] DELETE /identity/v3/users/8e6fef07913146ab8531d97525b3c782 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:42:39.833461 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e1e62-6b51-4088-982c-9c399dfc61f2 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:39.834251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e1e62-6b51-4088-982c-9c399dfc61f2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:39.844070 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e1e62-6b51-4088-982c-9c399dfc61f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:39.910626 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-e24e1e62-6b51-4088-982c-9c399dfc61f2 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:39.911977 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e24e1e62-6b51-4088-982c-9c399dfc61f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:39.953175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:40.150638 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 832/1670] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:40.213990 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:40.216260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:40.422146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc0287-3d19-4961-9d37-1a148f3a4045 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:40.426334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61e85b-9b9b-4996-8040-ba2f1793714c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:40.427341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61e85b-9b9b-4996-8040-ba2f1793714c service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:40.427756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61e85b-9b9b-4996-8040-ba2f1793714c service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:40.428218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61e85b-9b9b-4996-8040-ba2f1793714c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:40.462568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61e85b-9b9b-4996-8040-ba2f1793714c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:40.464411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61e85b-9b9b-4996-8040-ba2f1793714c service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:40.489971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 839/1671] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:42:40.700632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e1e62-6b51-4088-982c-9c399dfc61f2 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:40.704009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e24e1e62-6b51-4088-982c-9c399dfc61f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:40.752561 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e1e62-6b51-4088-982c-9c399dfc61f2 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:40.777279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:40.778006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:40.778261 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:40.779713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93 admin admin] PATH_INFO: `/v3/projects/c70f5dbadebc41b1bdaa527280f8e677` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:40.781103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70f5dbadebc41b1bdaa527280f8e677)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:40.784090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:40.948234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61e85b-9b9b-4996-8040-ba2f1793714c service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:40.953565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6c61e85b-9b9b-4996-8040-ba2f1793714c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:41.006742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61e85b-9b9b-4996-8040-ba2f1793714c service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:41.013569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73b0fb-d072-4756-967f-36289a9a8bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:41.014264 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73b0fb-d072-4756-967f-36289a9a8bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:41.014906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73b0fb-d072-4756-967f-36289a9a8bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:41.015340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73b0fb-d072-4756-967f-36289a9a8bb6 admin admin] PATH_INFO: `/v3/users/a73ccaf0509d4354bb038dea3d1fb40c` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:41.017793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73b0fb-d072-4756-967f-36289a9a8bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73ccaf0509d4354bb038dea3d1fb40c)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:41.021941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73b0fb-d072-4756-967f-36289a9a8bb6 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:41.062758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70f5dbadebc41b1bdaa527280f8e677', 'request_id': 'req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:41.082020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70f5dbadebc41b1bdaa527280f8e677', 'request_id': 'req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:41.338793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70f5dbadebc41b1bdaa527280f8e677', 'request_id': 'req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:41.367354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93 admin admin] The token cache is being invalidate because project c70f5dbadebc41b1bdaa527280f8e677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:42:41.368364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:41.370490 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-74d19d77-787e-4557-8d2f-9bd0e4f0aa93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:41.374222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 833/1672] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:42:40 2022] DELETE /identity/v3/projects/c70f5dbadebc41b1bdaa527280f8e677 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:41.384879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd82af-88f7-4963-9376-efc8c35c5a22 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:41.385984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd82af-88f7-4963-9376-efc8c35c5a22 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:41.386687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd82af-88f7-4963-9376-efc8c35c5a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:41.434832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-84bd82af-88f7-4963-9376-efc8c35c5a22 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:41.438119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-84bd82af-88f7-4963-9376-efc8c35c5a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:41.522513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6d73b0fb-d072-4756-967f-36289a9a8bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73ccaf0509d4354bb038dea3d1fb40c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:41.553059 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6d73b0fb-d072-4756-967f-36289a9a8bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73ccaf0509d4354bb038dea3d1fb40c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:41.569539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 834/1673] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:41.574588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da299f-6396-4193-8cef-241c96448d3a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:41.575203 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da299f-6396-4193-8cef-241c96448d3a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:41.576942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da299f-6396-4193-8cef-241c96448d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:41.586919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6d73b0fb-d072-4756-967f-36289a9a8bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73ccaf0509d4354bb038dea3d1fb40c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:41.635509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-88da299f-6396-4193-8cef-241c96448d3a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:41.639773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-88da299f-6396-4193-8cef-241c96448d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:41.652348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 835/1674] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:41.653687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da299f-6396-4193-8cef-241c96448d3a None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:41.665198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da299f-6396-4193-8cef-241c96448d3a None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:41.670970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12776909-eb48-43b9-a969-46c194d97f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:41.671971 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12776909-eb48-43b9-a969-46c194d97f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:41.672802 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12776909-eb48-43b9-a969-46c194d97f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:41.674372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12776909-eb48-43b9-a969-46c194d97f5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:41.677436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12776909-eb48-43b9-a969-46c194d97f5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:41.678183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12776909-eb48-43b9-a969-46c194d97f5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:41.680736 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12776909-eb48-43b9-a969-46c194d97f5c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:41.704272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 836/1675] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:41.706571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12776909-eb48-43b9-a969-46c194d97f5c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:41.723579 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12776909-eb48-43b9-a969-46c194d97f5c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:41.736813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d8646-3cd4-4ac0-8031-75cc8eb0a4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:41.738222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d8646-3cd4-4ac0-8031-75cc8eb0a4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:41.741491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d8646-3cd4-4ac0-8031-75cc8eb0a4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:41.742338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d8646-3cd4-4ac0-8031-75cc8eb0a4b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:41.745210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d8646-3cd4-4ac0-8031-75cc8eb0a4b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:41.749799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d8646-3cd4-4ac0-8031-75cc8eb0a4b8 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:41.771517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6d73b0fb-d072-4756-967f-36289a9a8bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73ccaf0509d4354bb038dea3d1fb40c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:41.772556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6d73b0fb-d072-4756-967f-36289a9a8bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73ccaf0509d4354bb038dea3d1fb40c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:41.801784 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 840/1676] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:42:40 2022] DELETE /identity/v3/users/a73ccaf0509d4354bb038dea3d1fb40c => generated 0 bytes in 856 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:41.810018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ff1a7-bc7e-4a58-99b8-234bbe954fd8 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:41.828140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ff1a7-bc7e-4a58-99b8-234bbe954fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:41.829202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ff1a7-bc7e-4a58-99b8-234bbe954fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:41.897872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-e51ff1a7-bc7e-4a58-99b8-234bbe954fd8 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:41.900879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e51ff1a7-bc7e-4a58-99b8-234bbe954fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:41.950270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:42.000436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 841/1677] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:42.006223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 837/1678] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:41 2022] POST /identity/v3/projects => generated 389 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:42.014026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ff1a7-bc7e-4a58-99b8-234bbe954fd8 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:42.017287 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e51ff1a7-bc7e-4a58-99b8-234bbe954fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:42.073308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ff1a7-bc7e-4a58-99b8-234bbe954fd8 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:42.120419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d8646-3cd4-4ac0-8031-75cc8eb0a4b8 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:42.127531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-125d8646-3cd4-4ac0-8031-75cc8eb0a4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:42.281666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242304ca-f775-4bc0-b68d-4641a2f2c673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:42.282357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242304ca-f775-4bc0-b68d-4641a2f2c673 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:42.282686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242304ca-f775-4bc0-b68d-4641a2f2c673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:42.283335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242304ca-f775-4bc0-b68d-4641a2f2c673 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:42.285066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242304ca-f775-4bc0-b68d-4641a2f2c673 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:42.291028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242304ca-f775-4bc0-b68d-4641a2f2c673 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:42.355557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d8646-3cd4-4ac0-8031-75cc8eb0a4b8 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:42.364324 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7de456-49c6-471a-9652-04b2f019cd46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:42.368287 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de456-49c6-471a-9652-04b2f019cd46 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:42.369135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de456-49c6-471a-9652-04b2f019cd46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:42.369447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7de456-49c6-471a-9652-04b2f019cd46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:42.396349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7de456-49c6-471a-9652-04b2f019cd46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:42.401538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7de456-49c6-471a-9652-04b2f019cd46 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:42.442047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 838/1679] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:42.450671 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 842/1680] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:42 2022] POST /identity/v3/users => generated 295 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:42.463153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7de456-49c6-471a-9652-04b2f019cd46 service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:42.503581 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7de456-49c6-471a-9652-04b2f019cd46 service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:42.529540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930e9dd-0da5-420e-a15c-f779cb56b8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:42.530277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930e9dd-0da5-420e-a15c-f779cb56b8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:42.530684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930e9dd-0da5-420e-a15c-f779cb56b8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:42.530965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930e9dd-0da5-420e-a15c-f779cb56b8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:42.531627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930e9dd-0da5-420e-a15c-f779cb56b8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:42.534835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930e9dd-0da5-420e-a15c-f779cb56b8e0 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:42.548818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 839/1681] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:42.554362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242304ca-f775-4bc0-b68d-4641a2f2c673 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:42.569943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242304ca-f775-4bc0-b68d-4641a2f2c673 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:42.583086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930e9dd-0da5-420e-a15c-f779cb56b8e0 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:42.586056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4930e9dd-0da5-420e-a15c-f779cb56b8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:42.599413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff310ed6-0bfc-4848-9b35-c72b81228945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:42.604201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff310ed6-0bfc-4848-9b35-c72b81228945 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:42.605022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff310ed6-0bfc-4848-9b35-c72b81228945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:42.606284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff310ed6-0bfc-4848-9b35-c72b81228945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:42.609142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff310ed6-0bfc-4848-9b35-c72b81228945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:42.615475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff310ed6-0bfc-4848-9b35-c72b81228945 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:42.622389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930e9dd-0da5-420e-a15c-f779cb56b8e0 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:42.651564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639a18-3d49-4f87-89b0-02a03596bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:42.651564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639a18-3d49-4f87-89b0-02a03596bf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:42.651564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639a18-3d49-4f87-89b0-02a03596bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:42.651564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639a18-3d49-4f87-89b0-02a03596bf7a admin admin] PATH_INFO: `/v3/users/a23e62b60327455bb078b9cf29ad7032` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:42.657487 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25639a18-3d49-4f87-89b0-02a03596bf7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23e62b60327455bb078b9cf29ad7032)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:42.669151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25639a18-3d49-4f87-89b0-02a03596bf7a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:42.670536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 843/1682] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:42:42.677909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff310ed6-0bfc-4848-9b35-c72b81228945 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:42.709222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff310ed6-0bfc-4848-9b35-c72b81228945 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:42.726181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06386525-238f-4907-a39b-aeb6fffc0c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:42.727162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06386525-238f-4907-a39b-aeb6fffc0c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:42.727600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06386525-238f-4907-a39b-aeb6fffc0c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:42.728754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06386525-238f-4907-a39b-aeb6fffc0c37 admin admin] PATH_INFO: `/v3/projects/5c89de6a53944a0b8e58d5aedf75a6b9/users/5465709c2f354ea68f4d99e2d2a954e7/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:42.766005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06386525-238f-4907-a39b-aeb6fffc0c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c89de6a53944a0b8e58d5aedf75a6b9, user_id=5465709c2f354ea68f4d99e2d2a954e7, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:42.769894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06386525-238f-4907-a39b-aeb6fffc0c37 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:42.934257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 844/1683] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:42 2022] PUT /identity/v3/projects/5c89de6a53944a0b8e58d5aedf75a6b9/users/5465709c2f354ea68f4d99e2d2a954e7/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:42.962610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd8014-6bde-459c-95cd-838c088fdaca None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:42.968832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd8014-6bde-459c-95cd-838c088fdaca None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:42.968832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd8014-6bde-459c-95cd-838c088fdaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:43.160373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-32dd8014-6bde-459c-95cd-838c088fdaca None None] MFA Rules not processed for user `5465709c2f354ea68f4d99e2d2a954e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:43.162231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-32dd8014-6bde-459c-95cd-838c088fdaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:43.220282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-25639a18-3d49-4f87-89b0-02a03596bf7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23e62b60327455bb078b9cf29ad7032'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:43.264456 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-25639a18-3d49-4f87-89b0-02a03596bf7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23e62b60327455bb078b9cf29ad7032'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:43.356662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 845/1684] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:43.361688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd8014-6bde-459c-95cd-838c088fdaca None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:43.421996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-25639a18-3d49-4f87-89b0-02a03596bf7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23e62b60327455bb078b9cf29ad7032'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:43.423325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-25639a18-3d49-4f87-89b0-02a03596bf7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23e62b60327455bb078b9cf29ad7032'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:43.424117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-25639a18-3d49-4f87-89b0-02a03596bf7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23e62b60327455bb078b9cf29ad7032'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:43.466048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 840/1685] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:42:42 2022] DELETE /identity/v3/users/a23e62b60327455bb078b9cf29ad7032 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:43.467820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ede2d4-8f0d-4583-9d5c-4890f276ae7a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:43.468092 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ede2d4-8f0d-4583-9d5c-4890f276ae7a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:43.468374 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ede2d4-8f0d-4583-9d5c-4890f276ae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:43.510717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-21ede2d4-8f0d-4583-9d5c-4890f276ae7a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:43.511992 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-21ede2d4-8f0d-4583-9d5c-4890f276ae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:43.532699 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd8014-6bde-459c-95cd-838c088fdaca None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:43.652859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 841/1686] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:43.654423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ede2d4-8f0d-4583-9d5c-4890f276ae7a None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:43.655618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-21ede2d4-8f0d-4583-9d5c-4890f276ae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:43.673448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ede2d4-8f0d-4583-9d5c-4890f276ae7a None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:43.684182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6ab8-f1d2-4faa-a58c-d41585fe1020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:43.684182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6ab8-f1d2-4faa-a58c-d41585fe1020 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:43.684182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6ab8-f1d2-4faa-a58c-d41585fe1020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:43.684182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb6ab8-f1d2-4faa-a58c-d41585fe1020 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:43.685213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:43.685326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb6ab8-f1d2-4faa-a58c-d41585fe1020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:43.685562 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:43.685562 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:43.685562 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] PATH_INFO: `/v3/projects/11177b3ce5b847939ccc95b45005a671` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:43.685562 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] RBAC: Authorizing `identity:delete_project(project_id=11177b3ce5b847939ccc95b45005a671)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:43.685832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb6ab8-f1d2-4faa-a58c-d41585fe1020 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:43.686604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:43.850138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:43.869396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 846/1687] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:43 2022] POST /identity/v3/projects => generated 387 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:42:43.869396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6ab8-f1d2-4faa-a58c-d41585fe1020 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:43.874380 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0fdb6ab8-f1d2-4faa-a58c-d41585fe1020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:43.878200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11177b3ce5b847939ccc95b45005a671', 'request_id': 'req-969ee1bc-653b-401b-a1da-10deafe3700e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:43.892269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11177b3ce5b847939ccc95b45005a671', 'request_id': 'req-969ee1bc-653b-401b-a1da-10deafe3700e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:44.016660 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb6ab8-f1d2-4faa-a58c-d41585fe1020 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:44.021900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11177b3ce5b847939ccc95b45005a671', 'request_id': 'req-969ee1bc-653b-401b-a1da-10deafe3700e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:44.029966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13129722-0155-4d9f-a0c6-fdf9c7710904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:44.032300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13129722-0155-4d9f-a0c6-fdf9c7710904 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:44.032664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13129722-0155-4d9f-a0c6-fdf9c7710904 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:44.034139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13129722-0155-4d9f-a0c6-fdf9c7710904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:44.041064 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] The token cache is being invalidate because project 11177b3ce5b847939ccc95b45005a671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:42:44.041336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:44.042204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:44.061050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 842/1688] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:42:43 2022] DELETE /identity/v3/projects/11177b3ce5b847939ccc95b45005a671 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:44.064440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:44.066836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:44.231331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13129722-0155-4d9f-a0c6-fdf9c7710904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:44.232971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13129722-0155-4d9f-a0c6-fdf9c7710904 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:44.266675 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ee1bc-653b-401b-a1da-10deafe3700e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:44.277944 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83216b5c-9cff-46e9-9471-fab829f2741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:44.278728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83216b5c-9cff-46e9-9471-fab829f2741f admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:44.279113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83216b5c-9cff-46e9-9471-fab829f2741f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:44.279458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83216b5c-9cff-46e9-9471-fab829f2741f admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:44.280181 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83216b5c-9cff-46e9-9471-fab829f2741f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:44.282320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83216b5c-9cff-46e9-9471-fab829f2741f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:44.286961 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 847/1689] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:44.288732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced7255-e366-482f-99dc-0e36b46d941f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:44.289406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced7255-e366-482f-99dc-0e36b46d941f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:44.289891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced7255-e366-482f-99dc-0e36b46d941f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:44.316783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-eced7255-e366-482f-99dc-0e36b46d941f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:44.318302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-eced7255-e366-482f-99dc-0e36b46d941f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:44.328818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 848/1690] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:44.336950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a27df-0f17-4077-ae01-3df9e05cdfdc None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:44.337352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a27df-0f17-4077-ae01-3df9e05cdfdc None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:44.337680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a27df-0f17-4077-ae01-3df9e05cdfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:44.369681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-914a27df-0f17-4077-ae01-3df9e05cdfdc None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:44.371895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-914a27df-0f17-4077-ae01-3df9e05cdfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:44.382610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 849/1691] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:42:44.389562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a27df-0f17-4077-ae01-3df9e05cdfdc None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:44.404349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a27df-0f17-4077-ae01-3df9e05cdfdc None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:44.409838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fd72e-8f3b-45ef-9c37-3b4aca417d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:44.410522 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fd72e-8f3b-45ef-9c37-3b4aca417d8b admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:44.410810 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fd72e-8f3b-45ef-9c37-3b4aca417d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:44.411078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fd72e-8f3b-45ef-9c37-3b4aca417d8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:44.412000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fd72e-8f3b-45ef-9c37-3b4aca417d8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:44.412358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fd72e-8f3b-45ef-9c37-3b4aca417d8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:44.414055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fd72e-8f3b-45ef-9c37-3b4aca417d8b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:44.436951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 850/1692] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:44.442449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fd72e-8f3b-45ef-9c37-3b4aca417d8b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:44.457202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fd72e-8f3b-45ef-9c37-3b4aca417d8b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:44.463152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f71f6-3199-42d5-8130-48ab9195f20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:44.463892 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f71f6-3199-42d5-8130-48ab9195f20b admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:44.464046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f71f6-3199-42d5-8130-48ab9195f20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:44.464317 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f71f6-3199-42d5-8130-48ab9195f20b admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:44.464958 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f71f6-3199-42d5-8130-48ab9195f20b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:44.467099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f71f6-3199-42d5-8130-48ab9195f20b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:44.549662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 843/1693] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:44 2022] POST /identity/v3/users => generated 300 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:44.554832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83216b5c-9cff-46e9-9471-fab829f2741f admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:44.579354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83216b5c-9cff-46e9-9471-fab829f2741f admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:44.582117 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 851/1694] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:44 2022] POST /identity/v3/projects => generated 405 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:42:44.593901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f71f6-3199-42d5-8130-48ab9195f20b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:44.773869 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4cadf-405c-4e5b-b923-8ce1d19ddc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:44.775805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4cadf-405c-4e5b-b923-8ce1d19ddc9f admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:44.775805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4cadf-405c-4e5b-b923-8ce1d19ddc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:44.775805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4cadf-405c-4e5b-b923-8ce1d19ddc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:44.776619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4cadf-405c-4e5b-b923-8ce1d19ddc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:44.778351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4cadf-405c-4e5b-b923-8ce1d19ddc9f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:44.816979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 844/1695] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:44.831399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f71f6-3199-42d5-8130-48ab9195f20b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:44.837868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101a46d-dc8e-46f9-8688-875a960ff399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:44.844035 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101a46d-dc8e-46f9-8688-875a960ff399 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:44.844035 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101a46d-dc8e-46f9-8688-875a960ff399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:44.844035 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101a46d-dc8e-46f9-8688-875a960ff399 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:44.844035 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101a46d-dc8e-46f9-8688-875a960ff399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:44.844035 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101a46d-dc8e-46f9-8688-875a960ff399 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:44.846037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4cadf-405c-4e5b-b923-8ce1d19ddc9f admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:44.855853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c7e4cadf-405c-4e5b-b923-8ce1d19ddc9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:44.879747 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4cadf-405c-4e5b-b923-8ce1d19ddc9f admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:44.895571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:44.902852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:44.902852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:44.902852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] PATH_INFO: `/v3/projects/015981bd28fa41d7b31536f8a0ca9fdd` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:44.902852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=015981bd28fa41d7b31536f8a0ca9fdd)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:44.902852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:45.065183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 852/1696] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:44 2022] POST /identity/v3/users => generated 303 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:45.065183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101a46d-dc8e-46f9-8688-875a960ff399 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:45.085972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101a46d-dc8e-46f9-8688-875a960ff399 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:45.094262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a70371-16aa-4e5f-8e8a-53c862f60b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:45.095193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a70371-16aa-4e5f-8e8a-53c862f60b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:45.095687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a70371-16aa-4e5f-8e8a-53c862f60b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:45.102665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a70371-16aa-4e5f-8e8a-53c862f60b23 admin admin] PATH_INFO: `/v3/projects/2414803271914bc29f6e71378986de6b/users/4268325e98684685be6e19602a9a4ca7/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:45.127169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a70371-16aa-4e5f-8e8a-53c862f60b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2414803271914bc29f6e71378986de6b, user_id=4268325e98684685be6e19602a9a4ca7, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:45.130876 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a70371-16aa-4e5f-8e8a-53c862f60b23 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:45.145817 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015981bd28fa41d7b31536f8a0ca9fdd', 'request_id': 'req-4719f2da-a737-41b2-9ca2-64b523fe39ff'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:45.156683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015981bd28fa41d7b31536f8a0ca9fdd', 'request_id': 'req-4719f2da-a737-41b2-9ca2-64b523fe39ff'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:45.252566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 853/1697] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:45 2022] PUT /identity/v3/projects/2414803271914bc29f6e71378986de6b/users/4268325e98684685be6e19602a9a4ca7/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:45.255030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a70371-16aa-4e5f-8e8a-53c862f60b23 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:45.285696 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:45.286774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015981bd28fa41d7b31536f8a0ca9fdd', 'request_id': 'req-4719f2da-a737-41b2-9ca2-64b523fe39ff'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:45.307998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] The token cache is being invalidate because project 015981bd28fa41d7b31536f8a0ca9fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:42:45.308309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:45.309058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:45.310662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 845/1698] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:42:44 2022] DELETE /identity/v3/projects/015981bd28fa41d7b31536f8a0ca9fdd => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:45.311551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:45.316348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:45.412795 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a70371-16aa-4e5f-8e8a-53c862f60b23 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:45.427021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160afb1-41c7-4522-8114-bbc49c3d5190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:45.431608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160afb1-41c7-4522-8114-bbc49c3d5190 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:45.435004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160afb1-41c7-4522-8114-bbc49c3d5190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:45.440108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160afb1-41c7-4522-8114-bbc49c3d5190 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:45.443418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160afb1-41c7-4522-8114-bbc49c3d5190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:45.451209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160afb1-41c7-4522-8114-bbc49c3d5190 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:45.507985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 854/1699] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:45.512754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160afb1-41c7-4522-8114-bbc49c3d5190 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:45.519587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d160afb1-41c7-4522-8114-bbc49c3d5190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:45.524125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719f2da-a737-41b2-9ca2-64b523fe39ff admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:45.530895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb5fd4-2f89-411d-8046-c0022655180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:45.532366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb5fd4-2f89-411d-8046-c0022655180f admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:45.532918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb5fd4-2f89-411d-8046-c0022655180f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:45.533464 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb5fd4-2f89-411d-8046-c0022655180f admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:45.534499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb5fd4-2f89-411d-8046-c0022655180f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:45.537169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb5fd4-2f89-411d-8046-c0022655180f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:45.544840 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160afb1-41c7-4522-8114-bbc49c3d5190 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:45.552215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 846/1700] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:45.553959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb5fd4-2f89-411d-8046-c0022655180f admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:45.566254 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:45.567239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:45.567530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:45.567813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] PATH_INFO: `/v3/users/d8bb2d6c402049898afd3505fff61cd4` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:45.571570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8bb2d6c402049898afd3505fff61cd4)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:45.575991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:45.590253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4fbb5fd4-2f89-411d-8046-c0022655180f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:45.639179 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb5fd4-2f89-411d-8046-c0022655180f admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:45.657237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f77b4b-7628-4ceb-acf8-1fd9d5c257a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:45.657237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f77b4b-7628-4ceb-acf8-1fd9d5c257a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:45.657237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f77b4b-7628-4ceb-acf8-1fd9d5c257a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:45.657237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f77b4b-7628-4ceb-acf8-1fd9d5c257a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:45.658144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f77b4b-7628-4ceb-acf8-1fd9d5c257a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:45.658144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f77b4b-7628-4ceb-acf8-1fd9d5c257a6 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:45.682411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 847/1701] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:45.686016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f77b4b-7628-4ceb-acf8-1fd9d5c257a6 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:45.706093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f77b4b-7628-4ceb-acf8-1fd9d5c257a6 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:45.711902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e293ee-0420-48b4-98a6-ba11eafc6ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:45.716287 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e293ee-0420-48b4-98a6-ba11eafc6ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:45.716287 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e293ee-0420-48b4-98a6-ba11eafc6ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:45.716287 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e293ee-0420-48b4-98a6-ba11eafc6ccf admin admin] PATH_INFO: `/v3/projects/2414803271914bc29f6e71378986de6b/users/4268325e98684685be6e19602a9a4ca7/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:45.717214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e293ee-0420-48b4-98a6-ba11eafc6ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2414803271914bc29f6e71378986de6b, user_id=4268325e98684685be6e19602a9a4ca7, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:45.720306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e293ee-0420-48b4-98a6-ba11eafc6ccf admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:45.735513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 848/1702] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:45 2022] PUT /identity/v3/projects/2414803271914bc29f6e71378986de6b/users/4268325e98684685be6e19602a9a4ca7/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:45.749586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039faffd-c8da-4f4a-9d83-f089bbf8fa82 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:45.749586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039faffd-c8da-4f4a-9d83-f089bbf8fa82 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:45.749586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039faffd-c8da-4f4a-9d83-f089bbf8fa82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:45.761681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-039faffd-c8da-4f4a-9d83-f089bbf8fa82 None None] MFA Rules not processed for user `bc8972d8bcec4e779a95a3b698641198`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:45.763218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-039faffd-c8da-4f4a-9d83-f089bbf8fa82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:45.898007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 849/1703] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:45.898007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039faffd-c8da-4f4a-9d83-f089bbf8fa82 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:46.086503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039faffd-c8da-4f4a-9d83-f089bbf8fa82 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:46.088476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485ddba-c396-4a57-bede-514705cc7035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:46.090442 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ddba-c396-4a57-bede-514705cc7035 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:46.090442 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ddba-c396-4a57-bede-514705cc7035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:46.090681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485ddba-c396-4a57-bede-514705cc7035 admin admin] PATH_INFO: `/v3/projects/8d83792cc6384009b4a291bd25e6b816/users/19269acf1bb14b3ab1556fba4bbf5c14/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:46.111739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485ddba-c396-4a57-bede-514705cc7035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d83792cc6384009b4a291bd25e6b816, user_id=19269acf1bb14b3ab1556fba4bbf5c14, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:46.111943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8bb2d6c402049898afd3505fff61cd4'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:46.115925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485ddba-c396-4a57-bede-514705cc7035 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:46.177575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8bb2d6c402049898afd3505fff61cd4'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:46.189194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8bb2d6c402049898afd3505fff61cd4'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:46.302663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 850/1704] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:45 2022] PUT /identity/v3/projects/8d83792cc6384009b4a291bd25e6b816/users/19269acf1bb14b3ab1556fba4bbf5c14/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:46.305509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300526db-9f1a-4635-bf00-6535a5093480 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:46.306270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300526db-9f1a-4635-bf00-6535a5093480 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:46.307038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300526db-9f1a-4635-bf00-6535a5093480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:46.338424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8bb2d6c402049898afd3505fff61cd4'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:46.342796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8bb2d6c402049898afd3505fff61cd4'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:46.346569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-300526db-9f1a-4635-bf00-6535a5093480 None None] MFA Rules not processed for user `4268325e98684685be6e19602a9a4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:46.348126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-300526db-9f1a-4635-bf00-6535a5093480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:46.348794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 855/1705] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:42:45 2022] DELETE /identity/v3/users/d8bb2d6c402049898afd3505fff61cd4 => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:46.350410 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:46.352031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:46.440371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71745e28-b844-4eac-acbd-bc3b47d60ad5 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:46.446335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92e8cb-c387-4859-bc6b-a45ee40d82ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:46.447913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e8cb-c387-4859-bc6b-a45ee40d82ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:46.448403 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e8cb-c387-4859-bc6b-a45ee40d82ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:46.448877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92e8cb-c387-4859-bc6b-a45ee40d82ed admin admin] PATH_INFO: `/v3/projects/6bd439d1269740029a3bb623b0b2adab` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:46.450904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92e8cb-c387-4859-bc6b-a45ee40d82ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd439d1269740029a3bb623b0b2adab)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:46.454142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92e8cb-c387-4859-bc6b-a45ee40d82ed admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:46.475016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 851/1706] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:46.476529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8199b-43d8-4496-9145-fceb9fe23e2a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:46.476824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8199b-43d8-4496-9145-fceb9fe23e2a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:46.477107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8199b-43d8-4496-9145-fceb9fe23e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:46.501798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-98f8199b-43d8-4496-9145-fceb9fe23e2a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:46.510395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-98f8199b-43d8-4496-9145-fceb9fe23e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:46.515670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 852/1707] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:46.517252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ae88-e1e5-4b52-93c2-93f0e9a6b1e2 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:46.517578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ae88-e1e5-4b52-93c2-93f0e9a6b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:46.517861 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9ae88-e1e5-4b52-93c2-93f0e9a6b1e2 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:46.519266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 853/1708] 10.222.0.48 () {54 vars in 912 bytes} [Thu Sep 1 05:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:42:46.525314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9ae88-e1e5-4b52-93c2-93f0e9a6b1e2 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:46.527565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7fe9ae88-e1e5-4b52-93c2-93f0e9a6b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:46.598801 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9ae88-e1e5-4b52-93c2-93f0e9a6b1e2 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:46.605358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70e1af-b831-4119-9bf1-59e8874a6231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:46.606101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70e1af-b831-4119-9bf1-59e8874a6231 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:46.606380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70e1af-b831-4119-9bf1-59e8874a6231 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:46.606652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70e1af-b831-4119-9bf1-59e8874a6231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:46.624939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70e1af-b831-4119-9bf1-59e8874a6231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:46.628163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70e1af-b831-4119-9bf1-59e8874a6231 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:46.641411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 854/1709] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:46.649406 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a940a3-1d72-42cb-bdc8-b584053a6568 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:46.649406 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a940a3-1d72-42cb-bdc8-b584053a6568 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:46.649406 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a940a3-1d72-42cb-bdc8-b584053a6568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-c1a940a3-1d72-42cb-bdc8-b584053a6568 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:42:46.651094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:42:46.651915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:42:46.662905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 855/1710] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:42:46 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 22 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 01 05:42:46.670126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a940a3-1d72-42cb-bdc8-b584053a6568 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:46.679074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c1a940a3-1d72-42cb-bdc8-b584053a6568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:46.713307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-be92e8cb-c387-4859-bc6b-a45ee40d82ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd439d1269740029a3bb623b0b2adab', 'request_id': 'req-be92e8cb-c387-4859-bc6b-a45ee40d82ed'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:46.857723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-be92e8cb-c387-4859-bc6b-a45ee40d82ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd439d1269740029a3bb623b0b2adab', 'request_id': 'req-be92e8cb-c387-4859-bc6b-a45ee40d82ed'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:46.857723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-be92e8cb-c387-4859-bc6b-a45ee40d82ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd439d1269740029a3bb623b0b2adab', 'request_id': 'req-be92e8cb-c387-4859-bc6b-a45ee40d82ed'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:46.858127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a940a3-1d72-42cb-bdc8-b584053a6568 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:46.870495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-be92e8cb-c387-4859-bc6b-a45ee40d82ed admin admin] The token cache is being invalidate because project 6bd439d1269740029a3bb623b0b2adab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:42:46.870803 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-be92e8cb-c387-4859-bc6b-a45ee40d82ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:46.871505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-be92e8cb-c387-4859-bc6b-a45ee40d82ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:46.873755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfc2e2-2c0b-47ac-bffe-658881a2b967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:46.878228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 856/1711] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:42:46 2022] DELETE /identity/v3/projects/6bd439d1269740029a3bb623b0b2adab => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:46.878386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfc2e2-2c0b-47ac-bffe-658881a2b967 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:46.878386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfc2e2-2c0b-47ac-bffe-658881a2b967 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:46.878707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfc2e2-2c0b-47ac-bffe-658881a2b967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:46.880439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af47951-efe3-4660-a6ec-0723b94c9053 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:46.882148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af47951-efe3-4660-a6ec-0723b94c9053 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:46.882453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af47951-efe3-4660-a6ec-0723b94c9053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:46.883938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ecdfc2e2-2c0b-47ac-bffe-658881a2b967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:46.921347 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-9af47951-efe3-4660-a6ec-0723b94c9053 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:46.923878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9af47951-efe3-4660-a6ec-0723b94c9053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:47.027172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfc2e2-2c0b-47ac-bffe-658881a2b967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:47.029050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfc2e2-2c0b-47ac-bffe-658881a2b967 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:47.046224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 856/1712] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:47.047569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfc2e2-2c0b-47ac-bffe-658881a2b967 service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:47.069640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ecdfc2e2-2c0b-47ac-bffe-658881a2b967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:47.098143 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 857/1713] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:47.099706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45004f49-067f-412a-a8a4-bfb64ddd6386 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:47.103793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45004f49-067f-412a-a8a4-bfb64ddd6386 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:47.104110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45004f49-067f-412a-a8a4-bfb64ddd6386 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:47.107288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 858/1714] 10.222.0.48 () {54 vars in 921 bytes} [Thu Sep 1 05:42:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:42:47.108557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91b6b5-4766-48e6-bd1e-71552b7f1c42 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:47.108848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91b6b5-4766-48e6-bd1e-71552b7f1c42 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:47.109122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91b6b5-4766-48e6-bd1e-71552b7f1c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:47.114379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfc2e2-2c0b-47ac-bffe-658881a2b967 service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:47.120815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:47.121837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:47.122147 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:47.122458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] PATH_INFO: `/v3/users/5465709c2f354ea68f4d99e2d2a954e7` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:47.123787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5465709c2f354ea68f4d99e2d2a954e7)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:47.127755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:47.141259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-7a91b6b5-4766-48e6-bd1e-71552b7f1c42 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:47.142480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7a91b6b5-4766-48e6-bd1e-71552b7f1c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:47.158961 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 859/1715] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:47.163371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91b6b5-4766-48e6-bd1e-71552b7f1c42 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:47.169783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91b6b5-4766-48e6-bd1e-71552b7f1c42 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:47.175394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e4461-502a-4543-9cde-dbb1f4ba3ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:47.176298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e4461-502a-4543-9cde-dbb1f4ba3ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:47.176742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e4461-502a-4543-9cde-dbb1f4ba3ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:47.177159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e4461-502a-4543-9cde-dbb1f4ba3ea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:47.179965 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e4461-502a-4543-9cde-dbb1f4ba3ea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:47.180472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e4461-502a-4543-9cde-dbb1f4ba3ea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:47.182851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e4461-502a-4543-9cde-dbb1f4ba3ea6 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:47.208981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 860/1716] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:47.210542 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2aa9a-4445-4be4-af0b-08324b55b338 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:47.210832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2aa9a-4445-4be4-af0b-08324b55b338 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:47.211111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2aa9a-4445-4be4-af0b-08324b55b338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:47.241680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-29e2aa9a-4445-4be4-af0b-08324b55b338 None None] MFA Rules not processed for user `055823f7760f485eb91266a0d63db602`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:47.244265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-29e2aa9a-4445-4be4-af0b-08324b55b338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:47.380796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 861/1717] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Sep 1 05:42:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:47.382182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2aa9a-4445-4be4-af0b-08324b55b338 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:47.413160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2aa9a-4445-4be4-af0b-08324b55b338 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:47.434096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc249d7-6c62-4401-8cbc-6b60cbd3f60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:47.435001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc249d7-6c62-4401-8cbc-6b60cbd3f60f admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:47.435268 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc249d7-6c62-4401-8cbc-6b60cbd3f60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:47.435697 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc249d7-6c62-4401-8cbc-6b60cbd3f60f admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:47.436378 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc249d7-6c62-4401-8cbc-6b60cbd3f60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:47.440052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc249d7-6c62-4401-8cbc-6b60cbd3f60f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:47.624172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5465709c2f354ea68f4d99e2d2a954e7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:47.636662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5465709c2f354ea68f4d99e2d2a954e7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:47.695973 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 862/1718] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:47 2022] POST /identity/v3/projects => generated 365 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:47.697037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc249d7-6c62-4401-8cbc-6b60cbd3f60f admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:47.704688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2dc249d7-6c62-4401-8cbc-6b60cbd3f60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:47.820054 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc249d7-6c62-4401-8cbc-6b60cbd3f60f admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:47.827968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff0f15-f61c-47d9-ae8e-fb41e1f7d582 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055823f7760f485eb91266a0d63db602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:47.828611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff0f15-f61c-47d9-ae8e-fb41e1f7d582 service placement] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:47.828897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff0f15-f61c-47d9-ae8e-fb41e1f7d582 service placement] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:47.829344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff0f15-f61c-47d9-ae8e-fb41e1f7d582 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:47.834922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5465709c2f354ea68f4d99e2d2a954e7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:47.836060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5465709c2f354ea68f4d99e2d2a954e7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:47.836729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5465709c2f354ea68f4d99e2d2a954e7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:47.843823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff0f15-f61c-47d9-ae8e-fb41e1f7d582 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:47.845051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff0f15-f61c-47d9-ae8e-fb41e1f7d582 service placement] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:47.861425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 857/1719] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:42:47 2022] DELETE /identity/v3/users/5465709c2f354ea68f4d99e2d2a954e7 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:47.862340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:47.864221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:47.865889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 863/1720] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:47.866556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff0f15-f61c-47d9-ae8e-fb41e1f7d582 service placement] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:48.019413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79500b3-35fb-438a-9678-4368868af576 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:48.038283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbabae0-cf81-4e22-9852-751e91cf5797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:48.038923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbabae0-cf81-4e22-9852-751e91cf5797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:48.039270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbabae0-cf81-4e22-9852-751e91cf5797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:48.039655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbabae0-cf81-4e22-9852-751e91cf5797 admin admin] PATH_INFO: `/v3/users/2954a215b049442cbd481f1f3ecab1db` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:48.043492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbabae0-cf81-4e22-9852-751e91cf5797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2954a215b049442cbd481f1f3ecab1db)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:48.044796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff0f15-f61c-47d9-ae8e-fb41e1f7d582 service placement] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:48.046985 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbabae0-cf81-4e22-9852-751e91cf5797 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:48.057429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30899290-51e7-454f-945a-10e6a4195a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:48.058228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30899290-51e7-454f-945a-10e6a4195a23 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:48.059432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30899290-51e7-454f-945a-10e6a4195a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:48.059785 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30899290-51e7-454f-945a-10e6a4195a23 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:48.065387 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30899290-51e7-454f-945a-10e6a4195a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:48.067655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30899290-51e7-454f-945a-10e6a4195a23 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:48.311962 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 864/1721] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:47 2022] POST /identity/v3/users => generated 283 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:48.311962 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30899290-51e7-454f-945a-10e6a4195a23 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:48.311962 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-30899290-51e7-454f-945a-10e6a4195a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:48.325587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30899290-51e7-454f-945a-10e6a4195a23 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:48.330886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:48.331552 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:48.331836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:48.332117 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] PATH_INFO: `/v3/projects/029f9834e81149c596375a1c3f0788f6` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:48.336513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] RBAC: Authorizing `identity:delete_project(project_id=029f9834e81149c596375a1c3f0788f6)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:48.336513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:48.472230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3bbabae0-cf81-4e22-9852-751e91cf5797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2954a215b049442cbd481f1f3ecab1db'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:48.496628 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3bbabae0-cf81-4e22-9852-751e91cf5797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2954a215b049442cbd481f1f3ecab1db'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:48.652788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3bbabae0-cf81-4e22-9852-751e91cf5797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2954a215b049442cbd481f1f3ecab1db'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:48.655725 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3bbabae0-cf81-4e22-9852-751e91cf5797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2954a215b049442cbd481f1f3ecab1db'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:48.659463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3bbabae0-cf81-4e22-9852-751e91cf5797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2954a215b049442cbd481f1f3ecab1db'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:48.695288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029f9834e81149c596375a1c3f0788f6', 'request_id': 'req-7d8d7421-4a5b-413a-8af4-003719dbc65c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:48.715835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 858/1722] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:42:47 2022] DELETE /identity/v3/users/2954a215b049442cbd481f1f3ecab1db => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:48.716805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f3132-dd28-4107-951b-e246548efd11 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:48.717097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f3132-dd28-4107-951b-e246548efd11 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:48.717403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f3132-dd28-4107-951b-e246548efd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:48.746814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-330f3132-dd28-4107-951b-e246548efd11 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:48.750311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-330f3132-dd28-4107-951b-e246548efd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:48.888188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 859/1723] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:48.889579 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f3132-dd28-4107-951b-e246548efd11 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:48.897300 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-330f3132-dd28-4107-951b-e246548efd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:48.909050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029f9834e81149c596375a1c3f0788f6', 'request_id': 'req-7d8d7421-4a5b-413a-8af4-003719dbc65c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:48.918888 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f3132-dd28-4107-951b-e246548efd11 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:48.930358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029f9834e81149c596375a1c3f0788f6', 'request_id': 'req-7d8d7421-4a5b-413a-8af4-003719dbc65c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:48.941946 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0863c-5712-4e7f-a1fe-fc43992d7d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:48.942513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0863c-5712-4e7f-a1fe-fc43992d7d65 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:48.942778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0863c-5712-4e7f-a1fe-fc43992d7d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:48.943052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0863c-5712-4e7f-a1fe-fc43992d7d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:48.943721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0863c-5712-4e7f-a1fe-fc43992d7d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:48.947036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0863c-5712-4e7f-a1fe-fc43992d7d65 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:48.954508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] The token cache is being invalidate because project 029f9834e81149c596375a1c3f0788f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:42:48.954810 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:48.961228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:48.962964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 860/1724] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:48.964198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0863c-5712-4e7f-a1fe-fc43992d7d65 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:48.966537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5dd0863c-5712-4e7f-a1fe-fc43992d7d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:48.968874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 865/1725] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:42:48 2022] DELETE /identity/v3/projects/029f9834e81149c596375a1c3f0788f6 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:48.981034 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:48.983257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:49.084886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:49.137704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0863c-5712-4e7f-a1fe-fc43992d7d65 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:49.151448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33982009-6ea0-4c79-ae3c-47a7ca8d5e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:49.152094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33982009-6ea0-4c79-ae3c-47a7ca8d5e96 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:49.152363 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33982009-6ea0-4c79-ae3c-47a7ca8d5e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:49.152629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33982009-6ea0-4c79-ae3c-47a7ca8d5e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:49.156558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-33982009-6ea0-4c79-ae3c-47a7ca8d5e96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:49.206755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33982009-6ea0-4c79-ae3c-47a7ca8d5e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:49.210223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33982009-6ea0-4c79-ae3c-47a7ca8d5e96 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:49.228012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 861/1726] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:49.228012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492b5f1-2ada-4cb2-bdb5-05d8756db516 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:49.228012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492b5f1-2ada-4cb2-bdb5-05d8756db516 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:49.228012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492b5f1-2ada-4cb2-bdb5-05d8756db516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:49.228270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d7421-4a5b-413a-8af4-003719dbc65c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:49.238044 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e33165-4bc3-4bd1-adb6-dd80e387203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:49.239068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e33165-4bc3-4bd1-adb6-dd80e387203d admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:49.239627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e33165-4bc3-4bd1-adb6-dd80e387203d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:49.240146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e33165-4bc3-4bd1-adb6-dd80e387203d admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:49.241110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e33165-4bc3-4bd1-adb6-dd80e387203d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:49.243769 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e33165-4bc3-4bd1-adb6-dd80e387203d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:49.256064 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-d492b5f1-2ada-4cb2-bdb5-05d8756db516 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:49.257844 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d492b5f1-2ada-4cb2-bdb5-05d8756db516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:49.260661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 866/1727] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:49.265770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e33165-4bc3-4bd1-adb6-dd80e387203d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:49.280392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 862/1728] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:49.281409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492b5f1-2ada-4cb2-bdb5-05d8756db516 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:49.284533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e33165-4bc3-4bd1-adb6-dd80e387203d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:49.286051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d492b5f1-2ada-4cb2-bdb5-05d8756db516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:49.301946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d8d47-156c-4a62-ba45-bf5114ffcf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:49.303438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d8d47-156c-4a62-ba45-bf5114ffcf42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:49.303438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d8d47-156c-4a62-ba45-bf5114ffcf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:49.303438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d8d47-156c-4a62-ba45-bf5114ffcf42 admin admin] PATH_INFO: `/v3/projects/35ec08c3882d4561ad2639d79d96da02/users/6043b89f06164e8c8db58c3e1dcf4331/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:49.313547 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492b5f1-2ada-4cb2-bdb5-05d8756db516 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:49.328946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d8d47-156c-4a62-ba45-bf5114ffcf42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ec08c3882d4561ad2639d79d96da02, user_id=6043b89f06164e8c8db58c3e1dcf4331, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:49.329490 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ea68f-0f64-496c-88d5-08995ffed68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:49.329855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ea68f-0f64-496c-88d5-08995ffed68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:49.330139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ea68f-0f64-496c-88d5-08995ffed68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:49.330416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ea68f-0f64-496c-88d5-08995ffed68e admin admin] PATH_INFO: `/v3/projects/a2369179eaa44d23bed423a8603730f6` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:49.331890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d8d47-156c-4a62-ba45-bf5114ffcf42 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:49.334037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ea68f-0f64-496c-88d5-08995ffed68e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2369179eaa44d23bed423a8603730f6)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:49.336194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ea68f-0f64-496c-88d5-08995ffed68e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:49.529883 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 867/1729] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:49 2022] PUT /identity/v3/projects/35ec08c3882d4561ad2639d79d96da02/users/6043b89f06164e8c8db58c3e1dcf4331/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:49.531474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c240d3-9316-44e9-b581-8c17c633a093 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:49.531759 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c240d3-9316-44e9-b581-8c17c633a093 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:49.533799 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c240d3-9316-44e9-b581-8c17c633a093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:49.542792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e44ea68f-0f64-496c-88d5-08995ffed68e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2369179eaa44d23bed423a8603730f6', 'request_id': 'req-e44ea68f-0f64-496c-88d5-08995ffed68e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:49.551050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e44ea68f-0f64-496c-88d5-08995ffed68e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2369179eaa44d23bed423a8603730f6', 'request_id': 'req-e44ea68f-0f64-496c-88d5-08995ffed68e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:49.563994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-82c240d3-9316-44e9-b581-8c17c633a093 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:49.565480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-82c240d3-9316-44e9-b581-8c17c633a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:49.654316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 868/1730] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:49.663559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c240d3-9316-44e9-b581-8c17c633a093 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:49.666014 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-82c240d3-9316-44e9-b581-8c17c633a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:49.688856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c240d3-9316-44e9-b581-8c17c633a093 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:49.694470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:49.695563 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:49.696043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:49.697222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] PATH_INFO: `/v3/users/5b1e6a1c0fe345bbbbe9c4a4a91f355a` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:49.700298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1e6a1c0fe345bbbbe9c4a4a91f355a)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:49.704180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:49.727866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e44ea68f-0f64-496c-88d5-08995ffed68e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2369179eaa44d23bed423a8603730f6', 'request_id': 'req-e44ea68f-0f64-496c-88d5-08995ffed68e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:49.746757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e44ea68f-0f64-496c-88d5-08995ffed68e admin admin] The token cache is being invalidate because project a2369179eaa44d23bed423a8603730f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:42:49.747214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e44ea68f-0f64-496c-88d5-08995ffed68e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:49.748323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e44ea68f-0f64-496c-88d5-08995ffed68e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:49.750892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 863/1731] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:42:49 2022] DELETE /identity/v3/projects/a2369179eaa44d23bed423a8603730f6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:49.753912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292055ba-ef11-4d29-adb0-d43f88da7090 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:49.754868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292055ba-ef11-4d29-adb0-d43f88da7090 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:49.755358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292055ba-ef11-4d29-adb0-d43f88da7090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:49.804157 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-292055ba-ef11-4d29-adb0-d43f88da7090 None None] MFA Rules not processed for user `6043b89f06164e8c8db58c3e1dcf4331`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:49.806895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-292055ba-ef11-4d29-adb0-d43f88da7090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:49.913102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 864/1732] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:49.914917 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292055ba-ef11-4d29-adb0-d43f88da7090 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:49.918272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-292055ba-ef11-4d29-adb0-d43f88da7090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:49.944965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292055ba-ef11-4d29-adb0-d43f88da7090 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:49.955105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5303cab-1523-4bff-b1b5-e02b729c51fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:49.956081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5303cab-1523-4bff-b1b5-e02b729c51fd admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:49.956538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5303cab-1523-4bff-b1b5-e02b729c51fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:49.956891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5303cab-1523-4bff-b1b5-e02b729c51fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:49.958135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5303cab-1523-4bff-b1b5-e02b729c51fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:49.958696 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5303cab-1523-4bff-b1b5-e02b729c51fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:49.961951 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5303cab-1523-4bff-b1b5-e02b729c51fd admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:49.986712 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 865/1733] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:49.988091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9881e55-7e39-4daf-8791-4af7b32e225a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:49.988384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9881e55-7e39-4daf-8791-4af7b32e225a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:49.988664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9881e55-7e39-4daf-8791-4af7b32e225a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:50.013120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b9881e55-7e39-4daf-8791-4af7b32e225a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:50.014572 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b9881e55-7e39-4daf-8791-4af7b32e225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:50.023356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 866/1734] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:50.025043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9881e55-7e39-4daf-8791-4af7b32e225a None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:50.026941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b9881e55-7e39-4daf-8791-4af7b32e225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:50.042537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9881e55-7e39-4daf-8791-4af7b32e225a None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:50.047729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbfbec-9870-40f5-bb37-42645d90d594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:50.048385 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbfbec-9870-40f5-bb37-42645d90d594 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:50.048662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbfbec-9870-40f5-bb37-42645d90d594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:50.048935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbfbec-9870-40f5-bb37-42645d90d594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:50.049723 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbfbec-9870-40f5-bb37-42645d90d594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:50.053187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbfbec-9870-40f5-bb37-42645d90d594 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:50.068137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:50.076881 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1e6a1c0fe345bbbbe9c4a4a91f355a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:50.093831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1e6a1c0fe345bbbbe9c4a4a91f355a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:50.101350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1e6a1c0fe345bbbbe9c4a4a91f355a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:50.198928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1e6a1c0fe345bbbbe9c4a4a91f355a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:50.199561 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1e6a1c0fe345bbbbe9c4a4a91f355a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:50.217348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 869/1735] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:42:49 2022] DELETE /identity/v3/users/5b1e6a1c0fe345bbbbe9c4a4a91f355a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:50.218374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:50.221648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:50.247338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 867/1736] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:50 2022] POST /identity/v3/projects => generated 363 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:50.248383 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbfbec-9870-40f5-bb37-42645d90d594 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:50.252498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-cafbfbec-9870-40f5-bb37-42645d90d594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:50.347898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f1116-cc79-4bfb-a0b1-1733c8d2101d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:50.353802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7370f8-b06e-4a40-9367-75fb051867c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:50.354454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7370f8-b06e-4a40-9367-75fb051867c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:50.354744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7370f8-b06e-4a40-9367-75fb051867c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:50.355072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7370f8-b06e-4a40-9367-75fb051867c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:50.355736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7370f8-b06e-4a40-9367-75fb051867c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:50.357821 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7370f8-b06e-4a40-9367-75fb051867c5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:50.386297 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbfbec-9870-40f5-bb37-42645d90d594 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:50.394621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:50.395754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:50.396258 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:50.396758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] PATH_INFO: `/v3/projects/5c89de6a53944a0b8e58d5aedf75a6b9` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:50.398855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c89de6a53944a0b8e58d5aedf75a6b9)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:50.404045 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:50.482281 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 870/1737] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:50 2022] POST /identity/v3/projects => generated 365 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:50.485983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d42d2-f060-438c-b013-502f21e25010 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:50.486263 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d42d2-f060-438c-b013-502f21e25010 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:50.486545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d42d2-f060-438c-b013-502f21e25010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:50.512294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-d71d42d2-f060-438c-b013-502f21e25010 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:50.514570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d71d42d2-f060-438c-b013-502f21e25010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:50.580059 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 871/1738] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:50.581477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0f66-e7f5-4547-8e96-1ac41ab20449 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:50.581717 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0f66-e7f5-4547-8e96-1ac41ab20449 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:50.581993 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e0f66-e7f5-4547-8e96-1ac41ab20449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:50.605019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c89de6a53944a0b8e58d5aedf75a6b9', 'request_id': 'req-961b78cd-8a56-4f72-a9ed-f34dfe886b34'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:50.611979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c89de6a53944a0b8e58d5aedf75a6b9', 'request_id': 'req-961b78cd-8a56-4f72-a9ed-f34dfe886b34'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:50.625654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-706e0f66-e7f5-4547-8e96-1ac41ab20449 None None] MFA Rules not processed for user `19269acf1bb14b3ab1556fba4bbf5c14`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:50.628041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-706e0f66-e7f5-4547-8e96-1ac41ab20449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:50.724805 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 872/1739] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:50.725592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e0f66-e7f5-4547-8e96-1ac41ab20449 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:50.727600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-706e0f66-e7f5-4547-8e96-1ac41ab20449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:50.746796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c89de6a53944a0b8e58d5aedf75a6b9', 'request_id': 'req-961b78cd-8a56-4f72-a9ed-f34dfe886b34'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:50.759699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] The token cache is being invalidate because project 5c89de6a53944a0b8e58d5aedf75a6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:42:50.769431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:50.769664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:50.771796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 868/1740] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:42:50 2022] DELETE /identity/v3/projects/5c89de6a53944a0b8e58d5aedf75a6b9 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:50.775976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:50.777669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:50.815083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e0f66-e7f5-4547-8e96-1ac41ab20449 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:50.820447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00fda2-c39e-4bae-b778-abe083bd931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:50.821185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00fda2-c39e-4bae-b778-abe083bd931e admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:50.826666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00fda2-c39e-4bae-b778-abe083bd931e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:50.826666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00fda2-c39e-4bae-b778-abe083bd931e admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:50.826666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00fda2-c39e-4bae-b778-abe083bd931e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:50.826666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00fda2-c39e-4bae-b778-abe083bd931e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:50.852375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b78cd-8a56-4f72-a9ed-f34dfe886b34 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:50.857523 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedae82-c321-4990-ab90-c0d479d68e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:50.858157 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedae82-c321-4990-ab90-c0d479d68e0a admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:50.858438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedae82-c321-4990-ab90-c0d479d68e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:50.858715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedae82-c321-4990-ab90-c0d479d68e0a admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:50.859398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedae82-c321-4990-ab90-c0d479d68e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:50.861521 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedae82-c321-4990-ab90-c0d479d68e0a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:51.115115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 873/1741] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:50 2022] POST /identity/v3/users => generated 288 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:51.120808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 869/1742] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:50 2022] POST /identity/v3/users => generated 283 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:51.121081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00fda2-c39e-4bae-b778-abe083bd931e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:51.121501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedae82-c321-4990-ab90-c0d479d68e0a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:51.121646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7a00fda2-c39e-4bae-b778-abe083bd931e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:51.121750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7dedae82-c321-4990-ab90-c0d479d68e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:51.130963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00fda2-c39e-4bae-b778-abe083bd931e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:51.132291 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedae82-c321-4990-ab90-c0d479d68e0a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:51.136768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc1cce-310f-4aa7-a02d-abae67e55965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:51.137401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc1cce-310f-4aa7-a02d-abae67e55965 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:51.137646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:51.137751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc1cce-310f-4aa7-a02d-abae67e55965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:51.137937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc1cce-310f-4aa7-a02d-abae67e55965 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:51.138286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:51.138569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:51.138656 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc1cce-310f-4aa7-a02d-abae67e55965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:51.138847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] PATH_INFO: `/v3/projects/5bacd190ec2c4f18867c4ef10b5c3f7b` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:51.138944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc1cce-310f-4aa7-a02d-abae67e55965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:51.142516 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bacd190ec2c4f18867c4ef10b5c3f7b)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:51.142988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc1cce-310f-4aa7-a02d-abae67e55965 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:51.143340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:51.156643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 874/1743] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:51.157571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc1cce-310f-4aa7-a02d-abae67e55965 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:51.159297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a1dc1cce-310f-4aa7-a02d-abae67e55965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:51.173622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc1cce-310f-4aa7-a02d-abae67e55965 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:51.178415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16936bc6-145b-4673-8df9-8fdce0aa34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:51.179050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16936bc6-145b-4673-8df9-8fdce0aa34d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:51.179381 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16936bc6-145b-4673-8df9-8fdce0aa34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:51.179693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16936bc6-145b-4673-8df9-8fdce0aa34d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:51.180355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16936bc6-145b-4673-8df9-8fdce0aa34d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:51.183524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16936bc6-145b-4673-8df9-8fdce0aa34d1 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:51.337655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bacd190ec2c4f18867c4ef10b5c3f7b', 'request_id': 'req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:51.348079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bacd190ec2c4f18867c4ef10b5c3f7b', 'request_id': 'req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:51.366064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 875/1744] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:51 2022] POST /identity/v3/projects => generated 405 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:51.369959 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16936bc6-145b-4673-8df9-8fdce0aa34d1 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:51.372004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-16936bc6-145b-4673-8df9-8fdce0aa34d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:51.444926 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16936bc6-145b-4673-8df9-8fdce0aa34d1 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:51.453285 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84711e5b-76a7-43f1-9483-f91edca6aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:51.453815 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84711e5b-76a7-43f1-9483-f91edca6aa3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:51.454079 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84711e5b-76a7-43f1-9483-f91edca6aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:51.454444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84711e5b-76a7-43f1-9483-f91edca6aa3f admin admin] PATH_INFO: `/v3/users/4268325e98684685be6e19602a9a4ca7` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:51.461951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84711e5b-76a7-43f1-9483-f91edca6aa3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4268325e98684685be6e19602a9a4ca7)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:51.465625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84711e5b-76a7-43f1-9483-f91edca6aa3f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:51.509938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bacd190ec2c4f18867c4ef10b5c3f7b', 'request_id': 'req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:51.532316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] The token cache is being invalidate because project 5bacd190ec2c4f18867c4ef10b5c3f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:42:51.532316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:51.532316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:51.532316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 870/1745] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:42:51 2022] DELETE /identity/v3/projects/5bacd190ec2c4f18867c4ef10b5c3f7b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:51.538286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:51.538286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:51.632409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18cdcc-0198-4be5-ab4e-e220a92d9e49 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:51.638284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2a94-9dc6-4336-b524-c987ab4d46ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:51.638911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2a94-9dc6-4336-b524-c987ab4d46ac admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:51.639196 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2a94-9dc6-4336-b524-c987ab4d46ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:51.639474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d2a94-9dc6-4336-b524-c987ab4d46ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:51.640128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d2a94-9dc6-4336-b524-c987ab4d46ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:51.641824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d2a94-9dc6-4336-b524-c987ab4d46ac admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:51.653241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 871/1746] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:51.654239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2a94-9dc6-4336-b524-c987ab4d46ac admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:51.657552 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-616d2a94-9dc6-4336-b524-c987ab4d46ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:51.672506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d2a94-9dc6-4336-b524-c987ab4d46ac admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:51.678505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4f4f0-d3b5-4210-b6b5-30b16a961e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:51.682085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f4f0-d3b5-4210-b6b5-30b16a961e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:51.682085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f4f0-d3b5-4210-b6b5-30b16a961e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:51.682085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4f4f0-d3b5-4210-b6b5-30b16a961e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:51.682085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4f4f0-d3b5-4210-b6b5-30b16a961e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:51.683453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4f4f0-d3b5-4210-b6b5-30b16a961e97 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:51.694765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 872/1747] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:51.695815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4f4f0-d3b5-4210-b6b5-30b16a961e97 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:51.699146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5eb4f4f0-d3b5-4210-b6b5-30b16a961e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:51.714023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4f4f0-d3b5-4210-b6b5-30b16a961e97 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:51.719663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589bfcb-a14a-4b0d-a08f-16223cc99006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:51.719831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589bfcb-a14a-4b0d-a08f-16223cc99006 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:51.720098 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589bfcb-a14a-4b0d-a08f-16223cc99006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:51.720510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589bfcb-a14a-4b0d-a08f-16223cc99006 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:51.721055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589bfcb-a14a-4b0d-a08f-16223cc99006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:51.723428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589bfcb-a14a-4b0d-a08f-16223cc99006 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:51.840244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-84711e5b-76a7-43f1-9483-f91edca6aa3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4268325e98684685be6e19602a9a4ca7'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:51.854431 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-84711e5b-76a7-43f1-9483-f91edca6aa3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4268325e98684685be6e19602a9a4ca7'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:51.862148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 873/1748] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:51 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:51.863074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589bfcb-a14a-4b0d-a08f-16223cc99006 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:51.870582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-84711e5b-76a7-43f1-9483-f91edca6aa3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4268325e98684685be6e19602a9a4ca7'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:51.870737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7589bfcb-a14a-4b0d-a08f-16223cc99006 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:51.949024 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589bfcb-a14a-4b0d-a08f-16223cc99006 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:51.954493 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee5eac-3de8-4029-8c97-b5e7bcdab870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:51.955219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee5eac-3de8-4029-8c97-b5e7bcdab870 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:51.955604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee5eac-3de8-4029-8c97-b5e7bcdab870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:51.955916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee5eac-3de8-4029-8c97-b5e7bcdab870 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:51.956579 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee5eac-3de8-4029-8c97-b5e7bcdab870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:51.958780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee5eac-3de8-4029-8c97-b5e7bcdab870 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:52.023851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-84711e5b-76a7-43f1-9483-f91edca6aa3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4268325e98684685be6e19602a9a4ca7'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:52.025493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-84711e5b-76a7-43f1-9483-f91edca6aa3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4268325e98684685be6e19602a9a4ca7'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:52.034852 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 876/1749] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:42:51 2022] DELETE /identity/v3/users/4268325e98684685be6e19602a9a4ca7 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:52.036847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a0b9-c08b-4d6c-9372-e40b38ca09c1 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:52.037271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a0b9-c08b-4d6c-9372-e40b38ca09c1 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:52.037913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a0b9-c08b-4d6c-9372-e40b38ca09c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:52.060575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-7a33a0b9-c08b-4d6c-9372-e40b38ca09c1 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:52.062018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7a33a0b9-c08b-4d6c-9372-e40b38ca09c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:52.135167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 877/1750] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:52.136013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33a0b9-c08b-4d6c-9372-e40b38ca09c1 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:52.146737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7a33a0b9-c08b-4d6c-9372-e40b38ca09c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:52.162684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 874/1751] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:51 2022] POST /identity/v3/users => generated 309 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:52.164342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee5eac-3de8-4029-8c97-b5e7bcdab870 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:52.169694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ebee5eac-3de8-4029-8c97-b5e7bcdab870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:52.174618 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33a0b9-c08b-4d6c-9372-e40b38ca09c1 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:52.186031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16dd81-41c1-4624-b189-d72d453d3e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:52.186656 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16dd81-41c1-4624-b189-d72d453d3e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:52.186993 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16dd81-41c1-4624-b189-d72d453d3e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:52.187109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee5eac-3de8-4029-8c97-b5e7bcdab870 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:52.187264 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16dd81-41c1-4624-b189-d72d453d3e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:52.188777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16dd81-41c1-4624-b189-d72d453d3e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:52.190724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16dd81-41c1-4624-b189-d72d453d3e7b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:52.193976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc063b-cfd9-4557-bdd6-9e576f99c714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:52.195125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc063b-cfd9-4557-bdd6-9e576f99c714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:52.195612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc063b-cfd9-4557-bdd6-9e576f99c714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:52.196128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc063b-cfd9-4557-bdd6-9e576f99c714 admin admin] PATH_INFO: `/v3/projects/903092a1a1a04b7f883cba9c3f994888/users/f4909b4571224a2c968d5972d8ed7e36/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:52.202526 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 878/1752] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:52.202921 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16dd81-41c1-4624-b189-d72d453d3e7b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:52.204713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0f16dd81-41c1-4624-b189-d72d453d3e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:52.219599 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16dd81-41c1-4624-b189-d72d453d3e7b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:52.224235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc063b-cfd9-4557-bdd6-9e576f99c714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903092a1a1a04b7f883cba9c3f994888, user_id=f4909b4571224a2c968d5972d8ed7e36, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:52.225362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa3892-bf26-4851-b25e-42172ad4ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:52.226062 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa3892-bf26-4851-b25e-42172ad4ae60 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:52.226384 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa3892-bf26-4851-b25e-42172ad4ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:52.226802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa3892-bf26-4851-b25e-42172ad4ae60 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:52.227142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc063b-cfd9-4557-bdd6-9e576f99c714 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:52.227445 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa3892-bf26-4851-b25e-42172ad4ae60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:52.230327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa3892-bf26-4851-b25e-42172ad4ae60 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:52.442310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 875/1753] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:52 2022] PUT /identity/v3/projects/903092a1a1a04b7f883cba9c3f994888/users/f4909b4571224a2c968d5972d8ed7e36/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:52.443840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfe811-1b08-439f-b8cd-2a0601c55f64 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:52.444133 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfe811-1b08-439f-b8cd-2a0601c55f64 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:52.444487 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfe811-1b08-439f-b8cd-2a0601c55f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:52.467633 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-2dbfe811-1b08-439f-b8cd-2a0601c55f64 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:52.469068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2dbfe811-1b08-439f-b8cd-2a0601c55f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:52.492983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 879/1754] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:52 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:52.496139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa3892-bf26-4851-b25e-42172ad4ae60 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:52.498714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a7aa3892-bf26-4851-b25e-42172ad4ae60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:52.514961 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa3892-bf26-4851-b25e-42172ad4ae60 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:52.553497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 876/1755] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:52.554365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfe811-1b08-439f-b8cd-2a0601c55f64 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:52.564632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfe811-1b08-439f-b8cd-2a0601c55f64 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:52.569545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62224cce-c49b-474e-9f7a-03ba78592d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:52.570221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62224cce-c49b-474e-9f7a-03ba78592d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:52.570508 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62224cce-c49b-474e-9f7a-03ba78592d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:52.570813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62224cce-c49b-474e-9f7a-03ba78592d15 admin admin] PATH_INFO: `/v3/projects/b03dc5c1d12a4ab788580281385b4f79/users/c6a6ceb541d44e60a9b5491a7ad4246d/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:52.586280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac6cc7-0edd-4219-b24d-6352f5139f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:52.587605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac6cc7-0edd-4219-b24d-6352f5139f7e admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:52.587884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac6cc7-0edd-4219-b24d-6352f5139f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:52.588119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac6cc7-0edd-4219-b24d-6352f5139f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:52.589859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac6cc7-0edd-4219-b24d-6352f5139f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:52.589990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62224cce-c49b-474e-9f7a-03ba78592d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03dc5c1d12a4ab788580281385b4f79, user_id=c6a6ceb541d44e60a9b5491a7ad4246d, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:52.591942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac6cc7-0edd-4219-b24d-6352f5139f7e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:52.592938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62224cce-c49b-474e-9f7a-03ba78592d15 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:52.603185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 880/1756] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:52.614443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac6cc7-0edd-4219-b24d-6352f5139f7e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:52.626467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac6cc7-0edd-4219-b24d-6352f5139f7e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:52.640816 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73c503-5957-4f3a-96d6-71efa2540ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:52.641906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73c503-5957-4f3a-96d6-71efa2540ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:52.642499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73c503-5957-4f3a-96d6-71efa2540ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:52.642742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73c503-5957-4f3a-96d6-71efa2540ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:52.644146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73c503-5957-4f3a-96d6-71efa2540ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:52.647165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73c503-5957-4f3a-96d6-71efa2540ef0 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:52.665182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 881/1757] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:52.665182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73c503-5957-4f3a-96d6-71efa2540ef0 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:52.678170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73c503-5957-4f3a-96d6-71efa2540ef0 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:52.684016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fa124-65b2-4797-8e5c-d24d3759e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:52.685171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fa124-65b2-4797-8e5c-d24d3759e573 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:52.685171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fa124-65b2-4797-8e5c-d24d3759e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:52.685171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fa124-65b2-4797-8e5c-d24d3759e573 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:52.686152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fa124-65b2-4797-8e5c-d24d3759e573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:52.687646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fa124-65b2-4797-8e5c-d24d3759e573 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:52.699821 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 882/1758] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:52.700695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fa124-65b2-4797-8e5c-d24d3759e573 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:52.713666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fa124-65b2-4797-8e5c-d24d3759e573 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:52.718596 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87a029-29b3-4af5-8ce2-8bfe6590cbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:52.719379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87a029-29b3-4af5-8ce2-8bfe6590cbbf admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:52.719658 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87a029-29b3-4af5-8ce2-8bfe6590cbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:52.719932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87a029-29b3-4af5-8ce2-8bfe6590cbbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:52.720581 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87a029-29b3-4af5-8ce2-8bfe6590cbbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:52.720885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87a029-29b3-4af5-8ce2-8bfe6590cbbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:52.722822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87a029-29b3-4af5-8ce2-8bfe6590cbbf admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:52.736588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 883/1759] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:52.737467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87a029-29b3-4af5-8ce2-8bfe6590cbbf admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:52.748548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87a029-29b3-4af5-8ce2-8bfe6590cbbf admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:52.753482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00ed5d-63c3-446e-97c7-23aac960ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:52.754291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00ed5d-63c3-446e-97c7-23aac960ac77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:52.754579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00ed5d-63c3-446e-97c7-23aac960ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:52.754858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00ed5d-63c3-446e-97c7-23aac960ac77 admin admin] PATH_INFO: `/v3/projects/826ce7737929467c93140b6b8a459043/users/14284a3eaa5949a2972692a8a13c0db1/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:52.771777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00ed5d-63c3-446e-97c7-23aac960ac77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826ce7737929467c93140b6b8a459043, user_id=14284a3eaa5949a2972692a8a13c0db1, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:52.775638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00ed5d-63c3-446e-97c7-23aac960ac77 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:52.906263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 877/1760] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:52 2022] PUT /identity/v3/projects/b03dc5c1d12a4ab788580281385b4f79/users/c6a6ceb541d44e60a9b5491a7ad4246d/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:52.907735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62224cce-c49b-474e-9f7a-03ba78592d15 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:52.960622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 884/1761] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:52 2022] PUT /identity/v3/projects/826ce7737929467c93140b6b8a459043/users/14284a3eaa5949a2972692a8a13c0db1/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:52.961410 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00ed5d-63c3-446e-97c7-23aac960ac77 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:53.006854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62224cce-c49b-474e-9f7a-03ba78592d15 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:53.042381 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00ed5d-63c3-446e-97c7-23aac960ac77 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:53.048222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4531f0-817a-4c28-a6da-d39c72ed986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:53.048992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4531f0-817a-4c28-a6da-d39c72ed986f admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.049350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4531f0-817a-4c28-a6da-d39c72ed986f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.049810 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4531f0-817a-4c28-a6da-d39c72ed986f admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.050547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4531f0-817a-4c28-a6da-d39c72ed986f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:53.052259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4531f0-817a-4c28-a6da-d39c72ed986f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:53.063465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 885/1762] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:53.064353 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4531f0-817a-4c28-a6da-d39c72ed986f admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:53.078591 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795be91-e781-44f5-b288-a812b703d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:53.079603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4531f0-817a-4c28-a6da-d39c72ed986f admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:53.079722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795be91-e781-44f5-b288-a812b703d129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.080191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795be91-e781-44f5-b288-a812b703d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.080681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795be91-e781-44f5-b288-a812b703d129 admin admin] PATH_INFO: `/v3/projects/903092a1a1a04b7f883cba9c3f994888/users/f4909b4571224a2c968d5972d8ed7e36/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.084609 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795be91-e781-44f5-b288-a812b703d129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903092a1a1a04b7f883cba9c3f994888, user_id=f4909b4571224a2c968d5972d8ed7e36, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:53.084878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fccb2-9ad4-4af0-954e-436da0f3830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:53.085616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fccb2-9ad4-4af0-954e-436da0f3830a admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.085898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fccb2-9ad4-4af0-954e-436da0f3830a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.086233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fccb2-9ad4-4af0-954e-436da0f3830a admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.087041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fccb2-9ad4-4af0-954e-436da0f3830a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:53.088752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795be91-e781-44f5-b288-a812b703d129 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:53.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fccb2-9ad4-4af0-954e-436da0f3830a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:53.101803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 878/1763] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:52 2022] PUT /identity/v3/projects/903092a1a1a04b7f883cba9c3f994888/users/f4909b4571224a2c968d5972d8ed7e36/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:53.110774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795be91-e781-44f5-b288-a812b703d129 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:53.110774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9795be91-e781-44f5-b288-a812b703d129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:53.176415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795be91-e781-44f5-b288-a812b703d129 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:53.183664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:53.184322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.184609 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.184891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] PATH_INFO: `/v3/projects/2414803271914bc29f6e71378986de6b` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.186234 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2414803271914bc29f6e71378986de6b)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:53.188374 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:53.231188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 886/1764] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:53 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:53.232395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bec59-91f7-40a5-86db-1922e35ee744 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.232705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bec59-91f7-40a5-86db-1922e35ee744 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.233022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bec59-91f7-40a5-86db-1922e35ee744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.253956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-4d4bec59-91f7-40a5-86db-1922e35ee744 None None] MFA Rules not processed for user `bc8972d8bcec4e779a95a3b698641198`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:53.255190 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-4d4bec59-91f7-40a5-86db-1922e35ee744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:53.343416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 887/1765] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:53.344674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f44b9-1dd8-487b-8418-2d94816b8c10 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.344993 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f44b9-1dd8-487b-8418-2d94816b8c10 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.345269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f44b9-1dd8-487b-8418-2d94816b8c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.363743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2414803271914bc29f6e71378986de6b', 'request_id': 'req-400faf0d-1c1c-4060-a3d3-08d93be7540d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:53.371570 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2414803271914bc29f6e71378986de6b', 'request_id': 'req-400faf0d-1c1c-4060-a3d3-08d93be7540d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:53.385525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-769f44b9-1dd8-487b-8418-2d94816b8c10 None None] MFA Rules not processed for user `c6a6ceb541d44e60a9b5491a7ad4246d`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:53.386851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-769f44b9-1dd8-487b-8418-2d94816b8c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:53.471043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 888/1766] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:53.472679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f44b9-1dd8-487b-8418-2d94816b8c10 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:53.509869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:53.510722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2414803271914bc29f6e71378986de6b', 'request_id': 'req-400faf0d-1c1c-4060-a3d3-08d93be7540d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:53.528136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] The token cache is being invalidate because project 2414803271914bc29f6e71378986de6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:42:53.528426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:53.529209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:53.536433 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 879/1767] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:42:53 2022] DELETE /identity/v3/projects/2414803271914bc29f6e71378986de6b => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:53.537922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:53.540044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:53.582301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f44b9-1dd8-487b-8418-2d94816b8c10 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:53.590111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc476ff7-c6a1-45e0-9e97-c94f501825c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:53.590778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc476ff7-c6a1-45e0-9e97-c94f501825c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.591069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc476ff7-c6a1-45e0-9e97-c94f501825c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.591653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc476ff7-c6a1-45e0-9e97-c94f501825c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.592288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc476ff7-c6a1-45e0-9e97-c94f501825c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:53.594507 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc476ff7-c6a1-45e0-9e97-c94f501825c1 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:53.616087 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 889/1768] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:53.616087 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae15754-89e4-4ad4-83f9-4613103c4da8 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.616087 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae15754-89e4-4ad4-83f9-4613103c4da8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.616387 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae15754-89e4-4ad4-83f9-4613103c4da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.635108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400faf0d-1c1c-4060-a3d3-08d93be7540d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:53.643311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca182a-fbf6-4637-8fda-871a79b6b22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:53.644521 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca182a-fbf6-4637-8fda-871a79b6b22a admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.645046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca182a-fbf6-4637-8fda-871a79b6b22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.645879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca182a-fbf6-4637-8fda-871a79b6b22a admin admin] PATH_INFO: `/v3/projects/f1ab6c47a23647c689280b95fc897278/users/b1fdffd48cc44f63b3cce07d74b0841e/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.657261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-bae15754-89e4-4ad4-83f9-4613103c4da8 None None] MFA Rules not processed for user `f4909b4571224a2c968d5972d8ed7e36`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:53.658820 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-bae15754-89e4-4ad4-83f9-4613103c4da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:53.675360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca182a-fbf6-4637-8fda-871a79b6b22a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ab6c47a23647c689280b95fc897278, user_id=b1fdffd48cc44f63b3cce07d74b0841e, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:53.678967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca182a-fbf6-4637-8fda-871a79b6b22a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:53.764376 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 890/1769] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:53.764376 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae15754-89e4-4ad4-83f9-4613103c4da8 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:53.765853 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-bae15754-89e4-4ad4-83f9-4613103c4da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:53.781270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae15754-89e4-4ad4-83f9-4613103c4da8 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:53.786058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48d97a-bbbf-4f9e-8f2c-445aef50be1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:53.786789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48d97a-bbbf-4f9e-8f2c-445aef50be1b admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.787068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48d97a-bbbf-4f9e-8f2c-445aef50be1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.787338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48d97a-bbbf-4f9e-8f2c-445aef50be1b admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.788001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48d97a-bbbf-4f9e-8f2c-445aef50be1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:53.789957 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48d97a-bbbf-4f9e-8f2c-445aef50be1b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:53.827408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 880/1770] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:53 2022] PUT /identity/v3/projects/f1ab6c47a23647c689280b95fc897278/users/b1fdffd48cc44f63b3cce07d74b0841e/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:53.828543 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca182a-fbf6-4637-8fda-871a79b6b22a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:53.830269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f7ca182a-fbf6-4637-8fda-871a79b6b22a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:53.895611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 891/1771] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:53 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:53.896946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5493d-59f6-4e81-a1b8-9734ca773377 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.897230 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5493d-59f6-4e81-a1b8-9734ca773377 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.897531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5493d-59f6-4e81-a1b8-9734ca773377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.910565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca182a-fbf6-4637-8fda-871a79b6b22a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:53.916060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e2b72-b197-4073-9f4b-5035744993f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:53.916854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2b72-b197-4073-9f4b-5035744993f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.917068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2b72-b197-4073-9f4b-5035744993f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.917348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e2b72-b197-4073-9f4b-5035744993f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.918069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e2b72-b197-4073-9f4b-5035744993f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:53.919972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e2b72-b197-4073-9f4b-5035744993f8 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:53.931084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-9ce5493d-59f6-4e81-a1b8-9734ca773377 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:53.936065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9ce5493d-59f6-4e81-a1b8-9734ca773377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:53.942056 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 892/1772] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:53.943323 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5493d-59f6-4e81-a1b8-9734ca773377 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:53.944846 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9ce5493d-59f6-4e81-a1b8-9734ca773377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:53.959674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5493d-59f6-4e81-a1b8-9734ca773377 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:53.966791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3c616-260f-42ab-a00e-746d2beb791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:53.967463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3c616-260f-42ab-a00e-746d2beb791d admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.967748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3c616-260f-42ab-a00e-746d2beb791d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.968025 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3c616-260f-42ab-a00e-746d2beb791d admin admin] PATH_INFO: `/v3/projects/826ce7737929467c93140b6b8a459043/users/14284a3eaa5949a2972692a8a13c0db1/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.969999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3c616-260f-42ab-a00e-746d2beb791d admin admin] RBAC: Authorizing `identity:create_grant(project_id=826ce7737929467c93140b6b8a459043, user_id=14284a3eaa5949a2972692a8a13c0db1, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:53.973098 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3c616-260f-42ab-a00e-746d2beb791d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:53.986646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 893/1773] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:53 2022] PUT /identity/v3/projects/826ce7737929467c93140b6b8a459043/users/14284a3eaa5949a2972692a8a13c0db1/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:53.988154 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a10e5-da37-4f0e-9bc1-4e0a989d79b8 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:53.988437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a10e5-da37-4f0e-9bc1-4e0a989d79b8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:53.988714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a10e5-da37-4f0e-9bc1-4e0a989d79b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-c75a10e5-da37-4f0e-9bc1-4e0a989d79b8 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:42:53.996342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:42:53.997135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:42:54.000030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 894/1774] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:42:53 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 11 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 01 05:42:54.000030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a10e5-da37-4f0e-9bc1-4e0a989d79b8 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:54.001913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c75a10e5-da37-4f0e-9bc1-4e0a989d79b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:54.049478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 881/1775] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:53 2022] POST /identity/v3/projects => generated 367 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:54.050436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742c27-a644-4737-aa5d-690f9ad14a0c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.058441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742c27-a644-4737-aa5d-690f9ad14a0c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.058441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e742c27-a644-4737-aa5d-690f9ad14a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.075124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-2e742c27-a644-4737-aa5d-690f9ad14a0c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:54.076424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2e742c27-a644-4737-aa5d-690f9ad14a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:54.086246 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a10e5-da37-4f0e-9bc1-4e0a989d79b8 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:54.142646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0a384-08b2-4db8-87d2-06f7dec6dda6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:54.143262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0a384-08b2-4db8-87d2-06f7dec6dda6 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.143540 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0a384-08b2-4db8-87d2-06f7dec6dda6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.143817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0a384-08b2-4db8-87d2-06f7dec6dda6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.147791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 882/1776] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:54.147791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e742c27-a644-4737-aa5d-690f9ad14a0c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:54.155889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e742c27-a644-4737-aa5d-690f9ad14a0c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:54.161843 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e42eb-470c-4806-85dc-117af70f2306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:54.162900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e42eb-470c-4806-85dc-117af70f2306 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.163349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e42eb-470c-4806-85dc-117af70f2306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.163732 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e42eb-470c-4806-85dc-117af70f2306 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.165461 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e42eb-470c-4806-85dc-117af70f2306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:54.169078 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e42eb-470c-4806-85dc-117af70f2306 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:54.189810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 883/1777] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:54.194293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6adea-73dc-4a8b-9e6d-646fda2c2722 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.194293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6adea-73dc-4a8b-9e6d-646fda2c2722 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.194293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6adea-73dc-4a8b-9e6d-646fda2c2722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.225343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0a384-08b2-4db8-87d2-06f7dec6dda6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:54.226872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0a384-08b2-4db8-87d2-06f7dec6dda6 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:54.237463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-0fd6adea-73dc-4a8b-9e6d-646fda2c2722 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:54.238557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 895/1778] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:54.239403 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0a384-08b2-4db8-87d2-06f7dec6dda6 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:54.263254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0fd6adea-73dc-4a8b-9e6d-646fda2c2722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:54.263344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0a384-08b2-4db8-87d2-06f7dec6dda6 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:54.267504 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02264fc2-07e5-4803-930f-5121cfecb6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:54.268634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02264fc2-07e5-4803-930f-5121cfecb6bc admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.269162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02264fc2-07e5-4803-930f-5121cfecb6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.269715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02264fc2-07e5-4803-930f-5121cfecb6bc admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.271002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02264fc2-07e5-4803-930f-5121cfecb6bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:54.273184 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02264fc2-07e5-4803-930f-5121cfecb6bc admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:54.277559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 884/1779] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:54.283712 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6adea-73dc-4a8b-9e6d-646fda2c2722 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:54.287482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0fd6adea-73dc-4a8b-9e6d-646fda2c2722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:54.358245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6adea-73dc-4a8b-9e6d-646fda2c2722 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:54.362377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82052564-8b12-46b3-8d7c-10d1a91fcbfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:54.363117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82052564-8b12-46b3-8d7c-10d1a91fcbfd service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.363484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82052564-8b12-46b3-8d7c-10d1a91fcbfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.363826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82052564-8b12-46b3-8d7c-10d1a91fcbfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.379466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82052564-8b12-46b3-8d7c-10d1a91fcbfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:54.380963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82052564-8b12-46b3-8d7c-10d1a91fcbfd service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:54.393620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 885/1780] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:54.394599 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82052564-8b12-46b3-8d7c-10d1a91fcbfd service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:54.404979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82052564-8b12-46b3-8d7c-10d1a91fcbfd service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:54.409638 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087bc27-14b0-460a-a7c5-bd1190e7aecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:54.410257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087bc27-14b0-460a-a7c5-bd1190e7aecb admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.410538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087bc27-14b0-460a-a7c5-bd1190e7aecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.410828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087bc27-14b0-460a-a7c5-bd1190e7aecb admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.411805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087bc27-14b0-460a-a7c5-bd1190e7aecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:54.413724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087bc27-14b0-460a-a7c5-bd1190e7aecb admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:54.427858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 886/1781] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:54.429545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087bc27-14b0-460a-a7c5-bd1190e7aecb admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:54.442984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087bc27-14b0-460a-a7c5-bd1190e7aecb admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:54.443358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 896/1782] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:54 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:54.444275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02264fc2-07e5-4803-930f-5121cfecb6bc admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:54.451183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5795-5706-49bd-9833-1af1af52ee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:54.451839 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5795-5706-49bd-9833-1af1af52ee20 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.452119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5795-5706-49bd-9833-1af1af52ee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.452704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c5795-5706-49bd-9833-1af1af52ee20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.453533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5795-5706-49bd-9833-1af1af52ee20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:42:54.454002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5795-5706-49bd-9833-1af1af52ee20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:54.455817 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c5795-5706-49bd-9833-1af1af52ee20 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:54.456079 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02264fc2-07e5-4803-930f-5121cfecb6bc admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:54.464172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e369ed3-3cfb-4146-90ae-a0627919c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:54.464878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e369ed3-3cfb-4146-90ae-a0627919c967 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.465178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e369ed3-3cfb-4146-90ae-a0627919c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.465825 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e369ed3-3cfb-4146-90ae-a0627919c967 admin admin] PATH_INFO: `/v3/projects/3adff77b66e04fecb1b8050ae849a050/users/baf01c91da264661a5b30fbc9d996dd2/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.469725 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 887/1783] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:42:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:42:54.470990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5795-5706-49bd-9833-1af1af52ee20 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:54.481286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c5795-5706-49bd-9833-1af1af52ee20 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:54.484803 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e369ed3-3cfb-4146-90ae-a0627919c967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3adff77b66e04fecb1b8050ae849a050, user_id=baf01c91da264661a5b30fbc9d996dd2, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:54.486973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842210ec-f9a3-42c1-a806-a2ecc90c2a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:54.487255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842210ec-f9a3-42c1-a806-a2ecc90c2a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.487536 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842210ec-f9a3-42c1-a806-a2ecc90c2a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.487811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842210ec-f9a3-42c1-a806-a2ecc90c2a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.489097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842210ec-f9a3-42c1-a806-a2ecc90c2a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:54.489205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e369ed3-3cfb-4146-90ae-a0627919c967 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:54.490908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842210ec-f9a3-42c1-a806-a2ecc90c2a7e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:54.501883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 888/1784] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:54.502729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842210ec-f9a3-42c1-a806-a2ecc90c2a7e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:54.514283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842210ec-f9a3-42c1-a806-a2ecc90c2a7e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:54.519027 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79d5a4-ee43-4278-85fb-b88ba535812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:54.519662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79d5a4-ee43-4278-85fb-b88ba535812a admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.519942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79d5a4-ee43-4278-85fb-b88ba535812a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.520228 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79d5a4-ee43-4278-85fb-b88ba535812a admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.520881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79d5a4-ee43-4278-85fb-b88ba535812a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:54.522859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79d5a4-ee43-4278-85fb-b88ba535812a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:54.543794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:54.672025 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 897/1785] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:54 2022] PUT /identity/v3/projects/3adff77b66e04fecb1b8050ae849a050/users/baf01c91da264661a5b30fbc9d996dd2/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:54.673681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e369ed3-3cfb-4146-90ae-a0627919c967 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:54.751953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 889/1786] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:54 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:54.756261 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f1ae4-ae88-4230-b845-6d13f9a56d69 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.756993 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f1ae4-ae88-4230-b845-6d13f9a56d69 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.757613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f1ae4-ae88-4230-b845-6d13f9a56d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.773123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e369ed3-3cfb-4146-90ae-a0627919c967 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:54.861576 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-6d4f1ae4-ae88-4230-b845-6d13f9a56d69 None None] MFA Rules not processed for user `baf01c91da264661a5b30fbc9d996dd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:54.862183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb759b8-77a2-4d08-975a-6fbeabf27746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:54.862183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb759b8-77a2-4d08-975a-6fbeabf27746 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:54.862183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb759b8-77a2-4d08-975a-6fbeabf27746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:54.862183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb759b8-77a2-4d08-975a-6fbeabf27746 admin admin] PATH_INFO: `/v3/projects/7384bad14fb64386b8902d346ce85993/users/b38950e555cd4e4ba8f88436551ffc05/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:54.862903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6d4f1ae4-ae88-4230-b845-6d13f9a56d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:54.876574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb759b8-77a2-4d08-975a-6fbeabf27746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7384bad14fb64386b8902d346ce85993, user_id=b38950e555cd4e4ba8f88436551ffc05, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:54.876574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb759b8-77a2-4d08-975a-6fbeabf27746 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:55.051036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 890/1787] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:55.051036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f1ae4-ae88-4230-b845-6d13f9a56d69 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:55.084325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f1ae4-ae88-4230-b845-6d13f9a56d69 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:55.095030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 898/1788] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:54 2022] PUT /identity/v3/projects/7384bad14fb64386b8902d346ce85993/users/b38950e555cd4e4ba8f88436551ffc05/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:55.096002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb759b8-77a2-4d08-975a-6fbeabf27746 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:55.100603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-cfb759b8-77a2-4d08-975a-6fbeabf27746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:55.211556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb759b8-77a2-4d08-975a-6fbeabf27746 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:55.214838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f61c4-a530-4786-883e-feb756e9f228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:55.217805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f61c4-a530-4786-883e-feb756e9f228 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:55.218950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f61c4-a530-4786-883e-feb756e9f228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:55.219066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f76d0-2e60-41db-bc0a-1a31d6205f35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:55.219432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f61c4-a530-4786-883e-feb756e9f228 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:55.219654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f76d0-2e60-41db-bc0a-1a31d6205f35 service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:55.219947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f76d0-2e60-41db-bc0a-1a31d6205f35 service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:55.220722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f61c4-a530-4786-883e-feb756e9f228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:55.220869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f76d0-2e60-41db-bc0a-1a31d6205f35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:55.227045 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f61c4-a530-4786-883e-feb756e9f228 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:55.301148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f76d0-2e60-41db-bc0a-1a31d6205f35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:55.302880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f76d0-2e60-41db-bc0a-1a31d6205f35 service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:55.313564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 899/1789] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:55.314568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f76d0-2e60-41db-bc0a-1a31d6205f35 service nova] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:55.328912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f76d0-2e60-41db-bc0a-1a31d6205f35 service nova] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:55.334013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d3bfa-836d-4eeb-8898-028b69b74e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:55.334641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d3bfa-836d-4eeb-8898-028b69b74e40 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:55.346783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d3bfa-836d-4eeb-8898-028b69b74e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:55.346783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d3bfa-836d-4eeb-8898-028b69b74e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:55.346783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d3bfa-836d-4eeb-8898-028b69b74e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:55.346783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d3bfa-836d-4eeb-8898-028b69b74e40 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:55.351143 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 900/1790] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:55.358226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d3bfa-836d-4eeb-8898-028b69b74e40 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:55.386231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 891/1791] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:55 2022] POST /identity/v3/users => generated 293 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:55.387745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f61c4-a530-4786-883e-feb756e9f228 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:55.390367 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d3bfa-836d-4eeb-8898-028b69b74e40 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:55.406636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f61c4-a530-4786-883e-feb756e9f228 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:55.409982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2c5d0-5e34-4208-b8dd-7bbca7fc7e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:55.410971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2c5d0-5e34-4208-b8dd-7bbca7fc7e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:55.412145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2c5d0-5e34-4208-b8dd-7bbca7fc7e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:55.412462 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2c5d0-5e34-4208-b8dd-7bbca7fc7e9d admin admin] PATH_INFO: `/v3/projects/7384bad14fb64386b8902d346ce85993/users/b38950e555cd4e4ba8f88436551ffc05/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:55.416673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2c5d0-5e34-4208-b8dd-7bbca7fc7e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7384bad14fb64386b8902d346ce85993, user_id=b38950e555cd4e4ba8f88436551ffc05, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:55.420225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2c5d0-5e34-4208-b8dd-7bbca7fc7e9d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:55.431984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de346fc3-1ba2-4ff3-a48c-191442bcf8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:55.432866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de346fc3-1ba2-4ff3-a48c-191442bcf8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:55.433663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de346fc3-1ba2-4ff3-a48c-191442bcf8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:55.433663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de346fc3-1ba2-4ff3-a48c-191442bcf8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:55.434128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de346fc3-1ba2-4ff3-a48c-191442bcf8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:55.438918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de346fc3-1ba2-4ff3-a48c-191442bcf8ae admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:55.457199 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 901/1792] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:55 2022] PUT /identity/v3/projects/7384bad14fb64386b8902d346ce85993/users/b38950e555cd4e4ba8f88436551ffc05/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:42:55.464453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 892/1793] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:55.465889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2c5d0-5e34-4208-b8dd-7bbca7fc7e9d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:55.469711 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0e1fa-7558-4bfd-92ed-b0459a0957d0 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:55.470447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0e1fa-7558-4bfd-92ed-b0459a0957d0 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:55.470731 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0e1fa-7558-4bfd-92ed-b0459a0957d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:55.546553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-58a0e1fa-7558-4bfd-92ed-b0459a0957d0 None None] MFA Rules not processed for user `b38950e555cd4e4ba8f88436551ffc05`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:55.548036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-58a0e1fa-7558-4bfd-92ed-b0459a0957d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:55.615938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2c5d0-5e34-4208-b8dd-7bbca7fc7e9d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:55.624338 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99075e-7a59-4bbf-b3f1-99832f343654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:55.624997 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99075e-7a59-4bbf-b3f1-99832f343654 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:55.626041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99075e-7a59-4bbf-b3f1-99832f343654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:55.626337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99075e-7a59-4bbf-b3f1-99832f343654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:55.628622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99075e-7a59-4bbf-b3f1-99832f343654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:55.631299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99075e-7a59-4bbf-b3f1-99832f343654 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:55.645292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 902/1794] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:55.652374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99075e-7a59-4bbf-b3f1-99832f343654 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:55.668937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99075e-7a59-4bbf-b3f1-99832f343654 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:55.681687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42ef3f-9846-44e9-a280-0cc111cc996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:55.682379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42ef3f-9846-44e9-a280-0cc111cc996c admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:55.682601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42ef3f-9846-44e9-a280-0cc111cc996c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:55.682886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42ef3f-9846-44e9-a280-0cc111cc996c admin admin] PATH_INFO: `/v3/projects/7c778fcbe13246659f2ad449d3c4cbd7/users/db1518754c1f446592a17925b86ced4d/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:55.708855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42ef3f-9846-44e9-a280-0cc111cc996c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c778fcbe13246659f2ad449d3c4cbd7, user_id=db1518754c1f446592a17925b86ced4d, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:55.712851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42ef3f-9846-44e9-a280-0cc111cc996c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:55.739951 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 893/1795] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:55.910138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 903/1796] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:55 2022] PUT /identity/v3/projects/7c778fcbe13246659f2ad449d3c4cbd7/users/db1518754c1f446592a17925b86ced4d/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:55.920749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d62f62-b986-439f-b3cd-9682aec6db9e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:55.921040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d62f62-b986-439f-b3cd-9682aec6db9e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:55.921324 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d62f62-b986-439f-b3cd-9682aec6db9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:55.964226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-50d62f62-b986-439f-b3cd-9682aec6db9e None None] MFA Rules not processed for user `db1518754c1f446592a17925b86ced4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:55.965824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-50d62f62-b986-439f-b3cd-9682aec6db9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:56.060636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 894/1797] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:56.065183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42ef3f-9846-44e9-a280-0cc111cc996c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:56.170346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42ef3f-9846-44e9-a280-0cc111cc996c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:56.175493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e490d-b30d-433c-a890-d4aa64f988f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:56.176393 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e490d-b30d-433c-a890-d4aa64f988f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:56.176531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e490d-b30d-433c-a890-d4aa64f988f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:56.176709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e490d-b30d-433c-a890-d4aa64f988f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:56.190275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e490d-b30d-433c-a890-d4aa64f988f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:56.192424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e490d-b30d-433c-a890-d4aa64f988f2 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:56.366327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d62f62-b986-439f-b3cd-9682aec6db9e None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:56.367848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-50d62f62-b986-439f-b3cd-9682aec6db9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:56.468338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d62f62-b986-439f-b3cd-9682aec6db9e None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:56.473608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce7402-e08d-4256-9d16-681646a18f25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:56.474471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce7402-e08d-4256-9d16-681646a18f25 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:56.474849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce7402-e08d-4256-9d16-681646a18f25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:56.475221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce7402-e08d-4256-9d16-681646a18f25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:56.624475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 904/1798] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:42:56 2022] POST /identity/v3/projects => generated 385 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:56.625040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce7402-e08d-4256-9d16-681646a18f25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:56.626596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce7402-e08d-4256-9d16-681646a18f25 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:56.628021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2f0e-61b2-4506-87d6-c31d541a4aa1 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:56.628936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2f0e-61b2-4506-87d6-c31d541a4aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:56.631067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a2f0e-61b2-4506-87d6-c31d541a4aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:56.651786 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 895/1799] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:56.653169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce7402-e08d-4256-9d16-681646a18f25 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:56.687850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce7402-e08d-4256-9d16-681646a18f25 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:56.691093 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-e00a2f0e-61b2-4506-87d6-c31d541a4aa1 None None] MFA Rules not processed for user `14284a3eaa5949a2972692a8a13c0db1`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:56.693714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e00a2f0e-61b2-4506-87d6-c31d541a4aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:56.824971 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e630a-a34e-4da6-b841-7843d3ff4fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:56.826504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e630a-a34e-4da6-b841-7843d3ff4fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:56.827239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e630a-a34e-4da6-b841-7843d3ff4fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:56.829567 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e630a-a34e-4da6-b841-7843d3ff4fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:56.831173 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e630a-a34e-4da6-b841-7843d3ff4fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:56.843991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e630a-a34e-4da6-b841-7843d3ff4fc0 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:56.871360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:42:56.888886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 905/1800] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:56 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:57.101594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 896/1801] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:42:56 2022] POST /identity/v3/users => generated 299 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:42:57.104158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a2f0e-61b2-4506-87d6-c31d541a4aa1 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:57.120564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e630a-a34e-4da6-b841-7843d3ff4fc0 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:57.125692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a2f0e-61b2-4506-87d6-c31d541a4aa1 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:57.131618 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59608e-00cd-4294-b431-4b4868e476b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:57.132256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59608e-00cd-4294-b431-4b4868e476b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:57.132544 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59608e-00cd-4294-b431-4b4868e476b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:57.132822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59608e-00cd-4294-b431-4b4868e476b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:57.133528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59608e-00cd-4294-b431-4b4868e476b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:57.136001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59608e-00cd-4294-b431-4b4868e476b6 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:57.158441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 906/1802] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:42:57.166911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59608e-00cd-4294-b431-4b4868e476b6 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:57.205679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59608e-00cd-4294-b431-4b4868e476b6 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:57.217999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4020cb-2c1f-4edd-8259-aaac4d5ce7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:57.219368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4020cb-2c1f-4edd-8259-aaac4d5ce7c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:57.219789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4020cb-2c1f-4edd-8259-aaac4d5ce7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:57.220207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4020cb-2c1f-4edd-8259-aaac4d5ce7c6 admin admin] PATH_INFO: `/v3/projects/bf6d654c760d453390d6216e3d290095/users/e13325db5850430ebcae6daaf1ab1be0/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:57.247312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4020cb-2c1f-4edd-8259-aaac4d5ce7c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6d654c760d453390d6216e3d290095, user_id=e13325db5850430ebcae6daaf1ab1be0, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:57.250821 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4020cb-2c1f-4edd-8259-aaac4d5ce7c6 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:57.274806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e630a-a34e-4da6-b841-7843d3ff4fc0 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:57.283290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9afb1e-ad0d-4f45-99db-37a095e70c1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:57.285236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9afb1e-ad0d-4f45-99db-37a095e70c1e service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:57.285236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9afb1e-ad0d-4f45-99db-37a095e70c1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:57.286177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9afb1e-ad0d-4f45-99db-37a095e70c1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:57.290005 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1b9afb1e-ad0d-4f45-99db-37a095e70c1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:57.402672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9afb1e-ad0d-4f45-99db-37a095e70c1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:57.404439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9afb1e-ad0d-4f45-99db-37a095e70c1e service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:57.417032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 897/1803] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:42:57.836927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 907/1804] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:57 2022] PUT /identity/v3/projects/bf6d654c760d453390d6216e3d290095/users/e13325db5850430ebcae6daaf1ab1be0/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:57.841737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9afb1e-ad0d-4f45-99db-37a095e70c1e service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:57.854340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9afb1e-ad0d-4f45-99db-37a095e70c1e service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:57.924952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4020cb-2c1f-4edd-8259-aaac4d5ce7c6 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:57.927051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-cd4020cb-2c1f-4edd-8259-aaac4d5ce7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:57.992239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d217d-3dcf-4e00-b209-f57110780a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:57.999448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d217d-3dcf-4e00-b209-f57110780a11 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:57.999448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d217d-3dcf-4e00-b209-f57110780a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:57.999448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d217d-3dcf-4e00-b209-f57110780a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:57.999448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d217d-3dcf-4e00-b209-f57110780a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:57.999448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d217d-3dcf-4e00-b209-f57110780a11 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:58.023328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 898/1805] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:42:58.028880 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d217d-3dcf-4e00-b209-f57110780a11 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:58.063457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d217d-3dcf-4e00-b209-f57110780a11 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:58.071730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22569b10-bd4b-462a-997f-c51059988dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:58.072544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22569b10-bd4b-462a-997f-c51059988dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:58.072881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22569b10-bd4b-462a-997f-c51059988dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:58.073162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22569b10-bd4b-462a-997f-c51059988dca admin admin] PATH_INFO: `/v3/projects/bf6d654c760d453390d6216e3d290095/users/e13325db5850430ebcae6daaf1ab1be0/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:58.099049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22569b10-bd4b-462a-997f-c51059988dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6d654c760d453390d6216e3d290095, user_id=e13325db5850430ebcae6daaf1ab1be0, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:58.106562 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22569b10-bd4b-462a-997f-c51059988dca admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:58.123525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4020cb-2c1f-4edd-8259-aaac4d5ce7c6 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:58.135506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 899/1806] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:42:58 2022] PUT /identity/v3/projects/bf6d654c760d453390d6216e3d290095/users/e13325db5850430ebcae6daaf1ab1be0/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:42:58.147850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d166d59-0b9a-4db1-8de0-075d90bd5a02 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:58.148124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d166d59-0b9a-4db1-8de0-075d90bd5a02 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:58.148410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d166d59-0b9a-4db1-8de0-075d90bd5a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:58.200952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-5d166d59-0b9a-4db1-8de0-075d90bd5a02 None None] MFA Rules not processed for user `e13325db5850430ebcae6daaf1ab1be0`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:58.203969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5d166d59-0b9a-4db1-8de0-075d90bd5a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:58.276853 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7586e40-d0f2-478d-80ba-dfb619d066a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:58.277790 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7586e40-d0f2-478d-80ba-dfb619d066a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:58.278201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7586e40-d0f2-478d-80ba-dfb619d066a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:58.278752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7586e40-d0f2-478d-80ba-dfb619d066a3 admin admin] PATH_INFO: `/v3/users/6043b89f06164e8c8db58c3e1dcf4331` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:58.280316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7586e40-d0f2-478d-80ba-dfb619d066a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6043b89f06164e8c8db58c3e1dcf4331)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:58.287397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7586e40-d0f2-478d-80ba-dfb619d066a3 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:58.409553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 900/1807] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:58.423292 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d166d59-0b9a-4db1-8de0-075d90bd5a02 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:58.547656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d166d59-0b9a-4db1-8de0-075d90bd5a02 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:58.557913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b03ebe-1894-456d-a744-c16f81c08c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:58.561241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b03ebe-1894-456d-a744-c16f81c08c93 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:58.561627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b03ebe-1894-456d-a744-c16f81c08c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:58.562346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b03ebe-1894-456d-a744-c16f81c08c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:58.695684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b03ebe-1894-456d-a744-c16f81c08c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:58.698683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b03ebe-1894-456d-a744-c16f81c08c93 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:58.719224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 901/1808] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:58.729454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d7586e40-d0f2-478d-80ba-dfb619d066a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6043b89f06164e8c8db58c3e1dcf4331'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:58.732642 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17992722-0e23-4dce-8455-ef0d7e5c7438 None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:58.734928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17992722-0e23-4dce-8455-ef0d7e5c7438 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:58.737656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17992722-0e23-4dce-8455-ef0d7e5c7438 None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:58.745166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 902/1809] 10.222.0.48 () {54 vars in 921 bytes} [Thu Sep 1 05:42:58 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:42:58.762415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d7586e40-d0f2-478d-80ba-dfb619d066a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6043b89f06164e8c8db58c3e1dcf4331'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:58.768487 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4cd98-f856-4577-8109-aa9c76b97101 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:58.769193 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4cd98-f856-4577-8109-aa9c76b97101 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:58.769734 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4cd98-f856-4577-8109-aa9c76b97101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:58.777669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d7586e40-d0f2-478d-80ba-dfb619d066a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6043b89f06164e8c8db58c3e1dcf4331'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:58.819681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-f6d4cd98-f856-4577-8109-aa9c76b97101 None None] MFA Rules not processed for user `055823f7760f485eb91266a0d63db602`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:58.820912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f6d4cd98-f856-4577-8109-aa9c76b97101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:58.935427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d7586e40-d0f2-478d-80ba-dfb619d066a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6043b89f06164e8c8db58c3e1dcf4331'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:58.936290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d7586e40-d0f2-478d-80ba-dfb619d066a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6043b89f06164e8c8db58c3e1dcf4331'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:42:58.952367 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 908/1810] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:42:57 2022] DELETE /identity/v3/users/6043b89f06164e8c8db58c3e1dcf4331 => generated 0 bytes in 1028 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:42:58.959538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5b85c-7b18-42e1-a677-d1f3c44827ca None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:58.960608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5b85c-7b18-42e1-a677-d1f3c44827ca None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:58.960608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5b85c-7b18-42e1-a677-d1f3c44827ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:59.016681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 903/1811] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Sep 1 05:42:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:42:59.060457 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-0bd5b85c-7b18-42e1-a677-d1f3c44827ca None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:42:59.084899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0bd5b85c-7b18-42e1-a677-d1f3c44827ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:59.318204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4cd98-f856-4577-8109-aa9c76b97101 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:59.323210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f6d4cd98-f856-4577-8109-aa9c76b97101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:59.345880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 909/1812] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:42:59.388735 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5b85c-7b18-42e1-a677-d1f3c44827ca None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:42:59.391446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0bd5b85c-7b18-42e1-a677-d1f3c44827ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:42:59.401190 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4cd98-f856-4577-8109-aa9c76b97101 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:59.554910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5b85c-7b18-42e1-a677-d1f3c44827ca None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:42:59.561240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21351ff4-4d47-4e39-b78f-ac47c2ffc90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:59.562217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21351ff4-4d47-4e39-b78f-ac47c2ffc90b service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:59.562645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21351ff4-4d47-4e39-b78f-ac47c2ffc90b service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:59.563133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21351ff4-4d47-4e39-b78f-ac47c2ffc90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:59.578203 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21351ff4-4d47-4e39-b78f-ac47c2ffc90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:59.580093 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21351ff4-4d47-4e39-b78f-ac47c2ffc90b service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:59.594565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 910/1813] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:59.601178 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b6bd7-0a1f-4185-8ada-220e6193e215 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055823f7760f485eb91266a0d63db602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:42:59.603821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b6bd7-0a1f-4185-8ada-220e6193e215 service placement] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:42:59.603821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b6bd7-0a1f-4185-8ada-220e6193e215 service placement] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:42:59.603821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b6bd7-0a1f-4185-8ada-220e6193e215 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:42:59.663216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b6bd7-0a1f-4185-8ada-220e6193e215 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:42:59.669924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b6bd7-0a1f-4185-8ada-220e6193e215 service placement] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:42:59.691398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 904/1814] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:42:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:42:59.710140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:00.024888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:00.686556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21351ff4-4d47-4e39-b78f-ac47c2ffc90b service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:00.691229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-21351ff4-4d47-4e39-b78f-ac47c2ffc90b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:00.736115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21351ff4-4d47-4e39-b78f-ac47c2ffc90b service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:00.752152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:00.752927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:00.753606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:00.754067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] PATH_INFO: `/v3/users/19269acf1bb14b3ab1556fba4bbf5c14` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:00.756030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19269acf1bb14b3ab1556fba4bbf5c14)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:00.761565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:01.120033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19269acf1bb14b3ab1556fba4bbf5c14'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:01.158461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19269acf1bb14b3ab1556fba4bbf5c14'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:01.195031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19269acf1bb14b3ab1556fba4bbf5c14'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:01.385973 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19269acf1bb14b3ab1556fba4bbf5c14'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:01.388341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19269acf1bb14b3ab1556fba4bbf5c14'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:01.411127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 911/1815] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:00 2022] DELETE /identity/v3/users/19269acf1bb14b3ab1556fba4bbf5c14 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:01.505441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b6bd7-0a1f-4185-8ada-220e6193e215 service placement] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:01.507898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f30b6bd7-0a1f-4185-8ada-220e6193e215 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:01.577786 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b6bd7-0a1f-4185-8ada-220e6193e215 service placement] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:01.656886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:01.659657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:01.809983 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:01.825656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:01.827885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:01.829493 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] PATH_INFO: `/v3/projects/35ec08c3882d4561ad2639d79d96da02` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:01.837815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ec08c3882d4561ad2639d79d96da02)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:01.843665 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:01.874687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2c1e-f3e2-4809-91cd-ca77ba6c0d8c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:01.922653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:01.929153 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:01.929153 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:01.929153 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] PATH_INFO: `/v3/users/baf01c91da264661a5b30fbc9d996dd2` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:01.934982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=baf01c91da264661a5b30fbc9d996dd2)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:01.939104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:02.102912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ec08c3882d4561ad2639d79d96da02', 'request_id': 'req-1498d90f-e272-4a3c-8a88-f9a7dd909773'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:02.111277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ec08c3882d4561ad2639d79d96da02', 'request_id': 'req-1498d90f-e272-4a3c-8a88-f9a7dd909773'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:02.279855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ec08c3882d4561ad2639d79d96da02', 'request_id': 'req-1498d90f-e272-4a3c-8a88-f9a7dd909773'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:02.314761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] The token cache is being invalidate because project 35ec08c3882d4561ad2639d79d96da02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:02.314761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:02.314761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:02.317856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 905/1816] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:01 2022] DELETE /identity/v3/projects/35ec08c3882d4561ad2639d79d96da02 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:02.319391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:02.322128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:02.334459 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baf01c91da264661a5b30fbc9d996dd2'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:02.362186 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baf01c91da264661a5b30fbc9d996dd2'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:02.389739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baf01c91da264661a5b30fbc9d996dd2'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:02.475057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498d90f-e272-4a3c-8a88-f9a7dd909773 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:02.486131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:02.487288 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:02.487677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:02.488063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] PATH_INFO: `/v3/projects/8d83792cc6384009b4a291bd25e6b816` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:02.489631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d83792cc6384009b4a291bd25e6b816)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:02.492530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:02.518670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baf01c91da264661a5b30fbc9d996dd2'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:02.518670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baf01c91da264661a5b30fbc9d996dd2'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:02.538701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 912/1817] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:01 2022] DELETE /identity/v3/users/baf01c91da264661a5b30fbc9d996dd2 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:02.540852 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:02.552783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:02.793643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b9bb1-9409-4490-892f-f0435c5b3cfe admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:02.825083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a5e82-673c-4e25-b4ee-590a588fb354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:02.826591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a5e82-673c-4e25-b4ee-590a588fb354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:02.827581 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a5e82-673c-4e25-b4ee-590a588fb354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:02.828165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a5e82-673c-4e25-b4ee-590a588fb354 admin admin] PATH_INFO: `/v3/users/f4909b4571224a2c968d5972d8ed7e36` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:02.830802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a5e82-673c-4e25-b4ee-590a588fb354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4909b4571224a2c968d5972d8ed7e36)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:02.836388 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a5e82-673c-4e25-b4ee-590a588fb354 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:03.520135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-fe4a5e82-673c-4e25-b4ee-590a588fb354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4909b4571224a2c968d5972d8ed7e36'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:03.540778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d83792cc6384009b4a291bd25e6b816', 'request_id': 'req-54e65286-990c-46f7-a834-1410ca722444'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:03.541356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-fe4a5e82-673c-4e25-b4ee-590a588fb354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4909b4571224a2c968d5972d8ed7e36'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:03.552389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-fe4a5e82-673c-4e25-b4ee-590a588fb354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4909b4571224a2c968d5972d8ed7e36'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:03.554540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d83792cc6384009b4a291bd25e6b816', 'request_id': 'req-54e65286-990c-46f7-a834-1410ca722444'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:03.853404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-fe4a5e82-673c-4e25-b4ee-590a588fb354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4909b4571224a2c968d5972d8ed7e36'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:03.854598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-fe4a5e82-673c-4e25-b4ee-590a588fb354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4909b4571224a2c968d5972d8ed7e36'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:03.863052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 913/1818] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:02 2022] DELETE /identity/v3/users/f4909b4571224a2c968d5972d8ed7e36 => generated 0 bytes in 1323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:03.864930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9aeae-109e-431b-b598-231535f5f0d3 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:03.865487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9aeae-109e-431b-b598-231535f5f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:03.866145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9aeae-109e-431b-b598-231535f5f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:03.943693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-62e9aeae-109e-431b-b598-231535f5f0d3 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:03.952228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-62e9aeae-109e-431b-b598-231535f5f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:03.990564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d83792cc6384009b4a291bd25e6b816', 'request_id': 'req-54e65286-990c-46f7-a834-1410ca722444'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:04.043587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] The token cache is being invalidate because project 8d83792cc6384009b4a291bd25e6b816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:04.049910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:04.051484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:04.062608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 906/1819] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:02 2022] DELETE /identity/v3/projects/8d83792cc6384009b4a291bd25e6b816 => generated 0 bytes in 1739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:04.069745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:04.077871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:04.193443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 914/1820] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:04.194653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9aeae-109e-431b-b598-231535f5f0d3 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:04.198902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-62e9aeae-109e-431b-b598-231535f5f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:04.216547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9aeae-109e-431b-b598-231535f5f0d3 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:04.223366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:04.224020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:04.224298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:04.224571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] PATH_INFO: `/v3/users/bc8972d8bcec4e779a95a3b698641198` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:04.225864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8972d8bcec4e779a95a3b698641198)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:04.228313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:04.238316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e65286-990c-46f7-a834-1410ca722444 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:04.250217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:04.251330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:04.251330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:04.253095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] PATH_INFO: `/v3/users/14284a3eaa5949a2972692a8a13c0db1` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:04.254130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=14284a3eaa5949a2972692a8a13c0db1)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:04.256652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:04.708422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14284a3eaa5949a2972692a8a13c0db1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:04.713641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8972d8bcec4e779a95a3b698641198'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:04.730884 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14284a3eaa5949a2972692a8a13c0db1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:04.740985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8972d8bcec4e779a95a3b698641198'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:04.752290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8972d8bcec4e779a95a3b698641198'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:04.873929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14284a3eaa5949a2972692a8a13c0db1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:04.877637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:04.879633 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14284a3eaa5949a2972692a8a13c0db1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:04.880951 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14284a3eaa5949a2972692a8a13c0db1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:04.924409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 907/1821] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:04 2022] DELETE /identity/v3/users/14284a3eaa5949a2972692a8a13c0db1 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:04.924409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:04.928449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:04.996024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8972d8bcec4e779a95a3b698641198'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:04.997192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8972d8bcec4e779a95a3b698641198'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:05.011752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 915/1822] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:04 2022] DELETE /identity/v3/users/bc8972d8bcec4e779a95a3b698641198 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:05.013233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:05.017344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:05.020368 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e09dce-534a-40de-b1ab-3580d69eb5dd admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:05.093792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3149fda-ee29-4db7-8225-403c915b7546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:05.094958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3149fda-ee29-4db7-8225-403c915b7546 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:05.095553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3149fda-ee29-4db7-8225-403c915b7546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:05.096006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3149fda-ee29-4db7-8225-403c915b7546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:05.099408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c3149fda-ee29-4db7-8225-403c915b7546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:05.201434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343c268-639c-4172-9876-8aa2ab70c532 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:05.215877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:05.216528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:05.216816 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:05.217101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] PATH_INFO: `/v3/projects/903092a1a1a04b7f883cba9c3f994888` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:05.224296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903092a1a1a04b7f883cba9c3f994888)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:05.235857 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:05.241677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3149fda-ee29-4db7-8225-403c915b7546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:05.247641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3149fda-ee29-4db7-8225-403c915b7546 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:05.277243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 908/1823] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:05.338040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:05.474417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903092a1a1a04b7f883cba9c3f994888', 'request_id': 'req-aca0526a-0451-4cb2-ba07-2b787bab82b9'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:05.584655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3149fda-ee29-4db7-8225-403c915b7546 service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:05.586347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c3149fda-ee29-4db7-8225-403c915b7546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:05.623595 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903092a1a1a04b7f883cba9c3f994888', 'request_id': 'req-aca0526a-0451-4cb2-ba07-2b787bab82b9'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:05.636739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903092a1a1a04b7f883cba9c3f994888', 'request_id': 'req-aca0526a-0451-4cb2-ba07-2b787bab82b9'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:05.640422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3149fda-ee29-4db7-8225-403c915b7546 service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:05.676413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] The token cache is being invalidate because project 903092a1a1a04b7f883cba9c3f994888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:05.676716 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:05.678260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:05.680046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 916/1824] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:05 2022] DELETE /identity/v3/projects/903092a1a1a04b7f883cba9c3f994888 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:05.681318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:05.683932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:05.928447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca0526a-0451-4cb2-ba07-2b787bab82b9 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:05.939743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:05.941073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9763ce7-fed5-4349-b801-3c5ecddcb93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:05.942079 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9763ce7-fed5-4349-b801-3c5ecddcb93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:05.943076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:05.943784 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:05.944083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9763ce7-fed5-4349-b801-3c5ecddcb93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:05.944521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9763ce7-fed5-4349-b801-3c5ecddcb93e admin admin] PATH_INFO: `/v3/projects/4676205a65474ae69b02d925b4a28248` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:05.945009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d admin admin] PATH_INFO: `/v3/projects/826ce7737929467c93140b6b8a459043` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:05.948094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=826ce7737929467c93140b6b8a459043)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:05.949312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9763ce7-fed5-4349-b801-3c5ecddcb93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4676205a65474ae69b02d925b4a28248)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:05.955354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9763ce7-fed5-4349-b801-3c5ecddcb93e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:05.956270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:06.204680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826ce7737929467c93140b6b8a459043', 'request_id': 'req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:06.230947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826ce7737929467c93140b6b8a459043', 'request_id': 'req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:06.240302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e9763ce7-fed5-4349-b801-3c5ecddcb93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4676205a65474ae69b02d925b4a28248', 'request_id': 'req-e9763ce7-fed5-4349-b801-3c5ecddcb93e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:06.560123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826ce7737929467c93140b6b8a459043', 'request_id': 'req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:06.574537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d admin admin] The token cache is being invalidate because project 826ce7737929467c93140b6b8a459043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:06.575123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:06.576150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ee04cc24-5cf6-4e29-9369-c3522bb7be0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:06.578336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 909/1825] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:05 2022] DELETE /identity/v3/projects/826ce7737929467c93140b6b8a459043 => generated 0 bytes in 994 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:06.579891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39282c24-50ee-446d-8064-d76596973bdb None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:06.580384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39282c24-50ee-446d-8064-d76596973bdb None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:06.580854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39282c24-50ee-446d-8064-d76596973bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:06.623353 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-39282c24-50ee-446d-8064-d76596973bdb None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:06.633672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-39282c24-50ee-446d-8064-d76596973bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:06.762586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 910/1826] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:06.765537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd63cc-ecf7-4da7-81d1-73daa6893195 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:06.766263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd63cc-ecf7-4da7-81d1-73daa6893195 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:06.766853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd63cc-ecf7-4da7-81d1-73daa6893195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:06.796479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-d5cd63cc-ecf7-4da7-81d1-73daa6893195 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:06.797626 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d5cd63cc-ecf7-4da7-81d1-73daa6893195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:06.807639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 911/1827] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:06.808585 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd63cc-ecf7-4da7-81d1-73daa6893195 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:06.810037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d5cd63cc-ecf7-4da7-81d1-73daa6893195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:06.826878 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd63cc-ecf7-4da7-81d1-73daa6893195 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:06.833941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd13c31-f049-40e9-b965-0988ca835810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:06.834620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd13c31-f049-40e9-b965-0988ca835810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:06.834895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd13c31-f049-40e9-b965-0988ca835810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:06.835165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd13c31-f049-40e9-b965-0988ca835810 admin admin] PATH_INFO: `/v3/projects/3adff77b66e04fecb1b8050ae849a050` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:06.836748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd13c31-f049-40e9-b965-0988ca835810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3adff77b66e04fecb1b8050ae849a050)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:06.839139 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd13c31-f049-40e9-b965-0988ca835810 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:06.912778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e9763ce7-fed5-4349-b801-3c5ecddcb93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4676205a65474ae69b02d925b4a28248', 'request_id': 'req-e9763ce7-fed5-4349-b801-3c5ecddcb93e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:06.923425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e9763ce7-fed5-4349-b801-3c5ecddcb93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4676205a65474ae69b02d925b4a28248', 'request_id': 'req-e9763ce7-fed5-4349-b801-3c5ecddcb93e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:06.939176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e9763ce7-fed5-4349-b801-3c5ecddcb93e admin admin] The token cache is being invalidate because project 4676205a65474ae69b02d925b4a28248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:06.940258 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e9763ce7-fed5-4349-b801-3c5ecddcb93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:06.941478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e9763ce7-fed5-4349-b801-3c5ecddcb93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:06.943510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 917/1828] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:05 2022] DELETE /identity/v3/projects/4676205a65474ae69b02d925b4a28248 => generated 0 bytes in 1263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:06.944958 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124eb0-c448-4d79-b485-4835445e1165 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:06.945433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124eb0-c448-4d79-b485-4835445e1165 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:06.950046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124eb0-c448-4d79-b485-4835445e1165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:06.996277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-35124eb0-c448-4d79-b485-4835445e1165 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:06.997653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-35124eb0-c448-4d79-b485-4835445e1165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:07.010030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 918/1829] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:07.014754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8decebd-01ba-4568-bd0e-d0191abc95ae None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:07.015043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8decebd-01ba-4568-bd0e-d0191abc95ae None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:07.015484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8decebd-01ba-4568-bd0e-d0191abc95ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:07.039373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-f8decebd-01ba-4568-bd0e-d0191abc95ae None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:07.040864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f8decebd-01ba-4568-bd0e-d0191abc95ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:07.050389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 919/1830] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:07.051420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b064f-1de1-4003-96e7-e8c06cc10170 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:07.051710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b064f-1de1-4003-96e7-e8c06cc10170 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:07.051990 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b064f-1de1-4003-96e7-e8c06cc10170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:07.093728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-7f9b064f-1de1-4003-96e7-e8c06cc10170 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:07.095535 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7f9b064f-1de1-4003-96e7-e8c06cc10170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:07.101600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5dd13c31-f049-40e9-b965-0988ca835810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3adff77b66e04fecb1b8050ae849a050', 'request_id': 'req-5dd13c31-f049-40e9-b965-0988ca835810'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:07.120770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5dd13c31-f049-40e9-b965-0988ca835810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3adff77b66e04fecb1b8050ae849a050', 'request_id': 'req-5dd13c31-f049-40e9-b965-0988ca835810'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:07.209974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 920/1831] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:07.212243 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b064f-1de1-4003-96e7-e8c06cc10170 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:07.232656 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b064f-1de1-4003-96e7-e8c06cc10170 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:07.241613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f7ad2-4ae4-48ef-95ae-2586774ad0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:07.242235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f7ad2-4ae4-48ef-95ae-2586774ad0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:07.243291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f7ad2-4ae4-48ef-95ae-2586774ad0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:07.243739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f7ad2-4ae4-48ef-95ae-2586774ad0a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:07.244729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f7ad2-4ae4-48ef-95ae-2586774ad0a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:07.245190 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f7ad2-4ae4-48ef-95ae-2586774ad0a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:07.248170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f7ad2-4ae4-48ef-95ae-2586774ad0a5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:07.279515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 921/1832] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:07.281003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f7ad2-4ae4-48ef-95ae-2586774ad0a5 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:07.296546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5dd13c31-f049-40e9-b965-0988ca835810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3adff77b66e04fecb1b8050ae849a050', 'request_id': 'req-5dd13c31-f049-40e9-b965-0988ca835810'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:07.317774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5dd13c31-f049-40e9-b965-0988ca835810 admin admin] The token cache is being invalidate because project 3adff77b66e04fecb1b8050ae849a050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:07.318736 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5dd13c31-f049-40e9-b965-0988ca835810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:07.319879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f7ad2-4ae4-48ef-95ae-2586774ad0a5 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:07.320802 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5dd13c31-f049-40e9-b965-0988ca835810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:07.324533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 912/1833] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:06 2022] DELETE /identity/v3/projects/3adff77b66e04fecb1b8050ae849a050 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:07.328782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79402420-fee6-4825-8ae8-7f83db272fc1 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:07.329684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79402420-fee6-4825-8ae8-7f83db272fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:07.330720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79402420-fee6-4825-8ae8-7f83db272fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:07.345246 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e926f13-0c99-40e1-a8e3-1cc657289dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:07.345974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e926f13-0c99-40e1-a8e3-1cc657289dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:07.346452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e926f13-0c99-40e1-a8e3-1cc657289dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:07.346943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e926f13-0c99-40e1-a8e3-1cc657289dc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:07.348001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e926f13-0c99-40e1-a8e3-1cc657289dc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:07.348314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e926f13-0c99-40e1-a8e3-1cc657289dc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:07.350169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e926f13-0c99-40e1-a8e3-1cc657289dc6 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:07.377644 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 922/1834] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:07.384429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e926f13-0c99-40e1-a8e3-1cc657289dc6 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:07.387905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7e926f13-0c99-40e1-a8e3-1cc657289dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:07.408677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-79402420-fee6-4825-8ae8-7f83db272fc1 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:07.408677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-79402420-fee6-4825-8ae8-7f83db272fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:07.423472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 913/1835] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:07.423982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e926f13-0c99-40e1-a8e3-1cc657289dc6 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:07.424690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8e3c6-0d1a-4114-b446-7bea454a38a0 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:07.424974 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8e3c6-0d1a-4114-b446-7bea454a38a0 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:07.425246 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8e3c6-0d1a-4114-b446-7bea454a38a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:07.431433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b0a6b-b16b-41b6-9765-ca78f7fbc6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:07.432846 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b0a6b-b16b-41b6-9765-ca78f7fbc6fb admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:07.433487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b0a6b-b16b-41b6-9765-ca78f7fbc6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:07.434006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b0a6b-b16b-41b6-9765-ca78f7fbc6fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:07.434868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b0a6b-b16b-41b6-9765-ca78f7fbc6fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:07.437821 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b0a6b-b16b-41b6-9765-ca78f7fbc6fb admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:07.473208 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-c7b8e3c6-0d1a-4114-b446-7bea454a38a0 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:07.474501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c7b8e3c6-0d1a-4114-b446-7bea454a38a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:07.496559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 914/1836] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:07.505611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8e3c6-0d1a-4114-b446-7bea454a38a0 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:07.509774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c7b8e3c6-0d1a-4114-b446-7bea454a38a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:07.554606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8e3c6-0d1a-4114-b446-7bea454a38a0 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:07.572547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 923/1837] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:07 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:07.575850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b0a6b-b16b-41b6-9765-ca78f7fbc6fb admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:07.577711 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c4f37-251e-44aa-912c-35be61abb535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:07.578693 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c4f37-251e-44aa-912c-35be61abb535 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:07.579160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c4f37-251e-44aa-912c-35be61abb535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:07.579724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c4f37-251e-44aa-912c-35be61abb535 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:07.589996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c4f37-251e-44aa-912c-35be61abb535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:07.592540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c4f37-251e-44aa-912c-35be61abb535 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:07.701931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b0a6b-b16b-41b6-9765-ca78f7fbc6fb admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:07.707123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a226d6-71cf-42a6-8641-6a5a93151018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:07.707752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a226d6-71cf-42a6-8641-6a5a93151018 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:07.708042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a226d6-71cf-42a6-8641-6a5a93151018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:07.708309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a226d6-71cf-42a6-8641-6a5a93151018 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:07.708979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a226d6-71cf-42a6-8641-6a5a93151018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:07.709288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a226d6-71cf-42a6-8641-6a5a93151018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:07.710932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a226d6-71cf-42a6-8641-6a5a93151018 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:07.733791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 924/1838] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:07.733791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06cc2c-fff0-4b56-81fb-bf7438634009 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:07.733791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06cc2c-fff0-4b56-81fb-bf7438634009 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:07.733791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06cc2c-fff0-4b56-81fb-bf7438634009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:07.755520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-cb06cc2c-fff0-4b56-81fb-bf7438634009 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:07.757260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-cb06cc2c-fff0-4b56-81fb-bf7438634009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:07.769763 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 925/1839] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:07.771188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06cc2c-fff0-4b56-81fb-bf7438634009 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:07.777989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 915/1840] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:07 2022] POST /identity/v3/projects => generated 363 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:07.780022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2a0fe-11f8-42e9-8f75-069d81727c92 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:07.780555 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2a0fe-11f8-42e9-8f75-069d81727c92 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:07.781320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2a0fe-11f8-42e9-8f75-069d81727c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:07.792630 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06cc2c-fff0-4b56-81fb-bf7438634009 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:07.851703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-9ee2a0fe-11f8-42e9-8f75-069d81727c92 None None] MFA Rules not processed for user `b1fdffd48cc44f63b3cce07d74b0841e`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:07.861631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9ee2a0fe-11f8-42e9-8f75-069d81727c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:07.926098 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06866136-7544-4500-aa28-4bf1526ab425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:07.926791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06866136-7544-4500-aa28-4bf1526ab425 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:07.927171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06866136-7544-4500-aa28-4bf1526ab425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:07.927436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06866136-7544-4500-aa28-4bf1526ab425 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:07.927983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06866136-7544-4500-aa28-4bf1526ab425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:07.933022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06866136-7544-4500-aa28-4bf1526ab425 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:07.986018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 916/1841] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:07.986864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2a0fe-11f8-42e9-8f75-069d81727c92 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:07.999042 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2a0fe-11f8-42e9-8f75-069d81727c92 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:08.004227 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb5c6-7c01-4195-9590-650dd7acc851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:08.005911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb5c6-7c01-4195-9590-650dd7acc851 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:08.006221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb5c6-7c01-4195-9590-650dd7acc851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:08.006504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfb5c6-7c01-4195-9590-650dd7acc851 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:08.007156 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb5c6-7c01-4195-9590-650dd7acc851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:08.010071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfb5c6-7c01-4195-9590-650dd7acc851 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:08.187745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:08.193285 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 926/1842] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:07 2022] POST /identity/v3/users => generated 288 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:08.194313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06866136-7544-4500-aa28-4bf1526ab425 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:08.208434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06866136-7544-4500-aa28-4bf1526ab425 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:08.209571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 917/1843] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:07 2022] POST /identity/v3/projects => generated 383 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:08.211509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb5c6-7c01-4195-9590-650dd7acc851 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:08.299949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdbb66-326e-4c0f-9707-486e27d4731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:08.300786 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdbb66-326e-4c0f-9707-486e27d4731b admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:08.301214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdbb66-326e-4c0f-9707-486e27d4731b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:08.301439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdbb66-326e-4c0f-9707-486e27d4731b admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:08.302119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdbb66-326e-4c0f-9707-486e27d4731b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:08.302453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdbb66-326e-4c0f-9707-486e27d4731b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:08.304086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdbb66-326e-4c0f-9707-486e27d4731b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:08.319977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 927/1844] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:08.322566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdbb66-326e-4c0f-9707-486e27d4731b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:08.323245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfb5c6-7c01-4195-9590-650dd7acc851 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:08.325658 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f7fdbb66-326e-4c0f-9707-486e27d4731b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:08.332339 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e494e-6bd2-47e5-b638-66861ea5dd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:08.333847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e494e-6bd2-47e5-b638-66861ea5dd27 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:08.334212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e494e-6bd2-47e5-b638-66861ea5dd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:08.334669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e494e-6bd2-47e5-b638-66861ea5dd27 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:08.335801 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e494e-6bd2-47e5-b638-66861ea5dd27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:08.340943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e494e-6bd2-47e5-b638-66861ea5dd27 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:08.428341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdbb66-326e-4c0f-9707-486e27d4731b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:08.435586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c421b95-3fd7-4337-8896-3f563aab5639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:08.436127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c421b95-3fd7-4337-8896-3f563aab5639 service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:08.436416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c421b95-3fd7-4337-8896-3f563aab5639 service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:08.436777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c421b95-3fd7-4337-8896-3f563aab5639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:08.525801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c421b95-3fd7-4337-8896-3f563aab5639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:08.530354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 918/1845] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:08 2022] POST /identity/v3/users => generated 282 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:08.530354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e494e-6bd2-47e5-b638-66861ea5dd27 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:08.534718 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c421b95-3fd7-4337-8896-3f563aab5639 service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:08.545252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 928/1846] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:08.545812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e494e-6bd2-47e5-b638-66861ea5dd27 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:08.546073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c421b95-3fd7-4337-8896-3f563aab5639 service nova] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:08.598068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c421b95-3fd7-4337-8896-3f563aab5639 service nova] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:08.598501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0dbe6-93ab-41dd-8365-432ba386539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:08.598501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0dbe6-93ab-41dd-8365-432ba386539d admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:08.598501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0dbe6-93ab-41dd-8365-432ba386539d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:08.598501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0dbe6-93ab-41dd-8365-432ba386539d admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:08.598765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0dbe6-93ab-41dd-8365-432ba386539d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:08.598765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0dbe6-93ab-41dd-8365-432ba386539d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:08.598886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeada19-1577-436d-8c17-fda558a1d8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:08.598886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeada19-1577-436d-8c17-fda558a1d8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:08.598886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeada19-1577-436d-8c17-fda558a1d8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:08.598886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeada19-1577-436d-8c17-fda558a1d8c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:08.599136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeada19-1577-436d-8c17-fda558a1d8c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:08.599136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeada19-1577-436d-8c17-fda558a1d8c3 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:08.599266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 919/1847] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:08.599266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0dbe6-93ab-41dd-8365-432ba386539d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:08.599266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0dbe6-93ab-41dd-8365-432ba386539d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:08.601918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465dc3a-2ddb-4fda-bb10-56fd948d825d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:08.603504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465dc3a-2ddb-4fda-bb10-56fd948d825d admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:08.603865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465dc3a-2ddb-4fda-bb10-56fd948d825d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:08.604217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465dc3a-2ddb-4fda-bb10-56fd948d825d admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:08.605114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465dc3a-2ddb-4fda-bb10-56fd948d825d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:08.607173 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465dc3a-2ddb-4fda-bb10-56fd948d825d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:09.193713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 929/1848] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:08 2022] POST /identity/v3/users => generated 292 bytes in 645 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:09.193713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeada19-1577-436d-8c17-fda558a1d8c3 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:09.200530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 920/1849] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:08 2022] POST /identity/v3/projects => generated 381 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:09.201512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465dc3a-2ddb-4fda-bb10-56fd948d825d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:09.211043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeada19-1577-436d-8c17-fda558a1d8c3 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:09.296071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465dc3a-2ddb-4fda-bb10-56fd948d825d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:09.297205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f0b3f-e318-4dbf-8769-932ff3b4bd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:09.297816 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f0b3f-e318-4dbf-8769-932ff3b4bd6c admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:09.298106 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f0b3f-e318-4dbf-8769-932ff3b4bd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:09.298386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f0b3f-e318-4dbf-8769-932ff3b4bd6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:09.299220 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f0b3f-e318-4dbf-8769-932ff3b4bd6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:09.301361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f0b3f-e318-4dbf-8769-932ff3b4bd6c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:09.306384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7520-262d-4dd1-89aa-088fb2320592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:09.309044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7520-262d-4dd1-89aa-088fb2320592 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:09.309905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7520-262d-4dd1-89aa-088fb2320592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:09.310401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c7520-262d-4dd1-89aa-088fb2320592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:09.312483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c7520-262d-4dd1-89aa-088fb2320592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:09.315520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c7520-262d-4dd1-89aa-088fb2320592 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:09.321440 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 930/1850] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:09.321440 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f0b3f-e318-4dbf-8769-932ff3b4bd6c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:09.336336 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f0b3f-e318-4dbf-8769-932ff3b4bd6c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:09.339837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 921/1851] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:09.341515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7520-262d-4dd1-89aa-088fb2320592 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:09.358380 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d728c-d0a9-401b-9fac-2e8e8fc4ca9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:09.359778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d728c-d0a9-401b-9fac-2e8e8fc4ca9a admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:09.360227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d728c-d0a9-401b-9fac-2e8e8fc4ca9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:09.360690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d728c-d0a9-401b-9fac-2e8e8fc4ca9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:09.362318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d728c-d0a9-401b-9fac-2e8e8fc4ca9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:09.364458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008d728c-d0a9-401b-9fac-2e8e8fc4ca9a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:09.365639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c7520-262d-4dd1-89aa-088fb2320592 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:09.375381 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0272a-62a8-49b8-9ff1-e923e0371a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:09.376871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0272a-62a8-49b8-9ff1-e923e0371a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:09.377516 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0272a-62a8-49b8-9ff1-e923e0371a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:09.378130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0272a-62a8-49b8-9ff1-e923e0371a91 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:09.378918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 931/1852] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:09.379894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d728c-d0a9-401b-9fac-2e8e8fc4ca9a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:09.380808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0272a-62a8-49b8-9ff1-e923e0371a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:09.385280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0272a-62a8-49b8-9ff1-e923e0371a91 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:09.403209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d728c-d0a9-401b-9fac-2e8e8fc4ca9a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:09.411795 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d2c9-4117-4e3c-82c6-0ee0b8fdaa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:09.412352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d2c9-4117-4e3c-82c6-0ee0b8fdaa3a admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:09.412745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d2c9-4117-4e3c-82c6-0ee0b8fdaa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:09.413096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d2c9-4117-4e3c-82c6-0ee0b8fdaa3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:09.414132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31d2c9-4117-4e3c-82c6-0ee0b8fdaa3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:09.417562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31d2c9-4117-4e3c-82c6-0ee0b8fdaa3a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:09.441176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 932/1853] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:09.441176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d2c9-4117-4e3c-82c6-0ee0b8fdaa3a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:09.458091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d2c9-4117-4e3c-82c6-0ee0b8fdaa3a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:09.466776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23e4c8-7727-40e9-bd19-209cacfe560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:09.468045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23e4c8-7727-40e9-bd19-209cacfe560a admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:09.468389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23e4c8-7727-40e9-bd19-209cacfe560a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:09.468871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23e4c8-7727-40e9-bd19-209cacfe560a admin admin] PATH_INFO: `/v3/projects/387f8659c9b449f6a5be51eebb9a5f2f/users/4ea713937f994ac4b34653bf6d1ca3b3/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:09.498906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23e4c8-7727-40e9-bd19-209cacfe560a admin admin] RBAC: Authorizing `identity:create_grant(project_id=387f8659c9b449f6a5be51eebb9a5f2f, user_id=4ea713937f994ac4b34653bf6d1ca3b3, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:09.500855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 922/1854] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:09 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:09.502020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0272a-62a8-49b8-9ff1-e923e0371a91 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:09.504590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23e4c8-7727-40e9-bd19-209cacfe560a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:09.513508 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0272a-62a8-49b8-9ff1-e923e0371a91 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:09.518449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f636277-05c8-44c5-a2e0-ba6ad9dff87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:09.519085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f636277-05c8-44c5-a2e0-ba6ad9dff87f admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:09.519371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f636277-05c8-44c5-a2e0-ba6ad9dff87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:09.519645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f636277-05c8-44c5-a2e0-ba6ad9dff87f admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:09.520452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f636277-05c8-44c5-a2e0-ba6ad9dff87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:09.522436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f636277-05c8-44c5-a2e0-ba6ad9dff87f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:09.536174 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 923/1855] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:09.537012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f636277-05c8-44c5-a2e0-ba6ad9dff87f admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:09.550504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f636277-05c8-44c5-a2e0-ba6ad9dff87f admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:09.557012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d32b7-7cb8-4dc5-b770-60035553c8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:09.557859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d32b7-7cb8-4dc5-b770-60035553c8a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:09.558660 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d32b7-7cb8-4dc5-b770-60035553c8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:09.558660 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d32b7-7cb8-4dc5-b770-60035553c8a2 admin admin] PATH_INFO: `/v3/projects/e18568cfce7142f2aafb71c709fa2ba2/users/8cfed5b67bd34f96be5bce8dec45ada6/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:09.577319 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d32b7-7cb8-4dc5-b770-60035553c8a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18568cfce7142f2aafb71c709fa2ba2, user_id=8cfed5b67bd34f96be5bce8dec45ada6, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:09.581393 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d32b7-7cb8-4dc5-b770-60035553c8a2 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:09.722024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 933/1856] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:09 2022] PUT /identity/v3/projects/387f8659c9b449f6a5be51eebb9a5f2f/users/4ea713937f994ac4b34653bf6d1ca3b3/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:09.722024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23e4c8-7727-40e9-bd19-209cacfe560a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:09.808454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23e4c8-7727-40e9-bd19-209cacfe560a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:09.808454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcb99d-3606-470d-b3cb-0013819d737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:09.808454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcb99d-3606-470d-b3cb-0013819d737f admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:09.808454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcb99d-3606-470d-b3cb-0013819d737f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:09.809307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcb99d-3606-470d-b3cb-0013819d737f admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:09.809734 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcb99d-3606-470d-b3cb-0013819d737f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:09.811448 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcb99d-3606-470d-b3cb-0013819d737f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:09.823188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 934/1857] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:09.824057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcb99d-3606-470d-b3cb-0013819d737f admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:09.838547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcb99d-3606-470d-b3cb-0013819d737f admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:09.845282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab78ed0-3284-4444-b9c3-61d92c07bef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:09.845558 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78ed0-3284-4444-b9c3-61d92c07bef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:09.845966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78ed0-3284-4444-b9c3-61d92c07bef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:09.846251 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab78ed0-3284-4444-b9c3-61d92c07bef8 admin admin] PATH_INFO: `/v3/projects/2b9baf9cac4a4b2686e7c2f033ef9efb/users/d5e35757fcf046bdbb34dee53a336a26/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:09.870677 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab78ed0-3284-4444-b9c3-61d92c07bef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9baf9cac4a4b2686e7c2f033ef9efb, user_id=d5e35757fcf046bdbb34dee53a336a26, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:09.874330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab78ed0-3284-4444-b9c3-61d92c07bef8 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:09.889859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 924/1858] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:09 2022] PUT /identity/v3/projects/e18568cfce7142f2aafb71c709fa2ba2/users/8cfed5b67bd34f96be5bce8dec45ada6/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:09.891364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56048719-1463-419c-9c22-7bcc3cf81c11 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:09.891756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56048719-1463-419c-9c22-7bcc3cf81c11 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:09.892136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56048719-1463-419c-9c22-7bcc3cf81c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:09.934235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-56048719-1463-419c-9c22-7bcc3cf81c11 None None] MFA Rules not processed for user `4ea713937f994ac4b34653bf6d1ca3b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:09.934235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-56048719-1463-419c-9c22-7bcc3cf81c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:10.029150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 925/1859] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:10.030151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56048719-1463-419c-9c22-7bcc3cf81c11 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:10.032079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-56048719-1463-419c-9c22-7bcc3cf81c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:10.324706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 935/1860] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:09 2022] PUT /identity/v3/projects/2b9baf9cac4a4b2686e7c2f033ef9efb/users/d5e35757fcf046bdbb34dee53a336a26/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:10.324706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab78ed0-3284-4444-b9c3-61d92c07bef8 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:10.328588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56048719-1463-419c-9c22-7bcc3cf81c11 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:10.329202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab78ed0-3284-4444-b9c3-61d92c07bef8 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:10.329202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a34d7-5dae-40eb-9793-1a50d41dda14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:10.329202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a34d7-5dae-40eb-9793-1a50d41dda14 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:10.329202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a34d7-5dae-40eb-9793-1a50d41dda14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:10.329617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a34d7-5dae-40eb-9793-1a50d41dda14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:10.329617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a34d7-5dae-40eb-9793-1a50d41dda14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:10.329617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a34d7-5dae-40eb-9793-1a50d41dda14 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:10.329617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 936/1861] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:10.329887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43507a49-16a2-4fb6-b654-392f8e984edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:10.329887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43507a49-16a2-4fb6-b654-392f8e984edd service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:10.329887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43507a49-16a2-4fb6-b654-392f8e984edd service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:10.330102 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ba44b-eabb-4cc3-9d3f-7fd4df571a82 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:10.330176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43507a49-16a2-4fb6-b654-392f8e984edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:10.330251 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ba44b-eabb-4cc3-9d3f-7fd4df571a82 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:10.330251 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ba44b-eabb-4cc3-9d3f-7fd4df571a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:10.330379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-43507a49-16a2-4fb6-b654-392f8e984edd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:10.330459 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-631ba44b-eabb-4cc3-9d3f-7fd4df571a82 None None] MFA Rules not processed for user `8cfed5b67bd34f96be5bce8dec45ada6`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:10.330459 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-631ba44b-eabb-4cc3-9d3f-7fd4df571a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:10.331656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43507a49-16a2-4fb6-b654-392f8e984edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:10.333264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43507a49-16a2-4fb6-b654-392f8e984edd service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:10.355725 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 926/1862] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:10.356898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43507a49-16a2-4fb6-b654-392f8e984edd service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:10.374276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43507a49-16a2-4fb6-b654-392f8e984edd service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:10.391079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da17916-79bf-43f0-a865-631489589ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:10.392030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da17916-79bf-43f0-a865-631489589ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:10.392529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da17916-79bf-43f0-a865-631489589ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:10.393028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da17916-79bf-43f0-a865-631489589ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:10.394177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da17916-79bf-43f0-a865-631489589ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:10.398367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da17916-79bf-43f0-a865-631489589ddb admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:10.403983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 937/1863] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:10.407908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ba44b-eabb-4cc3-9d3f-7fd4df571a82 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:10.426977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ba44b-eabb-4cc3-9d3f-7fd4df571a82 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:10.435554 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021ac32-eca0-4d5f-b574-f1538777490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:10.437794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ac32-eca0-4d5f-b574-f1538777490a admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:10.439423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ac32-eca0-4d5f-b574-f1538777490a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:10.439972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ac32-eca0-4d5f-b574-f1538777490a admin admin] PATH_INFO: `/v3/projects/5bf14c8088c44c80821c3d9cb5640835/users/f5b72ab6975043bb95b1b03a3d9c9ab0/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:10.463286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021ac32-eca0-4d5f-b574-f1538777490a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf14c8088c44c80821c3d9cb5640835, user_id=f5b72ab6975043bb95b1b03a3d9c9ab0, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:10.466329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021ac32-eca0-4d5f-b574-f1538777490a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:10.670845 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 938/1864] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:10 2022] PUT /identity/v3/projects/5bf14c8088c44c80821c3d9cb5640835/users/f5b72ab6975043bb95b1b03a3d9c9ab0/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:10.672574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71b4b8-cdf2-4122-9741-51fc32f91eb2 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:10.673334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71b4b8-cdf2-4122-9741-51fc32f91eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:10.685530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71b4b8-cdf2-4122-9741-51fc32f91eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:10.686678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 927/1865] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:10 2022] POST /identity/v3/projects => generated 375 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:10.688499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da17916-79bf-43f0-a865-631489589ddb admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:10.765890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-8f71b4b8-cdf2-4122-9741-51fc32f91eb2 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:10.770269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8f71b4b8-cdf2-4122-9741-51fc32f91eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:10.866754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da17916-79bf-43f0-a865-631489589ddb admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:10.886687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c7db6-0955-439c-9a31-d3919b97e745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:10.896217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c7db6-0955-439c-9a31-d3919b97e745 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:10.896217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c7db6-0955-439c-9a31-d3919b97e745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:10.896217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c7db6-0955-439c-9a31-d3919b97e745 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:10.896217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c7db6-0955-439c-9a31-d3919b97e745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:10.899912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c7db6-0955-439c-9a31-d3919b97e745 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:10.917839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 939/1866] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:10.921778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37b01e-e058-48eb-b587-70602d69f06e None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:10.925017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37b01e-e058-48eb-b587-70602d69f06e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:10.925017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37b01e-e058-48eb-b587-70602d69f06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:10.971452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-fb37b01e-e058-48eb-b587-70602d69f06e None None] MFA Rules not processed for user `f5b72ab6975043bb95b1b03a3d9c9ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:10.973637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-fb37b01e-e058-48eb-b587-70602d69f06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:11.096648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 940/1867] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:11.098132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37b01e-e058-48eb-b587-70602d69f06e None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:11.112597 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37b01e-e058-48eb-b587-70602d69f06e None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:11.129751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d01b6d-5532-4795-b2cf-cd674850b7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:11.131601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d01b6d-5532-4795-b2cf-cd674850b7af admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:11.131601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d01b6d-5532-4795-b2cf-cd674850b7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:11.132237 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d01b6d-5532-4795-b2cf-cd674850b7af admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:11.134414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d01b6d-5532-4795-b2cf-cd674850b7af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:11.138105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d01b6d-5532-4795-b2cf-cd674850b7af admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:11.208301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 928/1868] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:10 2022] POST /identity/v3/projects => generated 365 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:11.209982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c7db6-0955-439c-9a31-d3919b97e745 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:11.213493 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-eb4c7db6-0955-439c-9a31-d3919b97e745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:11.303935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c7db6-0955-439c-9a31-d3919b97e745 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:11.312172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e555d31-db03-48df-aaae-e0b880a71cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:11.313151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e555d31-db03-48df-aaae-e0b880a71cbe service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:11.313784 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e555d31-db03-48df-aaae-e0b880a71cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:11.314094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e555d31-db03-48df-aaae-e0b880a71cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:11.369951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 941/1869] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:11 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:11.371287 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d01b6d-5532-4795-b2cf-cd674850b7af admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:11.395863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d01b6d-5532-4795-b2cf-cd674850b7af admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:11.472804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e555d31-db03-48df-aaae-e0b880a71cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:11.474873 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e555d31-db03-48df-aaae-e0b880a71cbe service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:11.492992 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 929/1870] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:11.505548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e555d31-db03-48df-aaae-e0b880a71cbe service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:11.512423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e555d31-db03-48df-aaae-e0b880a71cbe service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:11.517929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb529f-be5c-43b9-b4b1-7fe41b61f874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:11.518564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb529f-be5c-43b9-b4b1-7fe41b61f874 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:11.518888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb529f-be5c-43b9-b4b1-7fe41b61f874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:11.519126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb529f-be5c-43b9-b4b1-7fe41b61f874 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:11.519793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb529f-be5c-43b9-b4b1-7fe41b61f874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:11.532767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb529f-be5c-43b9-b4b1-7fe41b61f874 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:11.556871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba637e-a5fd-4cfe-9714-ea65311b4b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:11.556871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba637e-a5fd-4cfe-9714-ea65311b4b8b admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:11.556871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba637e-a5fd-4cfe-9714-ea65311b4b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:11.556871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba637e-a5fd-4cfe-9714-ea65311b4b8b admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:11.557740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba637e-a5fd-4cfe-9714-ea65311b4b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:11.563227 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba637e-a5fd-4cfe-9714-ea65311b4b8b admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:11.729065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 942/1871] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:11 2022] POST /identity/v3/projects => generated 379 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:11.729065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb529f-be5c-43b9-b4b1-7fe41b61f874 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:11.815305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 930/1872] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:11 2022] POST /identity/v3/users => generated 289 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:11.826367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba637e-a5fd-4cfe-9714-ea65311b4b8b admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:11.838395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-31ba637e-a5fd-4cfe-9714-ea65311b4b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:11.860830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb529f-be5c-43b9-b4b1-7fe41b61f874 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:11.877301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48359fa3-edd9-4eaa-9a50-6294f4c8d35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:11.877301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48359fa3-edd9-4eaa-9a50-6294f4c8d35a admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:11.877301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48359fa3-edd9-4eaa-9a50-6294f4c8d35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:11.877301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48359fa3-edd9-4eaa-9a50-6294f4c8d35a admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:11.877908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48359fa3-edd9-4eaa-9a50-6294f4c8d35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:11.882297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48359fa3-edd9-4eaa-9a50-6294f4c8d35a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:11.905559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba637e-a5fd-4cfe-9714-ea65311b4b8b admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:11.908461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 943/1873] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:11.912766 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48359fa3-edd9-4eaa-9a50-6294f4c8d35a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:11.915272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:11.916447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:11.916920 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:11.917477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] PATH_INFO: `/v3/users/c6a6ceb541d44e60a9b5491a7ad4246d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:11.923446 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a6ceb541d44e60a9b5491a7ad4246d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:11.927386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:11.933151 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48359fa3-edd9-4eaa-9a50-6294f4c8d35a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:11.941983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f012dd-8855-41e4-b1f0-08f2631d831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:11.941983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f012dd-8855-41e4-b1f0-08f2631d831c admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:11.941983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f012dd-8855-41e4-b1f0-08f2631d831c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:11.941983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f012dd-8855-41e4-b1f0-08f2631d831c admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:11.943208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f012dd-8855-41e4-b1f0-08f2631d831c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:11.946268 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f012dd-8855-41e4-b1f0-08f2631d831c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:11.961098 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:12.085101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 944/1874] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:11 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:12.086842 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f012dd-8855-41e4-b1f0-08f2631d831c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:12.097869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f012dd-8855-41e4-b1f0-08f2631d831c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:12.104500 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf4951-442d-4cc7-9404-1e5ef7f163b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:12.105301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4951-442d-4cc7-9404-1e5ef7f163b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:12.105801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4951-442d-4cc7-9404-1e5ef7f163b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:12.106196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4951-442d-4cc7-9404-1e5ef7f163b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:12.106961 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf4951-442d-4cc7-9404-1e5ef7f163b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:12.108841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf4951-442d-4cc7-9404-1e5ef7f163b4 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:12.122844 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 945/1875] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:12.135026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf4951-442d-4cc7-9404-1e5ef7f163b4 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:12.139057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf4951-442d-4cc7-9404-1e5ef7f163b4 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:12.146517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a4e51-4203-47ba-97c4-c0fd6f1c342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:12.147563 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a4e51-4203-47ba-97c4-c0fd6f1c342f admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:12.147838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a4e51-4203-47ba-97c4-c0fd6f1c342f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:12.148111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a4e51-4203-47ba-97c4-c0fd6f1c342f admin admin] PATH_INFO: `/v3/projects/e0b780a1d061475680c06cdfd779ef2f/users/c30f0510a9794fbfa53260354bde4b86/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:12.169204 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a4e51-4203-47ba-97c4-c0fd6f1c342f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b780a1d061475680c06cdfd779ef2f, user_id=c30f0510a9794fbfa53260354bde4b86, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:12.179073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a4e51-4203-47ba-97c4-c0fd6f1c342f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:12.251870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a6ceb541d44e60a9b5491a7ad4246d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:12.263054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a6ceb541d44e60a9b5491a7ad4246d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:12.346096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 946/1876] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:12 2022] PUT /identity/v3/projects/e0b780a1d061475680c06cdfd779ef2f/users/c30f0510a9794fbfa53260354bde4b86/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:12.353793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a4e51-4203-47ba-97c4-c0fd6f1c342f admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:12.401740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a6ceb541d44e60a9b5491a7ad4246d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:12.402844 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a6ceb541d44e60a9b5491a7ad4246d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:12.404061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a6ceb541d44e60a9b5491a7ad4246d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:12.453416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 931/1877] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:11 2022] DELETE /identity/v3/users/c6a6ceb541d44e60a9b5491a7ad4246d => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:12.453416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:12.455943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:12.473827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a4e51-4203-47ba-97c4-c0fd6f1c342f admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:12.548116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e4f19-5f16-4233-b6c7-332595ce650d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:12.553701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777afd-232d-4856-ac21-a2e78c12e056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:12.554656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777afd-232d-4856-ac21-a2e78c12e056 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:12.555240 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777afd-232d-4856-ac21-a2e78c12e056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:12.555597 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777afd-232d-4856-ac21-a2e78c12e056 admin admin] PATH_INFO: `/v3/projects/969f0b93b19e4062bd1e46e57bf91c23/users/d54597b751bd478c8c1ba9bfe9dc20fa/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:12.556250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351389c-2f7a-4612-bd05-13c41e3f40e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:12.557353 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351389c-2f7a-4612-bd05-13c41e3f40e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:12.557820 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351389c-2f7a-4612-bd05-13c41e3f40e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:12.558111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351389c-2f7a-4612-bd05-13c41e3f40e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:12.561558 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351389c-2f7a-4612-bd05-13c41e3f40e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:12.561558 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351389c-2f7a-4612-bd05-13c41e3f40e5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:12.573098 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 947/1878] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:12.574216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351389c-2f7a-4612-bd05-13c41e3f40e5 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:12.575958 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d351389c-2f7a-4612-bd05-13c41e3f40e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:12.582649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62777afd-232d-4856-ac21-a2e78c12e056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969f0b93b19e4062bd1e46e57bf91c23, user_id=d54597b751bd478c8c1ba9bfe9dc20fa, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:12.585365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62777afd-232d-4856-ac21-a2e78c12e056 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:12.589608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351389c-2f7a-4612-bd05-13c41e3f40e5 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:12.596366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d88444-66eb-49ef-b641-2e38f4594f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:12.596983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d88444-66eb-49ef-b641-2e38f4594f75 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:12.597264 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d88444-66eb-49ef-b641-2e38f4594f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:12.597859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d88444-66eb-49ef-b641-2e38f4594f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:12.598515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d88444-66eb-49ef-b641-2e38f4594f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:12.600198 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d88444-66eb-49ef-b641-2e38f4594f75 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:12.611725 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 948/1879] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:12.613006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5967-66af-4fb1-9e73-a94f1f04c931 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:12.616183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5967-66af-4fb1-9e73-a94f1f04c931 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:12.616183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5967-66af-4fb1-9e73-a94f1f04c931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:12.634671 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-24ba5967-66af-4fb1-9e73-a94f1f04c931 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:12.636085 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-24ba5967-66af-4fb1-9e73-a94f1f04c931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:12.648910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 949/1880] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:12.648910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba5967-66af-4fb1-9e73-a94f1f04c931 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:12.657161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-24ba5967-66af-4fb1-9e73-a94f1f04c931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:12.669929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba5967-66af-4fb1-9e73-a94f1f04c931 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:12.676475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fb097-5424-4112-9e39-efd7614acff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:12.677253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fb097-5424-4112-9e39-efd7614acff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:12.678265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fb097-5424-4112-9e39-efd7614acff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:12.678265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fb097-5424-4112-9e39-efd7614acff2 admin admin] PATH_INFO: `/v3/projects/9c4ba483e8244845bf8e5a13a7795969/users/4dbddabda2c64908a4a0508cacd3b5a3/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:12.706588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fb097-5424-4112-9e39-efd7614acff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4ba483e8244845bf8e5a13a7795969, user_id=4dbddabda2c64908a4a0508cacd3b5a3, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:12.713969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fb097-5424-4112-9e39-efd7614acff2 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:12.738180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 932/1881] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:12 2022] PUT /identity/v3/projects/969f0b93b19e4062bd1e46e57bf91c23/users/d54597b751bd478c8c1ba9bfe9dc20fa/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:12.745105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777afd-232d-4856-ac21-a2e78c12e056 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:12.867312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 950/1882] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:12 2022] PUT /identity/v3/projects/9c4ba483e8244845bf8e5a13a7795969/users/4dbddabda2c64908a4a0508cacd3b5a3/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:12.869608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fb097-5424-4112-9e39-efd7614acff2 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:12.872485 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c04fb097-5424-4112-9e39-efd7614acff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:12.874345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777afd-232d-4856-ac21-a2e78c12e056 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:12.998211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fb097-5424-4112-9e39-efd7614acff2 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:13.002337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36c13c-5c7f-459b-aaa6-d364af4992ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:13.002963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36c13c-5c7f-459b-aaa6-d364af4992ab service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.003637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36c13c-5c7f-459b-aaa6-d364af4992ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.004480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36c13c-5c7f-459b-aaa6-d364af4992ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.009911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d913a-2a20-470f-be04-3b84e469367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:13.010615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d913a-2a20-470f-be04-3b84e469367d admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.010897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d913a-2a20-470f-be04-3b84e469367d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.011177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d913a-2a20-470f-be04-3b84e469367d admin admin] PATH_INFO: `/v3/projects/e0b780a1d061475680c06cdfd779ef2f/users/c30f0510a9794fbfa53260354bde4b86/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.014126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d913a-2a20-470f-be04-3b84e469367d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b780a1d061475680c06cdfd779ef2f, user_id=c30f0510a9794fbfa53260354bde4b86, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:13.015412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36c13c-5c7f-459b-aaa6-d364af4992ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:13.016936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36c13c-5c7f-459b-aaa6-d364af4992ab service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:13.018104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d913a-2a20-470f-be04-3b84e469367d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:13.033469 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 933/1883] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:12 2022] PUT /identity/v3/projects/e0b780a1d061475680c06cdfd779ef2f/users/c30f0510a9794fbfa53260354bde4b86/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:13.040149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 951/1884] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:13.040326 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d913a-2a20-470f-be04-3b84e469367d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:13.040429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36c13c-5c7f-459b-aaa6-d364af4992ab service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:13.049353 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36c13c-5c7f-459b-aaa6-d364af4992ab service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:13.146719 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecae780-46f0-443e-970f-290143ed8cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:13.148557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecae780-46f0-443e-970f-290143ed8cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.149682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecae780-46f0-443e-970f-290143ed8cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.150126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecae780-46f0-443e-970f-290143ed8cbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.150898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecae780-46f0-443e-970f-290143ed8cbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:13.155044 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecae780-46f0-443e-970f-290143ed8cbb admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:13.166086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d913a-2a20-470f-be04-3b84e469367d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:13.166086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce5764-c7cd-4016-8ec0-85ccb891dc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:13.166086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce5764-c7cd-4016-8ec0-85ccb891dc3c admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.166086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce5764-c7cd-4016-8ec0-85ccb891dc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.166439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce5764-c7cd-4016-8ec0-85ccb891dc3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.166439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce5764-c7cd-4016-8ec0-85ccb891dc3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:13.166439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce5764-c7cd-4016-8ec0-85ccb891dc3c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:13.166976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 952/1885] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:13.168620 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09437657-ba76-49e1-b757-2226b9248388 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.168914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09437657-ba76-49e1-b757-2226b9248388 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.169872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09437657-ba76-49e1-b757-2226b9248388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.179763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 934/1886] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:13.181540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce5764-c7cd-4016-8ec0-85ccb891dc3c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:13.197869 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce5764-c7cd-4016-8ec0-85ccb891dc3c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:13.212022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744e7f-61b7-4190-a351-4c266cfadeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:13.212022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744e7f-61b7-4190-a351-4c266cfadeac admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.212022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744e7f-61b7-4190-a351-4c266cfadeac admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.212022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59744e7f-61b7-4190-a351-4c266cfadeac admin admin] PATH_INFO: `/v3/projects/9c4ba483e8244845bf8e5a13a7795969/users/4dbddabda2c64908a4a0508cacd3b5a3/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.212420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59744e7f-61b7-4190-a351-4c266cfadeac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4ba483e8244845bf8e5a13a7795969, user_id=4dbddabda2c64908a4a0508cacd3b5a3, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:13.214264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59744e7f-61b7-4190-a351-4c266cfadeac admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:13.215894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-09437657-ba76-49e1-b757-2226b9248388 None None] MFA Rules not processed for user `c30f0510a9794fbfa53260354bde4b86`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:13.217420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-09437657-ba76-49e1-b757-2226b9248388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:13.232294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 935/1887] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:13 2022] PUT /identity/v3/projects/9c4ba483e8244845bf8e5a13a7795969/users/4dbddabda2c64908a4a0508cacd3b5a3/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:13.234196 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744e7f-61b7-4190-a351-4c266cfadeac admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:13.314528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 953/1888] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:13.316665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c643925-29c2-4978-9d7e-502f29b21750 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.316665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c643925-29c2-4978-9d7e-502f29b21750 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.316665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c643925-29c2-4978-9d7e-502f29b21750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.329406 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59744e7f-61b7-4190-a351-4c266cfadeac admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:13.334237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2c239-41b8-4a96-8848-15531ac0ffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:13.335129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2c239-41b8-4a96-8848-15531ac0ffe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.335666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2c239-41b8-4a96-8848-15531ac0ffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.335946 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2c239-41b8-4a96-8848-15531ac0ffe7 admin admin] PATH_INFO: `/v3/projects/969f0b93b19e4062bd1e46e57bf91c23/users/d54597b751bd478c8c1ba9bfe9dc20fa/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.338501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2c239-41b8-4a96-8848-15531ac0ffe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969f0b93b19e4062bd1e46e57bf91c23, user_id=d54597b751bd478c8c1ba9bfe9dc20fa, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:13.341633 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2c239-41b8-4a96-8848-15531ac0ffe7 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:13.353274 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 936/1889] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:13 2022] PUT /identity/v3/projects/969f0b93b19e4062bd1e46e57bf91c23/users/d54597b751bd478c8c1ba9bfe9dc20fa/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:13.354054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2c239-41b8-4a96-8848-15531ac0ffe7 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:13.363115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-14e2c239-41b8-4a96-8848-15531ac0ffe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:13.363863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-7c643925-29c2-4978-9d7e-502f29b21750 None None] MFA Rules not processed for user `4dbddabda2c64908a4a0508cacd3b5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:13.365497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7c643925-29c2-4978-9d7e-502f29b21750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:13.428218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2c239-41b8-4a96-8848-15531ac0ffe7 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:13.434622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f7f3e-8c37-4578-8c03-ac44a995f2ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:13.435245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f7f3e-8c37-4578-8c03-ac44a995f2ff service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.435556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f7f3e-8c37-4578-8c03-ac44a995f2ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.435831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f7f3e-8c37-4578-8c03-ac44a995f2ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.437855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e96f7f3e-8c37-4578-8c03-ac44a995f2ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:13.452793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 954/1890] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:13.452793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006491-0dbf-402b-ae80-0c84b16b273c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.452793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006491-0dbf-402b-ae80-0c84b16b273c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.452793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006491-0dbf-402b-ae80-0c84b16b273c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.494887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-da006491-0dbf-402b-ae80-0c84b16b273c None None] MFA Rules not processed for user `d54597b751bd478c8c1ba9bfe9dc20fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:13.496370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-da006491-0dbf-402b-ae80-0c84b16b273c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:13.521786 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f7f3e-8c37-4578-8c03-ac44a995f2ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:13.523101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f7f3e-8c37-4578-8c03-ac44a995f2ff service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:13.534259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 937/1891] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:13.535126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f7f3e-8c37-4578-8c03-ac44a995f2ff service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:13.536584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e96f7f3e-8c37-4578-8c03-ac44a995f2ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:13.570099 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f7f3e-8c37-4578-8c03-ac44a995f2ff service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:13.579425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0903d4-0370-49c8-891d-7a8e9a8ea0ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:13.580479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0903d4-0370-49c8-891d-7a8e9a8ea0ae service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.580479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0903d4-0370-49c8-891d-7a8e9a8ea0ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.580678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0903d4-0370-49c8-891d-7a8e9a8ea0ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.599931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 955/1892] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:13.605361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0903d4-0370-49c8-891d-7a8e9a8ea0ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:13.607138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0903d4-0370-49c8-891d-7a8e9a8ea0ae service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:13.618386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 938/1893] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:13.792069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da006491-0dbf-402b-ae80-0c84b16b273c None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:13.801641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da006491-0dbf-402b-ae80-0c84b16b273c None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:13.805920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978929b-c8ec-426f-878c-fc054edf1016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:13.806546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978929b-c8ec-426f-878c-fc054edf1016 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.806826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978929b-c8ec-426f-878c-fc054edf1016 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.807110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978929b-c8ec-426f-878c-fc054edf1016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.824322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978929b-c8ec-426f-878c-fc054edf1016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:13.827242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978929b-c8ec-426f-878c-fc054edf1016 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:13.845269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 956/1894] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:13.875701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8407da2-6383-418b-9529-b6538563e165 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:13.875990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8407da2-6383-418b-9529-b6538563e165 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:13.876269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8407da2-6383-418b-9529-b6538563e165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:13.897452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a8407da2-6383-418b-9529-b6538563e165 None None] MFA Rules not processed for user `b1fdffd48cc44f63b3cce07d74b0841e`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:13.898779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a8407da2-6383-418b-9529-b6538563e165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:13.979867 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978929b-c8ec-426f-878c-fc054edf1016 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:13.979867 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b978929b-c8ec-426f-878c-fc054edf1016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:13.981140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 939/1895] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:14.049216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978929b-c8ec-426f-878c-fc054edf1016 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:14.055909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:14.056677 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:14.056960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:14.057272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] PATH_INFO: `/v3/projects/b03dc5c1d12a4ab788580281385b4f79` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:14.058699 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b03dc5c1d12a4ab788580281385b4f79)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:14.060630 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:14.252566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b03dc5c1d12a4ab788580281385b4f79', 'request_id': 'req-b61a748b-dab2-4ad4-9a87-f5f691970c81'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:14.376554 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faf8ce-e89d-47b3-a304-107e2cd5feee None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:14.376837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faf8ce-e89d-47b3-a304-107e2cd5feee None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:14.377310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faf8ce-e89d-47b3-a304-107e2cd5feee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-b8faf8ce-e89d-47b3-a304-107e2cd5feee None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:43:14.384143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:43:14.389191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:43:14.390939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 940/1896] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:43:14 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 01 05:43:14.491883 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b03dc5c1d12a4ab788580281385b4f79', 'request_id': 'req-b61a748b-dab2-4ad4-9a87-f5f691970c81'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:14.502822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b03dc5c1d12a4ab788580281385b4f79', 'request_id': 'req-b61a748b-dab2-4ad4-9a87-f5f691970c81'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:14.517939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] The token cache is being invalidate because project b03dc5c1d12a4ab788580281385b4f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:14.518540 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:14.519444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:14.521364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 957/1897] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:13 2022] DELETE /identity/v3/projects/b03dc5c1d12a4ab788580281385b4f79 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:14.526015 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faf8ce-e89d-47b3-a304-107e2cd5feee None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:14.527886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b8faf8ce-e89d-47b3-a304-107e2cd5feee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:14.603753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:14.606425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:14.618871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faf8ce-e89d-47b3-a304-107e2cd5feee None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:14.630835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9df6c1-e78f-471e-a809-098be44fb7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:14.631561 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9df6c1-e78f-471e-a809-098be44fb7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:14.631839 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9df6c1-e78f-471e-a809-098be44fb7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:14.632284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9df6c1-e78f-471e-a809-098be44fb7e4 admin admin] PATH_INFO: `/v3/users/b38950e555cd4e4ba8f88436551ffc05` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:14.643644 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9df6c1-e78f-471e-a809-098be44fb7e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38950e555cd4e4ba8f88436551ffc05)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:14.643644 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9df6c1-e78f-471e-a809-098be44fb7e4 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:14.699104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a748b-dab2-4ad4-9a87-f5f691970c81 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:14.702968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d768704-0558-446d-9d73-43bbfd1119ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:14.703603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d768704-0558-446d-9d73-43bbfd1119ee service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:14.703877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d768704-0558-446d-9d73-43bbfd1119ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:14.704151 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d768704-0558-446d-9d73-43bbfd1119ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:14.705996 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3d768704-0558-446d-9d73-43bbfd1119ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:14.791286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d768704-0558-446d-9d73-43bbfd1119ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:14.792811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d768704-0558-446d-9d73-43bbfd1119ee service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:14.803891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 958/1898] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:43:14.804931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d768704-0558-446d-9d73-43bbfd1119ee service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:14.810159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3d768704-0558-446d-9d73-43bbfd1119ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:14.826372 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d768704-0558-446d-9d73-43bbfd1119ee service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:14.831154 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d7c55-9a5d-4795-aee3-9bc6ef9a7b9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:14.831878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7c55-9a5d-4795-aee3-9bc6ef9a7b9d service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:14.832052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7c55-9a5d-4795-aee3-9bc6ef9a7b9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:14.832322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7c55-9a5d-4795-aee3-9bc6ef9a7b9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:14.834315 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-bf7d7c55-9a5d-4795-aee3-9bc6ef9a7b9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:14.889863 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:14.912451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5e9df6c1-e78f-471e-a809-098be44fb7e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38950e555cd4e4ba8f88436551ffc05'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:14.927125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5e9df6c1-e78f-471e-a809-098be44fb7e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38950e555cd4e4ba8f88436551ffc05'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:14.954869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d7c55-9a5d-4795-aee3-9bc6ef9a7b9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:14.956657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d7c55-9a5d-4795-aee3-9bc6ef9a7b9d service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:14.969122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 959/1899] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:15.098076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5e9df6c1-e78f-471e-a809-098be44fb7e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38950e555cd4e4ba8f88436551ffc05'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:15.099121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5e9df6c1-e78f-471e-a809-098be44fb7e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38950e555cd4e4ba8f88436551ffc05'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:15.101199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5e9df6c1-e78f-471e-a809-098be44fb7e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38950e555cd4e4ba8f88436551ffc05'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:15.127649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 941/1900] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:14 2022] DELETE /identity/v3/users/b38950e555cd4e4ba8f88436551ffc05 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:16.252587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d7c55-9a5d-4795-aee3-9bc6ef9a7b9d service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:16.318778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d7c55-9a5d-4795-aee3-9bc6ef9a7b9d service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:16.435219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4066cd42-286c-4114-96bf-44fe2cc20bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:16.437812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066cd42-286c-4114-96bf-44fe2cc20bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:16.438541 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066cd42-286c-4114-96bf-44fe2cc20bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:16.439039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4066cd42-286c-4114-96bf-44fe2cc20bce admin admin] PATH_INFO: `/v3/projects/7384bad14fb64386b8902d346ce85993` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:16.441229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066cd42-286c-4114-96bf-44fe2cc20bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=7384bad14fb64386b8902d346ce85993)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:16.444964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4066cd42-286c-4114-96bf-44fe2cc20bce admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:16.693551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-4066cd42-286c-4114-96bf-44fe2cc20bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7384bad14fb64386b8902d346ce85993', 'request_id': 'req-4066cd42-286c-4114-96bf-44fe2cc20bce'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:16.832755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-4066cd42-286c-4114-96bf-44fe2cc20bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7384bad14fb64386b8902d346ce85993', 'request_id': 'req-4066cd42-286c-4114-96bf-44fe2cc20bce'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:16.839400 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-4066cd42-286c-4114-96bf-44fe2cc20bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7384bad14fb64386b8902d346ce85993', 'request_id': 'req-4066cd42-286c-4114-96bf-44fe2cc20bce'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:16.861261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-4066cd42-286c-4114-96bf-44fe2cc20bce admin admin] The token cache is being invalidate because project 7384bad14fb64386b8902d346ce85993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:16.861620 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-4066cd42-286c-4114-96bf-44fe2cc20bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:16.862327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-4066cd42-286c-4114-96bf-44fe2cc20bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:16.865052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 960/1901] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:16 2022] DELETE /identity/v3/projects/7384bad14fb64386b8902d346ce85993 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:43:16.869998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882bc02-f5d4-471b-a7fe-970038952d3c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:16.872721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882bc02-f5d4-471b-a7fe-970038952d3c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:16.876320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882bc02-f5d4-471b-a7fe-970038952d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:16.927401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-3882bc02-f5d4-471b-a7fe-970038952d3c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:16.928644 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3882bc02-f5d4-471b-a7fe-970038952d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:17.076465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa1a9-ed8c-456d-9f10-f21ae677606a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:17.076657 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 942/1902] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:17.076758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa1a9-ed8c-456d-9f10-f21ae677606a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:17.077013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfa1a9-ed8c-456d-9f10-f21ae677606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:17.119730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-d9cfa1a9-ed8c-456d-9f10-f21ae677606a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:17.128740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d9cfa1a9-ed8c-456d-9f10-f21ae677606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:17.151234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 961/1903] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:17.156146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882bc02-f5d4-471b-a7fe-970038952d3c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:17.168554 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882bc02-f5d4-471b-a7fe-970038952d3c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:17.184432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510058f5-0ce4-4e78-9f06-61c959a43dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:17.185141 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510058f5-0ce4-4e78-9f06-61c959a43dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:17.185471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510058f5-0ce4-4e78-9f06-61c959a43dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:17.185780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510058f5-0ce4-4e78-9f06-61c959a43dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:17.186878 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510058f5-0ce4-4e78-9f06-61c959a43dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:17.187665 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510058f5-0ce4-4e78-9f06-61c959a43dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:17.190054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510058f5-0ce4-4e78-9f06-61c959a43dd9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:17.208620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 943/1904] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:17.214102 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfa1a9-ed8c-456d-9f10-f21ae677606a None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:17.224555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfa1a9-ed8c-456d-9f10-f21ae677606a None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:17.236429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf21ebc-2b61-4051-9c95-78a28511ec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:17.238252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf21ebc-2b61-4051-9c95-78a28511ec03 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:17.238709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf21ebc-2b61-4051-9c95-78a28511ec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:17.240275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf21ebc-2b61-4051-9c95-78a28511ec03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:17.241286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf21ebc-2b61-4051-9c95-78a28511ec03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:17.256848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf21ebc-2b61-4051-9c95-78a28511ec03 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:17.497977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 962/1905] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:17 2022] POST /identity/v3/projects => generated 379 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:17.502994 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510058f5-0ce4-4e78-9f06-61c959a43dd9 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:17.514523 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510058f5-0ce4-4e78-9f06-61c959a43dd9 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:17.581397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a268e0-699d-4bde-8247-adf7a8778b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:17.582054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a268e0-699d-4bde-8247-adf7a8778b2d admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:17.582333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a268e0-699d-4bde-8247-adf7a8778b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:17.582603 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a268e0-699d-4bde-8247-adf7a8778b2d admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:17.583330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a268e0-699d-4bde-8247-adf7a8778b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:17.585287 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a268e0-699d-4bde-8247-adf7a8778b2d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:17.813468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 944/1906] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:17 2022] POST /identity/v3/users => generated 290 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:43:17.817586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf21ebc-2b61-4051-9c95-78a28511ec03 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:17.829478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf21ebc-2b61-4051-9c95-78a28511ec03 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:17.834505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4c44-6843-4101-bca9-8f80d443a8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:17.835121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4c44-6843-4101-bca9-8f80d443a8ba admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:17.835406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4c44-6843-4101-bca9-8f80d443a8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:17.835685 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca4c44-6843-4101-bca9-8f80d443a8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:17.836533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca4c44-6843-4101-bca9-8f80d443a8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:17.838557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca4c44-6843-4101-bca9-8f80d443a8ba admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:17.849409 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 963/1907] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:17.853849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a268e0-699d-4bde-8247-adf7a8778b2d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:17.872827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a268e0-699d-4bde-8247-adf7a8778b2d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:17.878211 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404772e1-9cd1-4677-a6f6-793205f7c70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:17.878796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404772e1-9cd1-4677-a6f6-793205f7c70e admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:17.879084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404772e1-9cd1-4677-a6f6-793205f7c70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:17.879360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404772e1-9cd1-4677-a6f6-793205f7c70e admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:17.880103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404772e1-9cd1-4677-a6f6-793205f7c70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:17.882089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404772e1-9cd1-4677-a6f6-793205f7c70e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:17.896817 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 945/1908] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:17.903734 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4c44-6843-4101-bca9-8f80d443a8ba admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:17.914893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca4c44-6843-4101-bca9-8f80d443a8ba admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:17.921397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45ad88-f7bc-452e-971c-8c243b272bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:17.922116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ad88-f7bc-452e-971c-8c243b272bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:17.922517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ad88-f7bc-452e-971c-8c243b272bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:17.922849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ad88-f7bc-452e-971c-8c243b272bc8 admin admin] PATH_INFO: `/v3/projects/13389b644fed4392845012597d065100/users/9692dba0e7524ef1b72938841a993064/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:17.948391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45ad88-f7bc-452e-971c-8c243b272bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13389b644fed4392845012597d065100, user_id=9692dba0e7524ef1b72938841a993064, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:17.955442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45ad88-f7bc-452e-971c-8c243b272bc8 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:18.165277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 964/1909] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:17 2022] PUT /identity/v3/projects/13389b644fed4392845012597d065100/users/9692dba0e7524ef1b72938841a993064/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:18.167563 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d9e97-d632-49ce-a481-ede5be4bd4f5 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:18.167856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d9e97-d632-49ce-a481-ede5be4bd4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:18.168136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d9e97-d632-49ce-a481-ede5be4bd4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:18.208698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-0b4d9e97-d632-49ce-a481-ede5be4bd4f5 None None] MFA Rules not processed for user `9692dba0e7524ef1b72938841a993064`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:18.210151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0b4d9e97-d632-49ce-a481-ede5be4bd4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:18.291306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 946/1910] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:18.292988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45ad88-f7bc-452e-971c-8c243b272bc8 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:18.363566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45ad88-f7bc-452e-971c-8c243b272bc8 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:18.368603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0db3-2096-440a-b2a7-d045a62f02ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:18.369690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0db3-2096-440a-b2a7-d045a62f02ec admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:18.369690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0db3-2096-440a-b2a7-d045a62f02ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:18.369894 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe0db3-2096-440a-b2a7-d045a62f02ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:18.370508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe0db3-2096-440a-b2a7-d045a62f02ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:18.372679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe0db3-2096-440a-b2a7-d045a62f02ec admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:18.632364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 965/1911] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:18 2022] POST /identity/v3/projects => generated 381 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:18.638202 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d9e97-d632-49ce-a481-ede5be4bd4f5 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:18.653150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d9e97-d632-49ce-a481-ede5be4bd4f5 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:18.685042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:18.762296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97dffa-a3ca-45e8-8f8c-abe62dd77a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:18.762928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97dffa-a3ca-45e8-8f8c-abe62dd77a93 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:18.763330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97dffa-a3ca-45e8-8f8c-abe62dd77a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:18.764127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97dffa-a3ca-45e8-8f8c-abe62dd77a93 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:18.764254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97dffa-a3ca-45e8-8f8c-abe62dd77a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:18.766417 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97dffa-a3ca-45e8-8f8c-abe62dd77a93 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:18.929602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 947/1912] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:18 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:18.931694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0db3-2096-440a-b2a7-d045a62f02ec admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:18.942623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe0db3-2096-440a-b2a7-d045a62f02ec admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:18.949202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c359-54b9-47ad-b4be-83082b2d46b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:18.950632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c359-54b9-47ad-b4be-83082b2d46b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:18.950632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c359-54b9-47ad-b4be-83082b2d46b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:18.950632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675c359-54b9-47ad-b4be-83082b2d46b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:18.951226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675c359-54b9-47ad-b4be-83082b2d46b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:18.952984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675c359-54b9-47ad-b4be-83082b2d46b5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:18.965081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 966/1913] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:18.974640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97dffa-a3ca-45e8-8f8c-abe62dd77a93 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:18.988965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97dffa-a3ca-45e8-8f8c-abe62dd77a93 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:18.995444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248157c4-8702-4fa2-bb7f-60ea6d3c49ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:18.996309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248157c4-8702-4fa2-bb7f-60ea6d3c49ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:18.996661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248157c4-8702-4fa2-bb7f-60ea6d3c49ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:18.997008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248157c4-8702-4fa2-bb7f-60ea6d3c49ae admin admin] PATH_INFO: `/v3/projects/8b5da9b279a54123957787954fee87a0/users/30aa8e538d2648468432fb48d64deb6a/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:19.017343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248157c4-8702-4fa2-bb7f-60ea6d3c49ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5da9b279a54123957787954fee87a0, user_id=30aa8e538d2648468432fb48d64deb6a, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:19.020763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248157c4-8702-4fa2-bb7f-60ea6d3c49ae admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:19.154856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 948/1914] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:18 2022] PUT /identity/v3/projects/8b5da9b279a54123957787954fee87a0/users/30aa8e538d2648468432fb48d64deb6a/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:19.157216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c359-54b9-47ad-b4be-83082b2d46b5 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:19.182512 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675c359-54b9-47ad-b4be-83082b2d46b5 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:19.344153 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91a73b-9307-41fc-9d86-9710bd29271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:19.345764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a73b-9307-41fc-9d86-9710bd29271e admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:19.346218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a73b-9307-41fc-9d86-9710bd29271e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:19.346657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91a73b-9307-41fc-9d86-9710bd29271e admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:19.348290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91a73b-9307-41fc-9d86-9710bd29271e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:19.350087 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91a73b-9307-41fc-9d86-9710bd29271e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:19.390382 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 967/1915] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:19.391238 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248157c4-8702-4fa2-bb7f-60ea6d3c49ae admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:19.423811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248157c4-8702-4fa2-bb7f-60ea6d3c49ae admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:19.423811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a94863-77bf-4e7c-ac2c-e03039ceb463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:19.423811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a94863-77bf-4e7c-ac2c-e03039ceb463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:19.423811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a94863-77bf-4e7c-ac2c-e03039ceb463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:19.424180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a94863-77bf-4e7c-ac2c-e03039ceb463 admin admin] PATH_INFO: `/v3/projects/8b5da9b279a54123957787954fee87a0/users/30aa8e538d2648468432fb48d64deb6a/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:19.424180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a94863-77bf-4e7c-ac2c-e03039ceb463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5da9b279a54123957787954fee87a0, user_id=30aa8e538d2648468432fb48d64deb6a, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:19.426514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a94863-77bf-4e7c-ac2c-e03039ceb463 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:19.463001 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 949/1916] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:19 2022] PUT /identity/v3/projects/8b5da9b279a54123957787954fee87a0/users/30aa8e538d2648468432fb48d64deb6a/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:19.465331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344bdd6-39cb-4fdc-8a9d-8115e9afa7be None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:19.466110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344bdd6-39cb-4fdc-8a9d-8115e9afa7be None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:19.466753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344bdd6-39cb-4fdc-8a9d-8115e9afa7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:19.522915 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-6344bdd6-39cb-4fdc-8a9d-8115e9afa7be None None] MFA Rules not processed for user `30aa8e538d2648468432fb48d64deb6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:19.524689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6344bdd6-39cb-4fdc-8a9d-8115e9afa7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:19.614242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 968/1917] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:19.641809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a94863-77bf-4e7c-ac2c-e03039ceb463 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:19.644399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-53a94863-77bf-4e7c-ac2c-e03039ceb463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:19.731081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a94863-77bf-4e7c-ac2c-e03039ceb463 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:19.737074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c7976-80a6-41f1-9438-b0ef488bab6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:19.737747 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c7976-80a6-41f1-9438-b0ef488bab6a service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:19.738027 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c7976-80a6-41f1-9438-b0ef488bab6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:19.738295 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c7976-80a6-41f1-9438-b0ef488bab6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:19.750410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c7976-80a6-41f1-9438-b0ef488bab6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:19.752536 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c7976-80a6-41f1-9438-b0ef488bab6a service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:19.768812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 950/1918] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:20.723249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cdf16-2892-45e5-a760-728e926cd57d None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:20.723759 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cdf16-2892-45e5-a760-728e926cd57d None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:20.728132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37cdf16-2892-45e5-a760-728e926cd57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:20.778824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-a37cdf16-2892-45e5-a760-728e926cd57d None None] MFA Rules not processed for user `d5e35757fcf046bdbb34dee53a336a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:20.780758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a37cdf16-2892-45e5-a760-728e926cd57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:20.902002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 969/1919] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:20.917310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c7976-80a6-41f1-9438-b0ef488bab6a service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:20.918922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4f8c7976-80a6-41f1-9438-b0ef488bab6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:21.037565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c7976-80a6-41f1-9438-b0ef488bab6a service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:21.037565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e376e1b-b4c4-4a35-90ef-d980f88a6790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:21.038406 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e376e1b-b4c4-4a35-90ef-d980f88a6790 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:21.038715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e376e1b-b4c4-4a35-90ef-d980f88a6790 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:21.038975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e376e1b-b4c4-4a35-90ef-d980f88a6790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:21.048036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e376e1b-b4c4-4a35-90ef-d980f88a6790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:21.049933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e376e1b-b4c4-4a35-90ef-d980f88a6790 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:21.059828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 951/1920] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:21.158533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b02ad-ce45-4c57-a313-651fa618b65e None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:21.159012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b02ad-ce45-4c57-a313-651fa618b65e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:21.159471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b02ad-ce45-4c57-a313-651fa618b65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:21.199898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-6c8b02ad-ce45-4c57-a313-651fa618b65e None None] MFA Rules not processed for user `b1fdffd48cc44f63b3cce07d74b0841e`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:21.202138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6c8b02ad-ce45-4c57-a313-651fa618b65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:21.270237 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 970/1921] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:21.448745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e376e1b-b4c4-4a35-90ef-d980f88a6790 service nova] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:21.450648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9e376e1b-b4c4-4a35-90ef-d980f88a6790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:21.463997 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e376e1b-b4c4-4a35-90ef-d980f88a6790 service nova] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:21.468510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdea07d-e0eb-4b39-951d-9e357c3acb56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:21.469129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdea07d-e0eb-4b39-951d-9e357c3acb56 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:21.469440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdea07d-e0eb-4b39-951d-9e357c3acb56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:21.469740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdea07d-e0eb-4b39-951d-9e357c3acb56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:21.471849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0fdea07d-e0eb-4b39-951d-9e357c3acb56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:21.542435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdea07d-e0eb-4b39-951d-9e357c3acb56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:21.543821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdea07d-e0eb-4b39-951d-9e357c3acb56 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:21.554000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 952/1922] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:43:21.683489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eebc10-632a-4ddb-8d92-c66fe5661428 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:21.683813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eebc10-632a-4ddb-8d92-c66fe5661428 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:21.685993 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eebc10-632a-4ddb-8d92-c66fe5661428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-52eebc10-632a-4ddb-8d92-c66fe5661428 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:43:21.698772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:43:21.699665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:43:21.700869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 971/1923] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:43:21 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 12 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 01 05:43:22.646379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:22.984097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdea07d-e0eb-4b39-951d-9e357c3acb56 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:22.985716 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0fdea07d-e0eb-4b39-951d-9e357c3acb56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:23.195096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdea07d-e0eb-4b39-951d-9e357c3acb56 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:23.203764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eebc10-632a-4ddb-8d92-c66fe5661428 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:23.209567 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd02d8f7-0da3-49d9-90ee-4fc049c844c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:23.218176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02d8f7-0da3-49d9-90ee-4fc049c844c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:23.218176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02d8f7-0da3-49d9-90ee-4fc049c844c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:23.218176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd02d8f7-0da3-49d9-90ee-4fc049c844c3 admin admin] PATH_INFO: `/v3/users/db1518754c1f446592a17925b86ced4d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:23.218176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02d8f7-0da3-49d9-90ee-4fc049c844c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1518754c1f446592a17925b86ced4d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:23.218176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd02d8f7-0da3-49d9-90ee-4fc049c844c3 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:23.256450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eebc10-632a-4ddb-8d92-c66fe5661428 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:23.265918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:23.267089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:23.267605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:23.268126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] PATH_INFO: `/v3/users/9692dba0e7524ef1b72938841a993064` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:23.270427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9692dba0e7524ef1b72938841a993064)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:23.275501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:23.738821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-cd02d8f7-0da3-49d9-90ee-4fc049c844c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1518754c1f446592a17925b86ced4d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:23.751864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9692dba0e7524ef1b72938841a993064'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:23.757192 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-cd02d8f7-0da3-49d9-90ee-4fc049c844c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1518754c1f446592a17925b86ced4d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:23.773651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9692dba0e7524ef1b72938841a993064'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:23.782164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9692dba0e7524ef1b72938841a993064'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:23.932849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-cd02d8f7-0da3-49d9-90ee-4fc049c844c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1518754c1f446592a17925b86ced4d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:23.933968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-cd02d8f7-0da3-49d9-90ee-4fc049c844c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1518754c1f446592a17925b86ced4d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:23.935521 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-cd02d8f7-0da3-49d9-90ee-4fc049c844c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1518754c1f446592a17925b86ced4d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:23.966889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 953/1924] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:22 2022] DELETE /identity/v3/users/db1518754c1f446592a17925b86ced4d => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:23.971442 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd64ff-5908-4237-aa42-eedaad933434 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:23.972080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd64ff-5908-4237-aa42-eedaad933434 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:23.972814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd64ff-5908-4237-aa42-eedaad933434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:24.009181 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-4fcd64ff-5908-4237-aa42-eedaad933434 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:24.009181 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4fcd64ff-5908-4237-aa42-eedaad933434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:24.099465 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 954/1925] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:24.120921 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9692dba0e7524ef1b72938841a993064'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:24.121755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9692dba0e7524ef1b72938841a993064'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:24.135450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 972/1926] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:23 2022] DELETE /identity/v3/users/9692dba0e7524ef1b72938841a993064 => generated 0 bytes in 935 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:24.136425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0f472-81dc-4d40-b19a-902488b466e2 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:24.136718 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0f472-81dc-4d40-b19a-902488b466e2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:24.136991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0f472-81dc-4d40-b19a-902488b466e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:24.177473 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-14f0f472-81dc-4d40-b19a-902488b466e2 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:24.178766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-14f0f472-81dc-4d40-b19a-902488b466e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:24.218880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:24.224268 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:24.329750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 955/1927] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:24.358475 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0f472-81dc-4d40-b19a-902488b466e2 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:24.358475 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-14f0f472-81dc-4d40-b19a-902488b466e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:24.439552 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13664b-94de-40bb-bcf3-2bf7ad79825e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:24.447933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0f472-81dc-4d40-b19a-902488b466e2 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:24.452594 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820ba74-ef6a-49f5-befe-684b83923475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:24.453454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce38b5-6481-4e72-808a-52d0270525b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:24.454088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce38b5-6481-4e72-808a-52d0270525b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:24.454421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce38b5-6481-4e72-808a-52d0270525b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:24.454538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820ba74-ef6a-49f5-befe-684b83923475 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:24.454692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce38b5-6481-4e72-808a-52d0270525b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:24.454854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820ba74-ef6a-49f5-befe-684b83923475 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:24.456262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820ba74-ef6a-49f5-befe-684b83923475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:24.461939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c820ba74-ef6a-49f5-befe-684b83923475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:24.470663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce38b5-6481-4e72-808a-52d0270525b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:24.472320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce38b5-6481-4e72-808a-52d0270525b4 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:24.485578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 956/1928] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:24.505977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820ba74-ef6a-49f5-befe-684b83923475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:24.507558 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820ba74-ef6a-49f5-befe-684b83923475 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:24.530162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 973/1929] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:43:25.390113 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:25.834347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce38b5-6481-4e72-808a-52d0270525b4 service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:25.836528 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-82ce38b5-6481-4e72-808a-52d0270525b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:25.862334 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce38b5-6481-4e72-808a-52d0270525b4 service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:25.880006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:25.881776 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:25.883728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:25.884100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] PATH_INFO: `/v3/projects/13389b644fed4392845012597d065100` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:25.894527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=13389b644fed4392845012597d065100)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:25.896740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:25.970107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820ba74-ef6a-49f5-befe-684b83923475 service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:25.972341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c820ba74-ef6a-49f5-befe-684b83923475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:26.019602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820ba74-ef6a-49f5-befe-684b83923475 service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:26.035428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:26.036419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:26.036860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:26.037304 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] PATH_INFO: `/v3/projects/7c778fcbe13246659f2ad449d3c4cbd7` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:26.039877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c778fcbe13246659f2ad449d3c4cbd7)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:26.044045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:26.241069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13389b644fed4392845012597d065100', 'request_id': 'req-751e9bff-9425-4e92-b149-07dc6a41f74e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:26.252324 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13389b644fed4392845012597d065100', 'request_id': 'req-751e9bff-9425-4e92-b149-07dc6a41f74e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:26.395939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c778fcbe13246659f2ad449d3c4cbd7', 'request_id': 'req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:26.406502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13389b644fed4392845012597d065100', 'request_id': 'req-751e9bff-9425-4e92-b149-07dc6a41f74e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:26.437164 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] The token cache is being invalidate because project 13389b644fed4392845012597d065100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:26.437437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:26.439061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:26.441915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 957/1930] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:25 2022] DELETE /identity/v3/projects/13389b644fed4392845012597d065100 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:26.448793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:26.451963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:26.639874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c778fcbe13246659f2ad449d3c4cbd7', 'request_id': 'req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:26.647812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c778fcbe13246659f2ad449d3c4cbd7', 'request_id': 'req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:26.665113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e9bff-9425-4e92-b149-07dc6a41f74e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:26.721223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] The token cache is being invalidate because project 7c778fcbe13246659f2ad449d3c4cbd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:26.721531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:26.728688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:26.736070 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 974/1931] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:25 2022] DELETE /identity/v3/projects/7c778fcbe13246659f2ad449d3c4cbd7 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:43:26.738635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:26.741536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:26.833676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84de4c-d372-48e6-990f-d84a1b114679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:26.838103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84de4c-d372-48e6-990f-d84a1b114679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:26.842148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84de4c-d372-48e6-990f-d84a1b114679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:26.842788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84de4c-d372-48e6-990f-d84a1b114679 admin admin] PATH_INFO: `/v3/users/30aa8e538d2648468432fb48d64deb6a` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:26.845592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84de4c-d372-48e6-990f-d84a1b114679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30aa8e538d2648468432fb48d64deb6a)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:26.848339 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84de4c-d372-48e6-990f-d84a1b114679 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:26.917322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249821d-f1b9-4d6f-8e29-ddd68f0c0411 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:26.928390 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba69e9b-060f-4a4b-a8ea-d9bd6bea13ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:26.932360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba69e9b-060f-4a4b-a8ea-d9bd6bea13ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:26.932360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba69e9b-060f-4a4b-a8ea-d9bd6bea13ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:26.932360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba69e9b-060f-4a4b-a8ea-d9bd6bea13ab admin admin] PATH_INFO: `/v3/users/e13325db5850430ebcae6daaf1ab1be0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:26.932360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba69e9b-060f-4a4b-a8ea-d9bd6bea13ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e13325db5850430ebcae6daaf1ab1be0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:26.938278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba69e9b-060f-4a4b-a8ea-d9bd6bea13ab admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:27.430090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ee84de4c-d372-48e6-990f-d84a1b114679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30aa8e538d2648468432fb48d64deb6a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:27.441863 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ee84de4c-d372-48e6-990f-d84a1b114679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30aa8e538d2648468432fb48d64deb6a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:27.480045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9ba69e9b-060f-4a4b-a8ea-d9bd6bea13ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e13325db5850430ebcae6daaf1ab1be0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:27.500482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9ba69e9b-060f-4a4b-a8ea-d9bd6bea13ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e13325db5850430ebcae6daaf1ab1be0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:27.514741 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9ba69e9b-060f-4a4b-a8ea-d9bd6bea13ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e13325db5850430ebcae6daaf1ab1be0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:27.711643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ee84de4c-d372-48e6-990f-d84a1b114679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30aa8e538d2648468432fb48d64deb6a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:27.713265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ee84de4c-d372-48e6-990f-d84a1b114679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30aa8e538d2648468432fb48d64deb6a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:27.715402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ee84de4c-d372-48e6-990f-d84a1b114679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30aa8e538d2648468432fb48d64deb6a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:27.786072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 958/1932] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:26 2022] DELETE /identity/v3/users/30aa8e538d2648468432fb48d64deb6a => generated 0 bytes in 1338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:27.788961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfc78b-a640-441d-bd65-9168f2593bc4 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:27.789927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfc78b-a640-441d-bd65-9168f2593bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:27.790591 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfc78b-a640-441d-bd65-9168f2593bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:27.855100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-86bfc78b-a640-441d-bd65-9168f2593bc4 None None] MFA Rules not processed for user `d5e35757fcf046bdbb34dee53a336a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:27.857593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-86bfc78b-a640-441d-bd65-9168f2593bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:27.966847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9ba69e9b-060f-4a4b-a8ea-d9bd6bea13ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e13325db5850430ebcae6daaf1ab1be0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:27.968430 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9ba69e9b-060f-4a4b-a8ea-d9bd6bea13ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e13325db5850430ebcae6daaf1ab1be0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:27.998782 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 975/1933] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:26 2022] DELETE /identity/v3/users/e13325db5850430ebcae6daaf1ab1be0 => generated 0 bytes in 1253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:28.018921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 959/1934] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:28.759718 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc34e19-95ea-4bb6-bfad-dd03657a4baa None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:28.760539 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc34e19-95ea-4bb6-bfad-dd03657a4baa None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:28.760677 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc34e19-95ea-4bb6-bfad-dd03657a4baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-1bc34e19-95ea-4bb6-bfad-dd03657a4baa None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:43:28.775625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:43:28.777471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:43:28.794314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 976/1935] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:43:28 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 33 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 01 05:43:28.900813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfc78b-a640-441d-bd65-9168f2593bc4 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:28.902416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-86bfc78b-a640-441d-bd65-9168f2593bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:29.084267 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfc78b-a640-441d-bd65-9168f2593bc4 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:29.166669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:29.181634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc34e19-95ea-4bb6-bfad-dd03657a4baa None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:29.183887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1bc34e19-95ea-4bb6-bfad-dd03657a4baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:29.236080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1da0e3-3cfe-49ba-9083-10636c9e383f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:29.237244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1da0e3-3cfe-49ba-9083-10636c9e383f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:29.238015 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1da0e3-3cfe-49ba-9083-10636c9e383f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:29.238571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1da0e3-3cfe-49ba-9083-10636c9e383f admin admin] PATH_INFO: `/v3/projects/8b5da9b279a54123957787954fee87a0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:29.240862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1da0e3-3cfe-49ba-9083-10636c9e383f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5da9b279a54123957787954fee87a0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:29.246131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1da0e3-3cfe-49ba-9083-10636c9e383f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:29.345329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc34e19-95ea-4bb6-bfad-dd03657a4baa None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:29.353976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:29.354873 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:29.355308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:29.355752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d admin admin] PATH_INFO: `/v3/projects/bf6d654c760d453390d6216e3d290095` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:29.357145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6d654c760d453390d6216e3d290095)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:29.359542 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:29.562283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7d1da0e3-3cfe-49ba-9083-10636c9e383f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5da9b279a54123957787954fee87a0', 'request_id': 'req-7d1da0e3-3cfe-49ba-9083-10636c9e383f'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:29.572024 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7d1da0e3-3cfe-49ba-9083-10636c9e383f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5da9b279a54123957787954fee87a0', 'request_id': 'req-7d1da0e3-3cfe-49ba-9083-10636c9e383f'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:29.580764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:29.637709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6d654c760d453390d6216e3d290095', 'request_id': 'req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:29.764481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7d1da0e3-3cfe-49ba-9083-10636c9e383f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5da9b279a54123957787954fee87a0', 'request_id': 'req-7d1da0e3-3cfe-49ba-9083-10636c9e383f'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:29.779978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7d1da0e3-3cfe-49ba-9083-10636c9e383f admin admin] The token cache is being invalidate because project 8b5da9b279a54123957787954fee87a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:29.780691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7d1da0e3-3cfe-49ba-9083-10636c9e383f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:29.782604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7d1da0e3-3cfe-49ba-9083-10636c9e383f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:29.788900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 960/1936] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:28 2022] DELETE /identity/v3/projects/8b5da9b279a54123957787954fee87a0 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:29.790930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b0adc-701b-412b-9a0b-151083292bbb None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:29.791510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b0adc-701b-412b-9a0b-151083292bbb None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:29.792129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b0adc-701b-412b-9a0b-151083292bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:29.819285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-452b0adc-701b-412b-9a0b-151083292bbb None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:29.822152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-452b0adc-701b-412b-9a0b-151083292bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:29.943686 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 961/1937] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:29.947283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331117-6b57-4f5e-899d-422705739630 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:29.947881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331117-6b57-4f5e-899d-422705739630 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:29.948313 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80331117-6b57-4f5e-899d-422705739630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:29.960126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6d654c760d453390d6216e3d290095', 'request_id': 'req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:29.970502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6d654c760d453390d6216e3d290095', 'request_id': 'req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:29.998318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d admin admin] The token cache is being invalidate because project bf6d654c760d453390d6216e3d290095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:30.000971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:30.004497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d165bc08-1dde-49b7-be3b-94a42fcd5d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:30.006765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 977/1938] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:29 2022] DELETE /identity/v3/projects/bf6d654c760d453390d6216e3d290095 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:30.014326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bab4-eded-4585-9f46-3daccb5867b2 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:30.014907 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bab4-eded-4585-9f46-3daccb5867b2 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:30.016126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6bab4-eded-4585-9f46-3daccb5867b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:30.028776 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-80331117-6b57-4f5e-899d-422705739630 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:30.031952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-80331117-6b57-4f5e-899d-422705739630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:30.085509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c0e6bab4-eded-4585-9f46-3daccb5867b2 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:30.086495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 962/1939] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:30.086887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c0e6bab4-eded-4585-9f46-3daccb5867b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:30.089236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80331117-6b57-4f5e-899d-422705739630 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:30.116812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80331117-6b57-4f5e-899d-422705739630 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:30.118693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 978/1940] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:43:30.120401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2e4cb-a674-4d75-93f1-bf53e79e474f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:30.120856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2e4cb-a674-4d75-93f1-bf53e79e474f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:30.121294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2e4cb-a674-4d75-93f1-bf53e79e474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:30.125972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ae3b1-0d1f-4a16-bf49-acd46a2628f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:30.127030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ae3b1-0d1f-4a16-bf49-acd46a2628f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:30.127514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ae3b1-0d1f-4a16-bf49-acd46a2628f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:30.127984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ae3b1-0d1f-4a16-bf49-acd46a2628f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:30.129652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ae3b1-0d1f-4a16-bf49-acd46a2628f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:30.130470 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ae3b1-0d1f-4a16-bf49-acd46a2628f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:30.134549 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ae3b1-0d1f-4a16-bf49-acd46a2628f5 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:30.153209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-faf2e4cb-a674-4d75-93f1-bf53e79e474f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:30.154633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-faf2e4cb-a674-4d75-93f1-bf53e79e474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:30.158288 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 963/1941] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:30.162974 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ae3b1-0d1f-4a16-bf49-acd46a2628f5 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:30.168028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 979/1942] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:30.173463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2e4cb-a674-4d75-93f1-bf53e79e474f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:30.176281 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ae3b1-0d1f-4a16-bf49-acd46a2628f5 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:30.183701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d1e58-ff38-49a3-a1a9-0a9f740f56ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:30.184409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d1e58-ff38-49a3-a1a9-0a9f740f56ec admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:30.184873 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d1e58-ff38-49a3-a1a9-0a9f740f56ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:30.189715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d1e58-ff38-49a3-a1a9-0a9f740f56ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:30.189715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d1e58-ff38-49a3-a1a9-0a9f740f56ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:30.190186 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2e4cb-a674-4d75-93f1-bf53e79e474f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:30.190301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d1e58-ff38-49a3-a1a9-0a9f740f56ec admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:30.203262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b3091-ae69-469d-90f1-7ebbf755d32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:30.203262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b3091-ae69-469d-90f1-7ebbf755d32e admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:30.203262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b3091-ae69-469d-90f1-7ebbf755d32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:30.203262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b3091-ae69-469d-90f1-7ebbf755d32e admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:30.204151 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b3091-ae69-469d-90f1-7ebbf755d32e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:30.204151 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b3091-ae69-469d-90f1-7ebbf755d32e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:30.204151 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b3091-ae69-469d-90f1-7ebbf755d32e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:30.237746 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 980/1943] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:30.237746 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b3091-ae69-469d-90f1-7ebbf755d32e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:30.250828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b3091-ae69-469d-90f1-7ebbf755d32e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:30.259042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d5583-fd9c-4ee4-859f-ed733afdc39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:30.259806 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d5583-fd9c-4ee4-859f-ed733afdc39e admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:30.260188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d5583-fd9c-4ee4-859f-ed733afdc39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:30.260465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d5583-fd9c-4ee4-859f-ed733afdc39e admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:30.261128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d5583-fd9c-4ee4-859f-ed733afdc39e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:30.263157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d5583-fd9c-4ee4-859f-ed733afdc39e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:30.450717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 964/1944] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:30 2022] POST /identity/v3/projects => generated 381 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:30.455113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d1e58-ff38-49a3-a1a9-0a9f740f56ec admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:30.606404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d1e58-ff38-49a3-a1a9-0a9f740f56ec admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:30.620429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536126f-8bb8-4ac5-a60c-a618f6577e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:30.621425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536126f-8bb8-4ac5-a60c-a618f6577e9c admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:30.621677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536126f-8bb8-4ac5-a60c-a618f6577e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:30.622126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536126f-8bb8-4ac5-a60c-a618f6577e9c admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:30.623460 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536126f-8bb8-4ac5-a60c-a618f6577e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:30.626389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9536126f-8bb8-4ac5-a60c-a618f6577e9c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:30.662490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 981/1945] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:30 2022] POST /identity/v3/projects => generated 385 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:30.666133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d5583-fd9c-4ee4-859f-ed733afdc39e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:30.669343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f58d5583-fd9c-4ee4-859f-ed733afdc39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:30.774917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d5583-fd9c-4ee4-859f-ed733afdc39e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:30.780995 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:30.782309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:30.782618 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:30.789726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] PATH_INFO: `/v3/users/b1fdffd48cc44f63b3cce07d74b0841e` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:30.789726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1fdffd48cc44f63b3cce07d74b0841e)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:30.789726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:30.945267 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 965/1946] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:30 2022] POST /identity/v3/users => generated 291 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:43:30.949452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536126f-8bb8-4ac5-a60c-a618f6577e9c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:30.963440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536126f-8bb8-4ac5-a60c-a618f6577e9c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:30.968377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f3211-60c4-4107-8431-88a16bc76e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:30.969303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f3211-60c4-4107-8431-88a16bc76e06 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:30.969303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f3211-60c4-4107-8431-88a16bc76e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:30.969645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f3211-60c4-4107-8431-88a16bc76e06 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:30.970238 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f3211-60c4-4107-8431-88a16bc76e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:30.972435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f3211-60c4-4107-8431-88a16bc76e06 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:31.204265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 966/1947] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:30 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:31.204265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f3211-60c4-4107-8431-88a16bc76e06 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:31.218774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f3211-60c4-4107-8431-88a16bc76e06 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:31.219637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1fdffd48cc44f63b3cce07d74b0841e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:31.231041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a5836-3c92-4df0-80de-afd6a19a4ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:31.232227 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a5836-3c92-4df0-80de-afd6a19a4ffb admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:31.232747 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a5836-3c92-4df0-80de-afd6a19a4ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:31.233749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a5836-3c92-4df0-80de-afd6a19a4ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:31.234153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a5836-3c92-4df0-80de-afd6a19a4ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:31.235910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a5836-3c92-4df0-80de-afd6a19a4ffb admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:31.245307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1fdffd48cc44f63b3cce07d74b0841e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:31.253930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1fdffd48cc44f63b3cce07d74b0841e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:31.272121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 967/1948] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:31.272121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a5836-3c92-4df0-80de-afd6a19a4ffb admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:31.300012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a5836-3c92-4df0-80de-afd6a19a4ffb admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:31.307215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eaba2-fe09-4277-8664-4aacdc294e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:31.307934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eaba2-fe09-4277-8664-4aacdc294e76 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:31.308305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eaba2-fe09-4277-8664-4aacdc294e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:31.308571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87eaba2-fe09-4277-8664-4aacdc294e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:31.309287 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eaba2-fe09-4277-8664-4aacdc294e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:31.310991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87eaba2-fe09-4277-8664-4aacdc294e76 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:31.327662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 968/1949] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:31.328840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eaba2-fe09-4277-8664-4aacdc294e76 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:31.354031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87eaba2-fe09-4277-8664-4aacdc294e76 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:31.362194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae5001-528b-44bf-82a9-c2e236ef6c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:31.363395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae5001-528b-44bf-82a9-c2e236ef6c97 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:31.363604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae5001-528b-44bf-82a9-c2e236ef6c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:31.363897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae5001-528b-44bf-82a9-c2e236ef6c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:31.364994 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae5001-528b-44bf-82a9-c2e236ef6c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:31.368396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae5001-528b-44bf-82a9-c2e236ef6c97 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:31.395102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 969/1950] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:31.396652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae5001-528b-44bf-82a9-c2e236ef6c97 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:31.415621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae5001-528b-44bf-82a9-c2e236ef6c97 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:31.423661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73bcd9-947a-445b-b860-c1885bce76da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:31.427286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73bcd9-947a-445b-b860-c1885bce76da admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:31.427286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73bcd9-947a-445b-b860-c1885bce76da admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:31.427286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73bcd9-947a-445b-b860-c1885bce76da admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:31.427286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73bcd9-947a-445b-b860-c1885bce76da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:31.428980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73bcd9-947a-445b-b860-c1885bce76da admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:31.448686 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 970/1951] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:31.449514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73bcd9-947a-445b-b860-c1885bce76da admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:31.458618 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1fdffd48cc44f63b3cce07d74b0841e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:31.459826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1fdffd48cc44f63b3cce07d74b0841e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:31.469023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 982/1952] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:30 2022] DELETE /identity/v3/users/b1fdffd48cc44f63b3cce07d74b0841e => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:31.471094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:31.473046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73bcd9-947a-445b-b860-c1885bce76da admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:31.473238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:31.562710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4ac7e-c271-4b37-86ba-52dd896453a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:31.563825 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4ac7e-c271-4b37-86ba-52dd896453a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:31.564106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4ac7e-c271-4b37-86ba-52dd896453a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:31.564375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4ac7e-c271-4b37-86ba-52dd896453a1 admin admin] PATH_INFO: `/v3/projects/b2c50a17a125477ea3ee7c6d6e81d62f/users/e7b8091ed488491e888dfec5878a49f3/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:31.579730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a693e5b8-2ae0-41bd-871b-aac520c34f34 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:31.582867 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4ac7e-c271-4b37-86ba-52dd896453a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c50a17a125477ea3ee7c6d6e81d62f, user_id=e7b8091ed488491e888dfec5878a49f3, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:31.585474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2957bbc5-d4d2-4a9e-8c26-2d250ffc7b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:31.586119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4ac7e-c271-4b37-86ba-52dd896453a1 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:31.586697 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957bbc5-d4d2-4a9e-8c26-2d250ffc7b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:31.588176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957bbc5-d4d2-4a9e-8c26-2d250ffc7b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:31.588735 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2957bbc5-d4d2-4a9e-8c26-2d250ffc7b69 admin admin] PATH_INFO: `/v3/projects/0d3acf7db89f4e02b5e456e76722fb2c/users/d2f00a61084c4e73bfc9532c99379708/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:31.623400 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957bbc5-d4d2-4a9e-8c26-2d250ffc7b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3acf7db89f4e02b5e456e76722fb2c, user_id=d2f00a61084c4e73bfc9532c99379708, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:31.628171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2957bbc5-d4d2-4a9e-8c26-2d250ffc7b69 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:31.797652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 971/1953] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:31 2022] PUT /identity/v3/projects/b2c50a17a125477ea3ee7c6d6e81d62f/users/e7b8091ed488491e888dfec5878a49f3/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:31.801729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4ac7e-c271-4b37-86ba-52dd896453a1 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:31.813827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 983/1954] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:31 2022] PUT /identity/v3/projects/0d3acf7db89f4e02b5e456e76722fb2c/users/d2f00a61084c4e73bfc9532c99379708/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:31.815379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-20a4ac7e-c271-4b37-86ba-52dd896453a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:31.819668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e92798-5b70-4c8f-a9ba-03d3495626a2 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:31.820002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e92798-5b70-4c8f-a9ba-03d3495626a2 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:31.820908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e92798-5b70-4c8f-a9ba-03d3495626a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:31.862041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-a5e92798-5b70-4c8f-a9ba-03d3495626a2 None None] MFA Rules not processed for user `d2f00a61084c4e73bfc9532c99379708`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:31.862041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a5e92798-5b70-4c8f-a9ba-03d3495626a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:31.920808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4ac7e-c271-4b37-86ba-52dd896453a1 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:31.926865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:31.927799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:31.928868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:31.930020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec admin admin] PATH_INFO: `/v3/projects/f1ab6c47a23647c689280b95fc897278` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:31.932376 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ab6c47a23647c689280b95fc897278)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:31.935680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:31.962569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 984/1955] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:31.964452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeff6a-aa66-488a-841f-41d418ff2190 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:31.964904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeff6a-aa66-488a-841f-41d418ff2190 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:31.965352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeff6a-aa66-488a-841f-41d418ff2190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:32.011239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-74aeff6a-aa66-488a-841f-41d418ff2190 None None] MFA Rules not processed for user `e7b8091ed488491e888dfec5878a49f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:32.013572 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-74aeff6a-aa66-488a-841f-41d418ff2190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:32.100140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 985/1956] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:32.102345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeff6a-aa66-488a-841f-41d418ff2190 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:32.104528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-74aeff6a-aa66-488a-841f-41d418ff2190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:32.108122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ab6c47a23647c689280b95fc897278', 'request_id': 'req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:32.115094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ab6c47a23647c689280b95fc897278', 'request_id': 'req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:32.190124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeff6a-aa66-488a-841f-41d418ff2190 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:32.246061 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480ba8c-9a08-48ca-bc1a-1c33d167f25a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:32.246726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480ba8c-9a08-48ca-bc1a-1c33d167f25a service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:32.246947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480ba8c-9a08-48ca-bc1a-1c33d167f25a service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:32.247222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480ba8c-9a08-48ca-bc1a-1c33d167f25a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:32.314645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480ba8c-9a08-48ca-bc1a-1c33d167f25a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:32.316125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480ba8c-9a08-48ca-bc1a-1c33d167f25a service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:32.321441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ab6c47a23647c689280b95fc897278', 'request_id': 'req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:32.327122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 986/1957] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:32.328024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480ba8c-9a08-48ca-bc1a-1c33d167f25a service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:32.330456 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1480ba8c-9a08-48ca-bc1a-1c33d167f25a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:32.333587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec admin admin] The token cache is being invalidate because project f1ab6c47a23647c689280b95fc897278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:32.334371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:32.334559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4e678f5c-1f22-4c6c-bc18-2dae3dc25bec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:32.337243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 972/1958] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:31 2022] DELETE /identity/v3/projects/f1ab6c47a23647c689280b95fc897278 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:32.345583 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9ddb0-6f2d-4f53-b399-2a81e372eb3f None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:32.346334 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9ddb0-6f2d-4f53-b399-2a81e372eb3f None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:32.347220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9ddb0-6f2d-4f53-b399-2a81e372eb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:32.396856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-75d9ddb0-6f2d-4f53-b399-2a81e372eb3f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:32.399675 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-75d9ddb0-6f2d-4f53-b399-2a81e372eb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:32.497160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480ba8c-9a08-48ca-bc1a-1c33d167f25a service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:32.498023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1563d9-050f-44b1-9877-29cac76cd4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:32.498901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1563d9-050f-44b1-9877-29cac76cd4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:32.499192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1563d9-050f-44b1-9877-29cac76cd4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:32.499532 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1563d9-050f-44b1-9877-29cac76cd4d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:32.500207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1563d9-050f-44b1-9877-29cac76cd4d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:32.503088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1563d9-050f-44b1-9877-29cac76cd4d2 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:32.511396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 973/1959] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:32.522956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd337b6-4e58-42a9-ad5c-55c885b779be None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:32.524520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd337b6-4e58-42a9-ad5c-55c885b779be None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:32.525061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd337b6-4e58-42a9-ad5c-55c885b779be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:32.560185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-cbd337b6-4e58-42a9-ad5c-55c885b779be None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:32.562583 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-cbd337b6-4e58-42a9-ad5c-55c885b779be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:32.573785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 974/1960] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:32.586278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd337b6-4e58-42a9-ad5c-55c885b779be None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:32.596249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd337b6-4e58-42a9-ad5c-55c885b779be None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:32.602134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c38585-f002-411a-989a-16ec4a03af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:32.602680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c38585-f002-411a-989a-16ec4a03af13 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:32.602964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c38585-f002-411a-989a-16ec4a03af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:32.603237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c38585-f002-411a-989a-16ec4a03af13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:32.603898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c38585-f002-411a-989a-16ec4a03af13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:32.604939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c38585-f002-411a-989a-16ec4a03af13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:32.605976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c38585-f002-411a-989a-16ec4a03af13 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:32.619879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 975/1961] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:32.624749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c38585-f002-411a-989a-16ec4a03af13 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:32.636358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c38585-f002-411a-989a-16ec4a03af13 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:32.646243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ec088-987c-48ce-8ec2-06a2bdf6a05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:32.646243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ec088-987c-48ce-8ec2-06a2bdf6a05f admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:32.646243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ec088-987c-48ce-8ec2-06a2bdf6a05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:32.646243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ec088-987c-48ce-8ec2-06a2bdf6a05f admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:32.647192 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ec088-987c-48ce-8ec2-06a2bdf6a05f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:32.647192 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ec088-987c-48ce-8ec2-06a2bdf6a05f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:32.733262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 987/1962] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:32 2022] POST /identity/v3/projects => generated 383 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:32.738685 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1563d9-050f-44b1-9877-29cac76cd4d2 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:32.741209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7f1563d9-050f-44b1-9877-29cac76cd4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:32.787414 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 976/1963] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:32 2022] POST /identity/v3/projects => generated 405 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:43:32.793145 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ec088-987c-48ce-8ec2-06a2bdf6a05f admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:32.854823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1563d9-050f-44b1-9877-29cac76cd4d2 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:32.925672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ec088-987c-48ce-8ec2-06a2bdf6a05f admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:32.933804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b2a2c-adba-4ce6-80df-62c0c1027630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:32.935202 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b2a2c-adba-4ce6-80df-62c0c1027630 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:32.935962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b2a2c-adba-4ce6-80df-62c0c1027630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:32.936522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b2a2c-adba-4ce6-80df-62c0c1027630 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:32.937749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b2a2c-adba-4ce6-80df-62c0c1027630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:32.941461 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b2a2c-adba-4ce6-80df-62c0c1027630 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:32.960185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44ba64-3a2a-4a94-afb8-6d5c772123b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:32.961207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ba64-3a2a-4a94-afb8-6d5c772123b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:32.963918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ba64-3a2a-4a94-afb8-6d5c772123b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:32.963918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44ba64-3a2a-4a94-afb8-6d5c772123b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:32.963918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44ba64-3a2a-4a94-afb8-6d5c772123b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:32.965382 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44ba64-3a2a-4a94-afb8-6d5c772123b1 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:33.137546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 977/1964] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:32 2022] POST /identity/v3/users => generated 303 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:43:33.140265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b2a2c-adba-4ce6-80df-62c0c1027630 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:33.142923 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 988/1965] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:32 2022] POST /identity/v3/users => generated 298 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:43:33.149308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44ba64-3a2a-4a94-afb8-6d5c772123b1 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:33.152955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b2a2c-adba-4ce6-80df-62c0c1027630 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:33.162200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67add1e2-57ff-4fd9-a7bd-266026fe6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:33.163248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67add1e2-57ff-4fd9-a7bd-266026fe6625 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:33.163594 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44ba64-3a2a-4a94-afb8-6d5c772123b1 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:33.164350 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67add1e2-57ff-4fd9-a7bd-266026fe6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:33.164438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67add1e2-57ff-4fd9-a7bd-266026fe6625 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:33.165626 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67add1e2-57ff-4fd9-a7bd-266026fe6625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:33.167070 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67add1e2-57ff-4fd9-a7bd-266026fe6625 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:33.171453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d6fe-e5dd-44f2-ac23-e0c3d55966aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:33.172183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d6fe-e5dd-44f2-ac23-e0c3d55966aa admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:33.172531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d6fe-e5dd-44f2-ac23-e0c3d55966aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:33.172928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1d6fe-e5dd-44f2-ac23-e0c3d55966aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:33.173693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1d6fe-e5dd-44f2-ac23-e0c3d55966aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:33.175400 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1d6fe-e5dd-44f2-ac23-e0c3d55966aa admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:33.184854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 978/1966] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:33.187774 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 989/1967] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:33.191500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67add1e2-57ff-4fd9-a7bd-266026fe6625 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:33.193050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d6fe-e5dd-44f2-ac23-e0c3d55966aa admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:33.204686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1d6fe-e5dd-44f2-ac23-e0c3d55966aa admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:33.211380 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435792b7-8099-468b-8d6a-c31c7719dfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:33.212248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435792b7-8099-468b-8d6a-c31c7719dfbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:33.212544 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435792b7-8099-468b-8d6a-c31c7719dfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:33.212823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435792b7-8099-468b-8d6a-c31c7719dfbb admin admin] PATH_INFO: `/v3/projects/6d96aa6c203a459987667d949f8fdae1/users/cbd6830bea254cf989b58cfc9a034b85/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:33.214753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67add1e2-57ff-4fd9-a7bd-266026fe6625 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:33.223069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ce495-7d99-478b-9e9a-54401a7da1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:33.224340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ce495-7d99-478b-9e9a-54401a7da1ad admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:33.224855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ce495-7d99-478b-9e9a-54401a7da1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:33.225410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ce495-7d99-478b-9e9a-54401a7da1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:33.229160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ce495-7d99-478b-9e9a-54401a7da1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:33.232323 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435792b7-8099-468b-8d6a-c31c7719dfbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d96aa6c203a459987667d949f8fdae1, user_id=cbd6830bea254cf989b58cfc9a034b85, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:33.233116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ce495-7d99-478b-9e9a-54401a7da1ad admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:33.235413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435792b7-8099-468b-8d6a-c31c7719dfbb admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:33.252522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 979/1968] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:43:33.256666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ce495-7d99-478b-9e9a-54401a7da1ad admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:33.268466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ce495-7d99-478b-9e9a-54401a7da1ad admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:33.274643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668749c-5f30-4754-83a1-879e41f5357e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:33.275600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668749c-5f30-4754-83a1-879e41f5357e admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:33.275942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668749c-5f30-4754-83a1-879e41f5357e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:33.276294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668749c-5f30-4754-83a1-879e41f5357e admin admin] PATH_INFO: `/v3/projects/fa0475aacfa3460f92ef56de2b8cd30a/users/d2c5d949dfe04f7888baf55b563efa91/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:33.309072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668749c-5f30-4754-83a1-879e41f5357e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0475aacfa3460f92ef56de2b8cd30a, user_id=d2c5d949dfe04f7888baf55b563efa91, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:33.312703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e668749c-5f30-4754-83a1-879e41f5357e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:33.459664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 980/1969] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:33 2022] PUT /identity/v3/projects/fa0475aacfa3460f92ef56de2b8cd30a/users/d2c5d949dfe04f7888baf55b563efa91/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:43:33.464933 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 990/1970] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:33 2022] PUT /identity/v3/projects/6d96aa6c203a459987667d949f8fdae1/users/cbd6830bea254cf989b58cfc9a034b85/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:33.468939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668749c-5f30-4754-83a1-879e41f5357e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:33.471361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237871a5-9e16-499f-a85b-f11069ca4a4b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:33.471854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237871a5-9e16-499f-a85b-f11069ca4a4b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:33.472246 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237871a5-9e16-499f-a85b-f11069ca4a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:33.508072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-237871a5-9e16-499f-a85b-f11069ca4a4b None None] MFA Rules not processed for user `d2c5d949dfe04f7888baf55b563efa91`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:33.509742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-237871a5-9e16-499f-a85b-f11069ca4a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:33.563052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668749c-5f30-4754-83a1-879e41f5357e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:33.614423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 991/1971] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:33 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:43:33.616063 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237871a5-9e16-499f-a85b-f11069ca4a4b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:33.623224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-237871a5-9e16-499f-a85b-f11069ca4a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:33.713890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1f5f5-35d7-4bb0-b33d-616cff50a6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:33.715140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1f5f5-35d7-4bb0-b33d-616cff50a6fa admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:33.715525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1f5f5-35d7-4bb0-b33d-616cff50a6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:33.715940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1f5f5-35d7-4bb0-b33d-616cff50a6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:33.717093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1f5f5-35d7-4bb0-b33d-616cff50a6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:33.719710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1f5f5-35d7-4bb0-b33d-616cff50a6fa admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:33.739631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 981/1972] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:33.741205 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1f5f5-35d7-4bb0-b33d-616cff50a6fa admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:33.765336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1f5f5-35d7-4bb0-b33d-616cff50a6fa admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:33.795010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93b8f4-f73a-4d2e-b74f-8a51eaf50000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:33.795010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93b8f4-f73a-4d2e-b74f-8a51eaf50000 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:33.795380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93b8f4-f73a-4d2e-b74f-8a51eaf50000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:33.795728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93b8f4-f73a-4d2e-b74f-8a51eaf50000 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:33.796468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93b8f4-f73a-4d2e-b74f-8a51eaf50000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:33.799467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93b8f4-f73a-4d2e-b74f-8a51eaf50000 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:33.802033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237871a5-9e16-499f-a85b-f11069ca4a4b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:33.818157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b348f2-4e4d-49cc-ad5c-5c74f219eb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:33.823891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b348f2-4e4d-49cc-ad5c-5c74f219eb93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:33.824648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b348f2-4e4d-49cc-ad5c-5c74f219eb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:33.825242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b348f2-4e4d-49cc-ad5c-5c74f219eb93 admin admin] PATH_INFO: `/v3/users/f5b72ab6975043bb95b1b03a3d9c9ab0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:33.827548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b348f2-4e4d-49cc-ad5c-5c74f219eb93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b72ab6975043bb95b1b03a3d9c9ab0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:33.829885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b348f2-4e4d-49cc-ad5c-5c74f219eb93 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:34.017350 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 982/1973] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:33 2022] POST /identity/v3/projects => generated 403 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:34.017350 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93b8f4-f73a-4d2e-b74f-8a51eaf50000 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:34.113470 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93b8f4-f73a-4d2e-b74f-8a51eaf50000 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:34.127702 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b45b1-47a7-470b-bacd-91ac7510df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:34.130595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b45b1-47a7-470b-bacd-91ac7510df1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:34.131550 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b45b1-47a7-470b-bacd-91ac7510df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:34.136140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b45b1-47a7-470b-bacd-91ac7510df1e admin admin] PATH_INFO: `/v3/projects/6d96aa6c203a459987667d949f8fdae1/users/cbd6830bea254cf989b58cfc9a034b85/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:34.144211 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b45b1-47a7-470b-bacd-91ac7510df1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d96aa6c203a459987667d949f8fdae1, user_id=cbd6830bea254cf989b58cfc9a034b85, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:34.150574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b45b1-47a7-470b-bacd-91ac7510df1e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:34.171321 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 983/1974] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:34 2022] PUT /identity/v3/projects/6d96aa6c203a459987667d949f8fdae1/users/cbd6830bea254cf989b58cfc9a034b85/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:34.172668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b45b1-47a7-470b-bacd-91ac7510df1e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:34.220528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-31b348f2-4e4d-49cc-ad5c-5c74f219eb93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b72ab6975043bb95b1b03a3d9c9ab0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:34.245207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-31b348f2-4e4d-49cc-ad5c-5c74f219eb93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b72ab6975043bb95b1b03a3d9c9ab0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:34.256679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-31b348f2-4e4d-49cc-ad5c-5c74f219eb93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b72ab6975043bb95b1b03a3d9c9ab0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:34.298047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b45b1-47a7-470b-bacd-91ac7510df1e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:34.304851 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521e3cc-153c-462c-8ad9-6bbe2f13948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:34.305665 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521e3cc-153c-462c-8ad9-6bbe2f13948c admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:34.306013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521e3cc-153c-462c-8ad9-6bbe2f13948c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:34.306357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521e3cc-153c-462c-8ad9-6bbe2f13948c admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:34.307075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521e3cc-153c-462c-8ad9-6bbe2f13948c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:34.310046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521e3cc-153c-462c-8ad9-6bbe2f13948c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:34.374032 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-31b348f2-4e4d-49cc-ad5c-5c74f219eb93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b72ab6975043bb95b1b03a3d9c9ab0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:34.375309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-31b348f2-4e4d-49cc-ad5c-5c74f219eb93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b72ab6975043bb95b1b03a3d9c9ab0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:34.391469 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 992/1975] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:33 2022] DELETE /identity/v3/users/f5b72ab6975043bb95b1b03a3d9c9ab0 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:34.394354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52d3c-e92f-449a-9b8f-957504f40582 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:34.397489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52d3c-e92f-449a-9b8f-957504f40582 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:34.398371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52d3c-e92f-449a-9b8f-957504f40582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:34.445774 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-cfa52d3c-e92f-449a-9b8f-957504f40582 None None] MFA Rules not processed for user `cbd6830bea254cf989b58cfc9a034b85`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:34.447524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-cfa52d3c-e92f-449a-9b8f-957504f40582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:34.562496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 993/1976] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:34.564144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa52d3c-e92f-449a-9b8f-957504f40582 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:34.566446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-cfa52d3c-e92f-449a-9b8f-957504f40582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:34.606775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:34.671230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 984/1977] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:34 2022] POST /identity/v3/users => generated 308 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:34.671646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa52d3c-e92f-449a-9b8f-957504f40582 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:34.679118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:34.681454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cddf6-10fd-4e31-80a2-60340a7caa8c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:34.681454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cddf6-10fd-4e31-80a2-60340a7caa8c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:34.681454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cddf6-10fd-4e31-80a2-60340a7caa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:34.681871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:34.681871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:34.681871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] PATH_INFO: `/v3/users/8cfed5b67bd34f96be5bce8dec45ada6` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:34.683854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cfed5b67bd34f96be5bce8dec45ada6)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:34.690756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:34.747320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-707cddf6-10fd-4e31-80a2-60340a7caa8c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:34.750109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-707cddf6-10fd-4e31-80a2-60340a7caa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:34.765943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 985/1978] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:34.772429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cddf6-10fd-4e31-80a2-60340a7caa8c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:34.772429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-707cddf6-10fd-4e31-80a2-60340a7caa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:34.886140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cddf6-10fd-4e31-80a2-60340a7caa8c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:34.892522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3d1c3-d41e-44fc-81c4-6326e8335969 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:34.893651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3d1c3-d41e-44fc-81c4-6326e8335969 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:34.894150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3d1c3-d41e-44fc-81c4-6326e8335969 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:34.894715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3d1c3-d41e-44fc-81c4-6326e8335969 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:34.928617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3d1c3-d41e-44fc-81c4-6326e8335969 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:34.928617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3d1c3-d41e-44fc-81c4-6326e8335969 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:34.928617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 986/1979] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:34.928617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3d1c3-d41e-44fc-81c4-6326e8335969 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:34.930401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7ad3d1c3-d41e-44fc-81c4-6326e8335969 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:34.946650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3d1c3-d41e-44fc-81c4-6326e8335969 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:34.951686 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96ebc-e2ca-4d08-aa95-6c36fee9c6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:34.952424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96ebc-e2ca-4d08-aa95-6c36fee9c6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:34.952806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96ebc-e2ca-4d08-aa95-6c36fee9c6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:34.953167 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df96ebc-e2ca-4d08-aa95-6c36fee9c6a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:34.954186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df96ebc-e2ca-4d08-aa95-6c36fee9c6a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:34.956112 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df96ebc-e2ca-4d08-aa95-6c36fee9c6a1 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:34.974864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 987/1980] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:34.974864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96ebc-e2ca-4d08-aa95-6c36fee9c6a1 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:34.974864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0df96ebc-e2ca-4d08-aa95-6c36fee9c6a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:35.073049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df96ebc-e2ca-4d08-aa95-6c36fee9c6a1 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:35.077755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63a326-b415-49e4-9ad0-25775bc68d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:35.078071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63a326-b415-49e4-9ad0-25775bc68d5c service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:35.078498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63a326-b415-49e4-9ad0-25775bc68d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:35.078932 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63a326-b415-49e4-9ad0-25775bc68d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:35.089991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63a326-b415-49e4-9ad0-25775bc68d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:35.091572 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63a326-b415-49e4-9ad0-25775bc68d5c service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:35.103210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 988/1981] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:35.104092 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63a326-b415-49e4-9ad0-25775bc68d5c service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:35.116168 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63a326-b415-49e4-9ad0-25775bc68d5c service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:35.124440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9645a3-d8be-4aa4-abfc-e76d0a07b901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:35.125840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9645a3-d8be-4aa4-abfc-e76d0a07b901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:35.126394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9645a3-d8be-4aa4-abfc-e76d0a07b901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:35.126934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9645a3-d8be-4aa4-abfc-e76d0a07b901 admin admin] PATH_INFO: `/v3/projects/b6e704bc8d4d411bafe22609055330c8/users/fc278df46661418c8a1fa4b130f27e93/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:35.153959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9645a3-d8be-4aa4-abfc-e76d0a07b901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e704bc8d4d411bafe22609055330c8, user_id=fc278df46661418c8a1fa4b130f27e93, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:35.159459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9645a3-d8be-4aa4-abfc-e76d0a07b901 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:35.175094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:35.340569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 989/1982] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:35 2022] PUT /identity/v3/projects/b6e704bc8d4d411bafe22609055330c8/users/fc278df46661418c8a1fa4b130f27e93/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:35.341695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803679e8-2400-4de7-9d01-054f6b6347fd None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:35.341987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803679e8-2400-4de7-9d01-054f6b6347fd None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:35.342409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803679e8-2400-4de7-9d01-054f6b6347fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:35.363934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-803679e8-2400-4de7-9d01-054f6b6347fd None None] MFA Rules not processed for user `d5e35757fcf046bdbb34dee53a336a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:35.365310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-803679e8-2400-4de7-9d01-054f6b6347fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:35.366012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cfed5b67bd34f96be5bce8dec45ada6'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:35.389073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cfed5b67bd34f96be5bce8dec45ada6'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:35.399920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cfed5b67bd34f96be5bce8dec45ada6'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:35.431553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 990/1983] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:35.432526 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803679e8-2400-4de7-9d01-054f6b6347fd None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:35.542271 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803679e8-2400-4de7-9d01-054f6b6347fd None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:35.546840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f86dbf-3804-4dec-ba8e-c3f56a0ec135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:35.547564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f86dbf-3804-4dec-ba8e-c3f56a0ec135 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:35.548185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f86dbf-3804-4dec-ba8e-c3f56a0ec135 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:35.548326 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f86dbf-3804-4dec-ba8e-c3f56a0ec135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:35.555235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f2f86dbf-3804-4dec-ba8e-c3f56a0ec135 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:35.594886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cfed5b67bd34f96be5bce8dec45ada6'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:35.596647 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cfed5b67bd34f96be5bce8dec45ada6'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:35.614114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 994/1984] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:34 2022] DELETE /identity/v3/users/8cfed5b67bd34f96be5bce8dec45ada6 => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:35.616052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:35.619146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:35.732047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f86dbf-3804-4dec-ba8e-c3f56a0ec135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:35.735768 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f86dbf-3804-4dec-ba8e-c3f56a0ec135 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:35.765729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 991/1985] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:35.771291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52320d8d-9e22-45c7-bb12-cbd3d4e0a264 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:35.778750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4532a1c-8b4d-40bb-97d1-4b9700130ebf None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:35.781341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4532a1c-8b4d-40bb-97d1-4b9700130ebf None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:35.781341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4532a1c-8b4d-40bb-97d1-4b9700130ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:35.784697 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04185744-758b-47a8-b293-6a98f064709e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:35.786250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04185744-758b-47a8-b293-6a98f064709e admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:35.787571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04185744-758b-47a8-b293-6a98f064709e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:35.790395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04185744-758b-47a8-b293-6a98f064709e admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:35.792144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04185744-758b-47a8-b293-6a98f064709e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:35.796205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04185744-758b-47a8-b293-6a98f064709e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:35.822189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 995/1986] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:35.825686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04185744-758b-47a8-b293-6a98f064709e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:35.859075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-e4532a1c-8b4d-40bb-97d1-4b9700130ebf None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:35.861471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04185744-758b-47a8-b293-6a98f064709e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:35.862780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e4532a1c-8b4d-40bb-97d1-4b9700130ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:35.871480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391a214-5737-4afb-84ec-9cb68c685509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:35.878879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a214-5737-4afb-84ec-9cb68c685509 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:35.878879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a214-5737-4afb-84ec-9cb68c685509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:35.878879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391a214-5737-4afb-84ec-9cb68c685509 admin admin] PATH_INFO: `/v3/projects/b6e704bc8d4d411bafe22609055330c8/users/fc278df46661418c8a1fa4b130f27e93/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:35.878879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391a214-5737-4afb-84ec-9cb68c685509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e704bc8d4d411bafe22609055330c8, user_id=fc278df46661418c8a1fa4b130f27e93, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:35.882929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 992/1987] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:35.887288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391a214-5737-4afb-84ec-9cb68c685509 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:35.901812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4532a1c-8b4d-40bb-97d1-4b9700130ebf None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:35.903358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e4532a1c-8b4d-40bb-97d1-4b9700130ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:35.917426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 996/1988] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:35 2022] PUT /identity/v3/projects/b6e704bc8d4d411bafe22609055330c8/users/fc278df46661418c8a1fa4b130f27e93/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:35.945851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4989d-5982-4c77-a0e5-9f7dd27d431d None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:35.945851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4989d-5982-4c77-a0e5-9f7dd27d431d None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:35.945851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe4989d-5982-4c77-a0e5-9f7dd27d431d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:35.996811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4532a1c-8b4d-40bb-97d1-4b9700130ebf None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:35.998252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-ffe4989d-5982-4c77-a0e5-9f7dd27d431d None None] MFA Rules not processed for user `fc278df46661418c8a1fa4b130f27e93`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:36.000203 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ffe4989d-5982-4c77-a0e5-9f7dd27d431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:36.085078 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1492294-1d5e-482a-bc51-6b57fee0e2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:36.085949 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1492294-1d5e-482a-bc51-6b57fee0e2ef service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:36.086374 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1492294-1d5e-482a-bc51-6b57fee0e2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:36.087250 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1492294-1d5e-482a-bc51-6b57fee0e2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:36.124728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 997/1989] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:35 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:43:36.127002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b900f81-e008-4711-bccd-da2c37d7f680 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:36.127292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b900f81-e008-4711-bccd-da2c37d7f680 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:36.128284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b900f81-e008-4711-bccd-da2c37d7f680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-0b900f81-e008-4711-bccd-da2c37d7f680 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:43:36.141854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:43:36.160863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:43:36.164942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 998/1990] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:43:36 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 01 05:43:36.164942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b900f81-e008-4711-bccd-da2c37d7f680 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:36.164942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0b900f81-e008-4711-bccd-da2c37d7f680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:36.198780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1492294-1d5e-482a-bc51-6b57fee0e2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:36.199513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1492294-1d5e-482a-bc51-6b57fee0e2ef service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:36.218654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 993/1991] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:36.218654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1492294-1d5e-482a-bc51-6b57fee0e2ef service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:36.220559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a1492294-1d5e-482a-bc51-6b57fee0e2ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:36.294949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b900f81-e008-4711-bccd-da2c37d7f680 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:36.301716 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:36.302376 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:36.302662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:36.303111 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] PATH_INFO: `/v3/projects/5bf14c8088c44c80821c3d9cb5640835` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:36.305841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf14c8088c44c80821c3d9cb5640835)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:36.307677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1492294-1d5e-482a-bc51-6b57fee0e2ef service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:36.309224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:36.314381 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6cc6a-f7dd-46af-a1dc-f86f4ed0099a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:36.315959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6cc6a-f7dd-46af-a1dc-f86f4ed0099a service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:36.316512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6cc6a-f7dd-46af-a1dc-f86f4ed0099a service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:36.316990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6cc6a-f7dd-46af-a1dc-f86f4ed0099a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:36.334070 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6cc6a-f7dd-46af-a1dc-f86f4ed0099a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:36.336398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6cc6a-f7dd-46af-a1dc-f86f4ed0099a service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:36.351275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 994/1992] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:36 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:36.571740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf14c8088c44c80821c3d9cb5640835', 'request_id': 'req-faa67668-0e09-460c-be3f-67139c9b14a8'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:36.741405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf14c8088c44c80821c3d9cb5640835', 'request_id': 'req-faa67668-0e09-460c-be3f-67139c9b14a8'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:36.766943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf14c8088c44c80821c3d9cb5640835', 'request_id': 'req-faa67668-0e09-460c-be3f-67139c9b14a8'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:36.803116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] The token cache is being invalidate because project 5bf14c8088c44c80821c3d9cb5640835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:36.803728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:36.805223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:36.808578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 999/1993] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:36 2022] DELETE /identity/v3/projects/5bf14c8088c44c80821c3d9cb5640835 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:36.813498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6cc6a-f7dd-46af-a1dc-f86f4ed0099a service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:36.847533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6cc6a-f7dd-46af-a1dc-f86f4ed0099a service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:36.943108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:36.943948 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:36.944226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:36.944510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] PATH_INFO: `/v3/users/4dbddabda2c64908a4a0508cacd3b5a3` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:36.946826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbddabda2c64908a4a0508cacd3b5a3)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:36.948854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:37.082813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:37.082813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:37.109964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa67668-0e09-460c-be3f-67139c9b14a8 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:37.138798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:37.139870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:37.140327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:37.140773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] PATH_INFO: `/v3/users/d2c5d949dfe04f7888baf55b563efa91` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:37.143277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c5d949dfe04f7888baf55b563efa91)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:37.155216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:37.377990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbddabda2c64908a4a0508cacd3b5a3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:37.418391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbddabda2c64908a4a0508cacd3b5a3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:37.511183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c5d949dfe04f7888baf55b563efa91'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:37.526831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c5d949dfe04f7888baf55b563efa91'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:37.536478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c5d949dfe04f7888baf55b563efa91'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:37.611783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbddabda2c64908a4a0508cacd3b5a3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:37.612740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbddabda2c64908a4a0508cacd3b5a3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:37.613626 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbddabda2c64908a4a0508cacd3b5a3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:37.637604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 995/1994] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:36 2022] DELETE /identity/v3/users/4dbddabda2c64908a4a0508cacd3b5a3 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:37.638777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:37.640394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:37.739847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f5a13-daff-4b7d-b90b-e0a893bc713c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:37.748962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d0984-86d4-4fc6-b5ea-e8702056ef45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:37.749704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d0984-86d4-4fc6-b5ea-e8702056ef45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:37.750051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d0984-86d4-4fc6-b5ea-e8702056ef45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:37.750357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d0984-86d4-4fc6-b5ea-e8702056ef45 admin admin] PATH_INFO: `/v3/projects/e18568cfce7142f2aafb71c709fa2ba2` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:37.751875 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d0984-86d4-4fc6-b5ea-e8702056ef45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18568cfce7142f2aafb71c709fa2ba2)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:37.754064 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d0984-86d4-4fc6-b5ea-e8702056ef45 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:37.766276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c5d949dfe04f7888baf55b563efa91'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:37.783417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c5d949dfe04f7888baf55b563efa91'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:37.784898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1000/1995] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:37 2022] DELETE /identity/v3/users/d2c5d949dfe04f7888baf55b563efa91 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:43:37.787452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:37.796824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:37.930975 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399d053-35b6-46ae-8f15-d69bede6fef3 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:37.936295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:37.936976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:37.937252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:37.937787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] PATH_INFO: `/v3/users/e7b8091ed488491e888dfec5878a49f3` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:37.939044 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7b8091ed488491e888dfec5878a49f3)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:37.941240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:37.978589 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-970d0984-86d4-4fc6-b5ea-e8702056ef45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18568cfce7142f2aafb71c709fa2ba2', 'request_id': 'req-970d0984-86d4-4fc6-b5ea-e8702056ef45'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:37.990006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-970d0984-86d4-4fc6-b5ea-e8702056ef45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18568cfce7142f2aafb71c709fa2ba2', 'request_id': 'req-970d0984-86d4-4fc6-b5ea-e8702056ef45'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:38.193276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-970d0984-86d4-4fc6-b5ea-e8702056ef45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18568cfce7142f2aafb71c709fa2ba2', 'request_id': 'req-970d0984-86d4-4fc6-b5ea-e8702056ef45'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:38.218321 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-970d0984-86d4-4fc6-b5ea-e8702056ef45 admin admin] The token cache is being invalidate because project e18568cfce7142f2aafb71c709fa2ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:38.219044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-970d0984-86d4-4fc6-b5ea-e8702056ef45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:38.219573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-970d0984-86d4-4fc6-b5ea-e8702056ef45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:38.221209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 996/1996] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:37 2022] DELETE /identity/v3/projects/e18568cfce7142f2aafb71c709fa2ba2 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:38.222700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b416a-ba1d-4076-b988-8cca2b0126a8 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:38.223426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b416a-ba1d-4076-b988-8cca2b0126a8 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:38.223707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b416a-ba1d-4076-b988-8cca2b0126a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:38.249199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-606b416a-ba1d-4076-b988-8cca2b0126a8 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:38.250619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-606b416a-ba1d-4076-b988-8cca2b0126a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:38.320894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 997/1997] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:38.322181 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b416a-ba1d-4076-b988-8cca2b0126a8 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:38.323688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-606b416a-ba1d-4076-b988-8cca2b0126a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:38.337759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b416a-ba1d-4076-b988-8cca2b0126a8 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:38.342850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:38.343472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:38.343786 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:38.344066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] PATH_INFO: `/v3/users/d54597b751bd478c8c1ba9bfe9dc20fa` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:38.345336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54597b751bd478c8c1ba9bfe9dc20fa)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:38.347331 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:38.437711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7b8091ed488491e888dfec5878a49f3'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:38.471728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7b8091ed488491e888dfec5878a49f3'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:38.483477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7b8091ed488491e888dfec5878a49f3'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:38.686016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7b8091ed488491e888dfec5878a49f3'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:38.686830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7b8091ed488491e888dfec5878a49f3'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:38.698676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1001/1998] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:37 2022] DELETE /identity/v3/users/e7b8091ed488491e888dfec5878a49f3 => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:38.700207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:38.702425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:38.765672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54597b751bd478c8c1ba9bfe9dc20fa'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:38.780772 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54597b751bd478c8c1ba9bfe9dc20fa'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:38.801296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41487cb-6cb5-4305-ab59-1e4b5341790e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:38.813773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543a64f-745a-48fa-b0e1-da7bf2e04dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:38.814705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543a64f-745a-48fa-b0e1-da7bf2e04dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:38.815032 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543a64f-745a-48fa-b0e1-da7bf2e04dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:38.815452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543a64f-745a-48fa-b0e1-da7bf2e04dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:38.818518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6543a64f-745a-48fa-b0e1-da7bf2e04dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:38.939992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543a64f-745a-48fa-b0e1-da7bf2e04dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:38.942681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543a64f-745a-48fa-b0e1-da7bf2e04dc7 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:38.961272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1002/1999] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:38.962742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543a64f-745a-48fa-b0e1-da7bf2e04dc7 service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:38.964980 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6543a64f-745a-48fa-b0e1-da7bf2e04dc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:38.986568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543a64f-745a-48fa-b0e1-da7bf2e04dc7 service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:38.994617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f76af-b518-4e69-a908-ba6aff7bc821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:38.995610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f76af-b518-4e69-a908-ba6aff7bc821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:38.996067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f76af-b518-4e69-a908-ba6aff7bc821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:38.997489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f76af-b518-4e69-a908-ba6aff7bc821 admin admin] PATH_INFO: `/v3/projects/9c4ba483e8244845bf8e5a13a7795969` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:38.998783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f76af-b518-4e69-a908-ba6aff7bc821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4ba483e8244845bf8e5a13a7795969)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:39.000856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f76af-b518-4e69-a908-ba6aff7bc821 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:39.005275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54597b751bd478c8c1ba9bfe9dc20fa'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.005982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54597b751bd478c8c1ba9bfe9dc20fa'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.006744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54597b751bd478c8c1ba9bfe9dc20fa'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.034424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 998/2000] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:38 2022] DELETE /identity/v3/users/d54597b751bd478c8c1ba9bfe9dc20fa => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:39.035563 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:39.037770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:39.160258 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3392ed71-0d00-48b6-be1c-0ad55883d0ae admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:39.170472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed0518-135c-44e7-bc95-ba6ef0b0fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:39.171610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0518-135c-44e7-bc95-ba6ef0b0fd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:39.172118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0518-135c-44e7-bc95-ba6ef0b0fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:39.172601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0518-135c-44e7-bc95-ba6ef0b0fd71 admin admin] PATH_INFO: `/v3/users/e349427373054c7f872fdee48129473b` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:39.176466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed0518-135c-44e7-bc95-ba6ef0b0fd71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e349427373054c7f872fdee48129473b)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:39.179595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed0518-135c-44e7-bc95-ba6ef0b0fd71 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:39.228014 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-bc0f76af-b518-4e69-a908-ba6aff7bc821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4ba483e8244845bf8e5a13a7795969', 'request_id': 'req-bc0f76af-b518-4e69-a908-ba6aff7bc821'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.337105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-bc0f76af-b518-4e69-a908-ba6aff7bc821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4ba483e8244845bf8e5a13a7795969', 'request_id': 'req-bc0f76af-b518-4e69-a908-ba6aff7bc821'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.356412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-bc0f76af-b518-4e69-a908-ba6aff7bc821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4ba483e8244845bf8e5a13a7795969', 'request_id': 'req-bc0f76af-b518-4e69-a908-ba6aff7bc821'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.370969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-bc0f76af-b518-4e69-a908-ba6aff7bc821 admin admin] The token cache is being invalidate because project 9c4ba483e8244845bf8e5a13a7795969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:39.371267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-bc0f76af-b518-4e69-a908-ba6aff7bc821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.372020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-bc0f76af-b518-4e69-a908-ba6aff7bc821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.373733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1003/2001] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:38 2022] DELETE /identity/v3/projects/9c4ba483e8244845bf8e5a13a7795969 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:39.375089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98080ff-8ab9-4764-bdd7-8e5b3bf71a0b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:39.375371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98080ff-8ab9-4764-bdd7-8e5b3bf71a0b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:39.375656 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98080ff-8ab9-4764-bdd7-8e5b3bf71a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:39.398658 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-b98080ff-8ab9-4764-bdd7-8e5b3bf71a0b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:39.400913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b98080ff-8ab9-4764-bdd7-8e5b3bf71a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:39.520509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1004/2002] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:39.524377 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098fdec-d056-4f73-bb02-0e0379e38b12 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:39.525320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098fdec-d056-4f73-bb02-0e0379e38b12 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:39.526060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098fdec-d056-4f73-bb02-0e0379e38b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:39.545934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8bed0518-135c-44e7-bc95-ba6ef0b0fd71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e349427373054c7f872fdee48129473b'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.571376 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8bed0518-135c-44e7-bc95-ba6ef0b0fd71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e349427373054c7f872fdee48129473b'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.576878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-b098fdec-d056-4f73-bb02-0e0379e38b12 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:39.579480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b098fdec-d056-4f73-bb02-0e0379e38b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:39.604315 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1005/2003] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:39.607265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098fdec-d056-4f73-bb02-0e0379e38b12 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:39.617624 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b098fdec-d056-4f73-bb02-0e0379e38b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:39.725868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8bed0518-135c-44e7-bc95-ba6ef0b0fd71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e349427373054c7f872fdee48129473b'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.727333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8bed0518-135c-44e7-bc95-ba6ef0b0fd71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e349427373054c7f872fdee48129473b'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.727941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098fdec-d056-4f73-bb02-0e0379e38b12 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:39.728144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8bed0518-135c-44e7-bc95-ba6ef0b0fd71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e349427373054c7f872fdee48129473b'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:39.734276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351548a-ca5e-4c6e-bbff-d7676ebbebeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:39.736015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351548a-ca5e-4c6e-bbff-d7676ebbebeb service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:39.736614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351548a-ca5e-4c6e-bbff-d7676ebbebeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:39.737583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351548a-ca5e-4c6e-bbff-d7676ebbebeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:39.740978 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0351548a-ca5e-4c6e-bbff-d7676ebbebeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:39.765125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351548a-ca5e-4c6e-bbff-d7676ebbebeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:39.767993 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351548a-ca5e-4c6e-bbff-d7676ebbebeb service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:39.770327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 999/2004] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:39 2022] DELETE /identity/v3/users/e349427373054c7f872fdee48129473b => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:39.774535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce043-4c09-4580-a0c1-67aae9677477 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:39.774535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce043-4c09-4580-a0c1-67aae9677477 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:39.774535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ce043-4c09-4580-a0c1-67aae9677477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:39.797880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1006/2005] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:39.799760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a641-4b73-4fb2-be79-0b5ddbf3c102 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:39.800190 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a641-4b73-4fb2-be79-0b5ddbf3c102 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:39.800664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991a641-4b73-4fb2-be79-0b5ddbf3c102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:39.803766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a95ce043-4c09-4580-a0c1-67aae9677477 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:39.805341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a95ce043-4c09-4580-a0c1-67aae9677477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:39.849437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c991a641-4b73-4fb2-be79-0b5ddbf3c102 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:39.852875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c991a641-4b73-4fb2-be79-0b5ddbf3c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:39.940970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1000/2006] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:39.942427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ce043-4c09-4580-a0c1-67aae9677477 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:39.945922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a95ce043-4c09-4580-a0c1-67aae9677477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:39.962078 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ce043-4c09-4580-a0c1-67aae9677477 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:39.969195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:39.970155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:39.970453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:39.970907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] PATH_INFO: `/v3/projects/fa0475aacfa3460f92ef56de2b8cd30a` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:39.972590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0475aacfa3460f92ef56de2b8cd30a)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:39.977561 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:40.024247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:40.085355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1007/2007] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:40.087053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a641-4b73-4fb2-be79-0b5ddbf3c102 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:40.089404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c991a641-4b73-4fb2-be79-0b5ddbf3c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:40.112596 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991a641-4b73-4fb2-be79-0b5ddbf3c102 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:40.120898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:40.121816 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:40.122150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:40.122438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] PATH_INFO: `/v3/projects/969f0b93b19e4062bd1e46e57bf91c23` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:40.124241 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=969f0b93b19e4062bd1e46e57bf91c23)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:40.128311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:40.225391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0475aacfa3460f92ef56de2b8cd30a', 'request_id': 'req-44b89bbc-9b57-4a24-8def-35a98fae294a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:40.236563 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0475aacfa3460f92ef56de2b8cd30a', 'request_id': 'req-44b89bbc-9b57-4a24-8def-35a98fae294a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:40.415573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969f0b93b19e4062bd1e46e57bf91c23', 'request_id': 'req-3e841473-554a-4357-a955-deae9e22c441'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:40.444103 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0475aacfa3460f92ef56de2b8cd30a', 'request_id': 'req-44b89bbc-9b57-4a24-8def-35a98fae294a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:40.445265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:40.458970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] The token cache is being invalidate because project fa0475aacfa3460f92ef56de2b8cd30a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:40.459485 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:40.460140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:40.463072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1001/2008] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:39 2022] DELETE /identity/v3/projects/fa0475aacfa3460f92ef56de2b8cd30a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:40.463454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:40.464771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:40.548244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b89bbc-9b57-4a24-8def-35a98fae294a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:40.611746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04923fea-8907-492c-b86a-c16ec359e235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:40.612364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04923fea-8907-492c-b86a-c16ec359e235 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:40.612673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04923fea-8907-492c-b86a-c16ec359e235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:40.612914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04923fea-8907-492c-b86a-c16ec359e235 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:40.613676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04923fea-8907-492c-b86a-c16ec359e235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:40.613982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04923fea-8907-492c-b86a-c16ec359e235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:40.615704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04923fea-8907-492c-b86a-c16ec359e235 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:40.637268 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1002/2009] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:40.637268 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04923fea-8907-492c-b86a-c16ec359e235 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:40.637268 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-04923fea-8907-492c-b86a-c16ec359e235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:40.697271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969f0b93b19e4062bd1e46e57bf91c23', 'request_id': 'req-3e841473-554a-4357-a955-deae9e22c441'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:40.704921 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04923fea-8907-492c-b86a-c16ec359e235 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:40.705156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969f0b93b19e4062bd1e46e57bf91c23', 'request_id': 'req-3e841473-554a-4357-a955-deae9e22c441'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:40.709201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd27b-9d71-47c0-8a0f-c9bfb410381a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:40.709998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd27b-9d71-47c0-8a0f-c9bfb410381a service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:40.710387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd27b-9d71-47c0-8a0f-c9bfb410381a service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:40.714044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd27b-9d71-47c0-8a0f-c9bfb410381a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:40.716197 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0f0cd27b-9d71-47c0-8a0f-c9bfb410381a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:40.733727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cd27b-9d71-47c0-8a0f-c9bfb410381a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:40.737056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cd27b-9d71-47c0-8a0f-c9bfb410381a service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:40.741148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] The token cache is being invalidate because project 969f0b93b19e4062bd1e46e57bf91c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:40.741674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:40.743081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:40.749105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1008/2010] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:40 2022] DELETE /identity/v3/projects/969f0b93b19e4062bd1e46e57bf91c23 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:40.749105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:40.755784 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:40.761414 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1003/2011] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:40.763126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd27b-9d71-47c0-8a0f-c9bfb410381a service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:40.780045 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd27b-9d71-47c0-8a0f-c9bfb410381a service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:40.791190 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2439029-5ae7-4484-a60e-f6755fefa2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:40.792667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2439029-5ae7-4484-a60e-f6755fefa2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:40.793202 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2439029-5ae7-4484-a60e-f6755fefa2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:40.793759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2439029-5ae7-4484-a60e-f6755fefa2d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:40.794752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2439029-5ae7-4484-a60e-f6755fefa2d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:40.798577 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2439029-5ae7-4484-a60e-f6755fefa2d2 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:40.815336 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e841473-554a-4357-a955-deae9e22c441 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:40.832949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbe10b-fa2a-4889-8953-f28fb8191c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:40.833710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbe10b-fa2a-4889-8953-f28fb8191c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:40.834000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbe10b-fa2a-4889-8953-f28fb8191c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:40.834282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbe10b-fa2a-4889-8953-f28fb8191c50 admin admin] PATH_INFO: `/v3/users/fc278df46661418c8a1fa4b130f27e93` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:40.835722 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbe10b-fa2a-4889-8953-f28fb8191c50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc278df46661418c8a1fa4b130f27e93)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:40.838321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbe10b-fa2a-4889-8953-f28fb8191c50 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:40.975341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1004/2012] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:40 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:40.975341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2439029-5ae7-4484-a60e-f6755fefa2d2 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:40.979485 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e2439029-5ae7-4484-a60e-f6755fefa2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:41.069400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2439029-5ae7-4484-a60e-f6755fefa2d2 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:41.077972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2510be3-f4ad-4370-b6dd-582eb41673be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:41.078782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2510be3-f4ad-4370-b6dd-582eb41673be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:41.079075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2510be3-f4ad-4370-b6dd-582eb41673be admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:41.079364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2510be3-f4ad-4370-b6dd-582eb41673be admin admin] PATH_INFO: `/v3/projects/b2c50a17a125477ea3ee7c6d6e81d62f` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:41.081593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2510be3-f4ad-4370-b6dd-582eb41673be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c50a17a125477ea3ee7c6d6e81d62f)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:41.084773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2510be3-f4ad-4370-b6dd-582eb41673be admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:41.746004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-23cbe10b-fa2a-4889-8953-f28fb8191c50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc278df46661418c8a1fa4b130f27e93'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:41.762249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-23cbe10b-fa2a-4889-8953-f28fb8191c50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc278df46661418c8a1fa4b130f27e93'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:41.770775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-23cbe10b-fa2a-4889-8953-f28fb8191c50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc278df46661418c8a1fa4b130f27e93'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:41.775563 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b2510be3-f4ad-4370-b6dd-582eb41673be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c50a17a125477ea3ee7c6d6e81d62f', 'request_id': 'req-b2510be3-f4ad-4370-b6dd-582eb41673be'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:41.783702 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b2510be3-f4ad-4370-b6dd-582eb41673be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c50a17a125477ea3ee7c6d6e81d62f', 'request_id': 'req-b2510be3-f4ad-4370-b6dd-582eb41673be'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:41.881884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-23cbe10b-fa2a-4889-8953-f28fb8191c50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc278df46661418c8a1fa4b130f27e93'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:41.883476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-23cbe10b-fa2a-4889-8953-f28fb8191c50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc278df46661418c8a1fa4b130f27e93'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:41.899385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1009/2013] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:40 2022] DELETE /identity/v3/users/fc278df46661418c8a1fa4b130f27e93 => generated 0 bytes in 1150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:41.899385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d85145-e0a4-4d44-bbfe-4798b7e60731 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:41.899385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d85145-e0a4-4d44-bbfe-4798b7e60731 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:41.899385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d85145-e0a4-4d44-bbfe-4798b7e60731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:41.944299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c6d85145-e0a4-4d44-bbfe-4798b7e60731 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:41.945952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c6d85145-e0a4-4d44-bbfe-4798b7e60731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:42.041785 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1010/2014] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:42.042671 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d85145-e0a4-4d44-bbfe-4798b7e60731 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:42.044337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c6d85145-e0a4-4d44-bbfe-4798b7e60731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:42.057443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b2510be3-f4ad-4370-b6dd-582eb41673be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c50a17a125477ea3ee7c6d6e81d62f', 'request_id': 'req-b2510be3-f4ad-4370-b6dd-582eb41673be'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:42.057898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d85145-e0a4-4d44-bbfe-4798b7e60731 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:42.063037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57194ba-68bb-48ab-a596-bb65a21aa12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:42.063691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57194ba-68bb-48ab-a596-bb65a21aa12c admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:42.063987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57194ba-68bb-48ab-a596-bb65a21aa12c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:42.064261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57194ba-68bb-48ab-a596-bb65a21aa12c admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:42.064912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57194ba-68bb-48ab-a596-bb65a21aa12c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:42.067060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57194ba-68bb-48ab-a596-bb65a21aa12c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:42.073592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b2510be3-f4ad-4370-b6dd-582eb41673be admin admin] The token cache is being invalidate because project b2c50a17a125477ea3ee7c6d6e81d62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:42.073592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b2510be3-f4ad-4370-b6dd-582eb41673be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:42.073592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b2510be3-f4ad-4370-b6dd-582eb41673be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:42.078016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1005/2015] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:40 2022] DELETE /identity/v3/projects/b2c50a17a125477ea3ee7c6d6e81d62f => generated 0 bytes in 1098 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:42.078016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63004e0-f23c-4b6d-b7b6-f7444360db77 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:42.078016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63004e0-f23c-4b6d-b7b6-f7444360db77 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:42.078016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63004e0-f23c-4b6d-b7b6-f7444360db77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:42.110336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-e63004e0-f23c-4b6d-b7b6-f7444360db77 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:42.112132 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e63004e0-f23c-4b6d-b7b6-f7444360db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:42.132967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1006/2016] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:42.132967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63004e0-f23c-4b6d-b7b6-f7444360db77 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:42.132967 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e63004e0-f23c-4b6d-b7b6-f7444360db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:42.176484 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63004e0-f23c-4b6d-b7b6-f7444360db77 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:42.187026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:42.187990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:42.188486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:42.188866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] PATH_INFO: `/v3/users/cbd6830bea254cf989b58cfc9a034b85` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:42.194020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbd6830bea254cf989b58cfc9a034b85)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:42.194742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:42.311045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1011/2017] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:42 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:42.314776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57194ba-68bb-48ab-a596-bb65a21aa12c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:42.324520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57194ba-68bb-48ab-a596-bb65a21aa12c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:42.329831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0febf7-8d4a-45ed-a1d0-e9b81fcdca5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:42.330471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0febf7-8d4a-45ed-a1d0-e9b81fcdca5c admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:42.330757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0febf7-8d4a-45ed-a1d0-e9b81fcdca5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:42.331050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0febf7-8d4a-45ed-a1d0-e9b81fcdca5c admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:42.331728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0febf7-8d4a-45ed-a1d0-e9b81fcdca5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:42.332042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0febf7-8d4a-45ed-a1d0-e9b81fcdca5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:42.333806 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0febf7-8d4a-45ed-a1d0-e9b81fcdca5c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:42.349953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1012/2018] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:42.350886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0febf7-8d4a-45ed-a1d0-e9b81fcdca5c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:42.359835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7d0febf7-8d4a-45ed-a1d0-e9b81fcdca5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:42.381210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0febf7-8d4a-45ed-a1d0-e9b81fcdca5c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:42.386152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:42.386908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:42.387192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:42.387474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] PATH_INFO: `/v3/projects/4a761955aa144c94be98a565c938ba86` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:42.388761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a761955aa144c94be98a565c938ba86)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:42.390775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:42.715082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbd6830bea254cf989b58cfc9a034b85'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:42.722105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a761955aa144c94be98a565c938ba86', 'request_id': 'req-67a91b64-83a5-4231-96ac-7dff4483158c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:42.724861 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbd6830bea254cf989b58cfc9a034b85'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:42.903200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbd6830bea254cf989b58cfc9a034b85'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:42.903999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbd6830bea254cf989b58cfc9a034b85'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:42.904757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbd6830bea254cf989b58cfc9a034b85'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:42.942340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1007/2019] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:42 2022] DELETE /identity/v3/users/cbd6830bea254cf989b58cfc9a034b85 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:42.943276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:42.946074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:43.047444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c17a5a-d978-420b-9860-768c0114e4db admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:43.052227 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd085a-0bdb-4ca0-94c7-370c3d3e7cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:43.052862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd085a-0bdb-4ca0-94c7-370c3d3e7cab admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:43.053146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd085a-0bdb-4ca0-94c7-370c3d3e7cab admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:43.053450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd085a-0bdb-4ca0-94c7-370c3d3e7cab admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:43.055046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd085a-0bdb-4ca0-94c7-370c3d3e7cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:43.056937 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd085a-0bdb-4ca0-94c7-370c3d3e7cab admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:43.073760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1008/2020] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:43.073760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd085a-0bdb-4ca0-94c7-370c3d3e7cab admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:43.073760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8dfd085a-0bdb-4ca0-94c7-370c3d3e7cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:43.086233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd085a-0bdb-4ca0-94c7-370c3d3e7cab admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:43.091187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0f405-33ac-41ee-a25d-45237e0fe8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:43.091818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0f405-33ac-41ee-a25d-45237e0fe8ef admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:43.092100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0f405-33ac-41ee-a25d-45237e0fe8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:43.092375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0f405-33ac-41ee-a25d-45237e0fe8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:43.093023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0f405-33ac-41ee-a25d-45237e0fe8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:43.094985 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0f405-33ac-41ee-a25d-45237e0fe8ef admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:43.128565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a761955aa144c94be98a565c938ba86', 'request_id': 'req-67a91b64-83a5-4231-96ac-7dff4483158c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:43.138062 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a761955aa144c94be98a565c938ba86', 'request_id': 'req-67a91b64-83a5-4231-96ac-7dff4483158c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:43.152274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] The token cache is being invalidate because project 4a761955aa144c94be98a565c938ba86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:43.152776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:43.153591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:43.155511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1013/2021] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:42 2022] DELETE /identity/v3/projects/4a761955aa144c94be98a565c938ba86 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:43.156062 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:43.159302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:43.234792 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a91b64-83a5-4231-96ac-7dff4483158c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:43.235888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:43.236537 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:43.236818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:43.237091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] PATH_INFO: `/v3/projects/b6e704bc8d4d411bafe22609055330c8` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:43.238322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e704bc8d4d411bafe22609055330c8)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:43.240305 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:43.280213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1009/2022] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:43 2022] POST /identity/v3/projects => generated 367 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:43.287671 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3110f8-e334-4d5c-964d-1b8cddd6f5c2 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:43.287671 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3110f8-e334-4d5c-964d-1b8cddd6f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:43.287671 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3110f8-e334-4d5c-964d-1b8cddd6f5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:43.301691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-dc3110f8-e334-4d5c-964d-1b8cddd6f5c2 None None] MFA Rules not processed for user `d5e35757fcf046bdbb34dee53a336a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:43.302941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-dc3110f8-e334-4d5c-964d-1b8cddd6f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:43.370898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1010/2023] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:43.378327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3110f8-e334-4d5c-964d-1b8cddd6f5c2 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:43.378327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-dc3110f8-e334-4d5c-964d-1b8cddd6f5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:43.438077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e704bc8d4d411bafe22609055330c8', 'request_id': 'req-9551c3f5-135e-42f6-8842-3d8b299dda3c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:43.457641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3110f8-e334-4d5c-964d-1b8cddd6f5c2 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:43.558283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203d9d6-094f-42dd-ad5a-f4e22e21c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:43.568548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d9d6-094f-42dd-ad5a-f4e22e21c615 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:43.568548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d9d6-094f-42dd-ad5a-f4e22e21c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:43.568548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d9d6-094f-42dd-ad5a-f4e22e21c615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:43.568548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203d9d6-094f-42dd-ad5a-f4e22e21c615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:43.568548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203d9d6-094f-42dd-ad5a-f4e22e21c615 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:43.577089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1011/2024] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:43.578334 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203d9d6-094f-42dd-ad5a-f4e22e21c615 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:43.581191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b203d9d6-094f-42dd-ad5a-f4e22e21c615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:43.598830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e704bc8d4d411bafe22609055330c8', 'request_id': 'req-9551c3f5-135e-42f6-8842-3d8b299dda3c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:43.602471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203d9d6-094f-42dd-ad5a-f4e22e21c615 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:43.618335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e704bc8d4d411bafe22609055330c8', 'request_id': 'req-9551c3f5-135e-42f6-8842-3d8b299dda3c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:43.618856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:43.618856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:43.618856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:43.618856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] PATH_INFO: `/v3/users/e1372ed02b5c4a1088a4383e2d194faa` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:43.619427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1372ed02b5c4a1088a4383e2d194faa)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:43.625030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:43.662719 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] The token cache is being invalidate because project b6e704bc8d4d411bafe22609055330c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:43.663203 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:43.665281 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:43.670860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1014/2025] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:43 2022] DELETE /identity/v3/projects/b6e704bc8d4d411bafe22609055330c8 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:43.672391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:43.674798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:43.700003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551c3f5-135e-42f6-8842-3d8b299dda3c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:43.708159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36226574-350e-4a57-b886-d21ad500ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:43.709286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36226574-350e-4a57-b886-d21ad500ede4 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:43.709869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36226574-350e-4a57-b886-d21ad500ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:43.710530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36226574-350e-4a57-b886-d21ad500ede4 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:43.711592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36226574-350e-4a57-b886-d21ad500ede4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:43.715562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36226574-350e-4a57-b886-d21ad500ede4 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:43.884599 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:43.935593 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1015/2026] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:43 2022] POST /identity/v3/users => generated 284 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:43.950166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1372ed02b5c4a1088a4383e2d194faa'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:43.959917 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1372ed02b5c4a1088a4383e2d194faa'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:43.960095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36226574-350e-4a57-b886-d21ad500ede4 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:43.967372 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-36226574-350e-4a57-b886-d21ad500ede4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:43.991916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36226574-350e-4a57-b886-d21ad500ede4 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:44.002700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae21757-8548-4775-aca1-9fec2a2fe4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:44.002700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae21757-8548-4775-aca1-9fec2a2fe4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:44.002700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae21757-8548-4775-aca1-9fec2a2fe4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:44.002700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae21757-8548-4775-aca1-9fec2a2fe4ae admin admin] PATH_INFO: `/v3/projects/ecf8dac03eb54416a4fe67dd64e0d469/users/fe8c793e5f764238957aa2e6b66ba988/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:44.027830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae21757-8548-4775-aca1-9fec2a2fe4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf8dac03eb54416a4fe67dd64e0d469, user_id=fe8c793e5f764238957aa2e6b66ba988, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:44.031785 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae21757-8548-4775-aca1-9fec2a2fe4ae admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:44.132645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1372ed02b5c4a1088a4383e2d194faa'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:44.133306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1372ed02b5c4a1088a4383e2d194faa'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:44.134047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1372ed02b5c4a1088a4383e2d194faa'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:44.156299 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1012/2027] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:43 2022] DELETE /identity/v3/users/e1372ed02b5c4a1088a4383e2d194faa => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:44.157581 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:44.159010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:44.254561 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5573cd2-eac3-4999-9f66-d74c20e86fee admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:44.261084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1016/2028] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:43 2022] PUT /identity/v3/projects/ecf8dac03eb54416a4fe67dd64e0d469/users/fe8c793e5f764238957aa2e6b66ba988/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:44.265472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57d79c-59d0-40f3-9eef-eeb8bf98e181 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:44.266550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57d79c-59d0-40f3-9eef-eeb8bf98e181 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:44.267470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57d79c-59d0-40f3-9eef-eeb8bf98e181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:44.308818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5d57d79c-59d0-40f3-9eef-eeb8bf98e181 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:44.311143 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5d57d79c-59d0-40f3-9eef-eeb8bf98e181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:44.374435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557fa39-35ee-4744-aba6-fac28dbc9d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:44.375133 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557fa39-35ee-4744-aba6-fac28dbc9d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:44.375649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557fa39-35ee-4744-aba6-fac28dbc9d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:44.376146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557fa39-35ee-4744-aba6-fac28dbc9d06 admin admin] PATH_INFO: `/v3/projects/6d96aa6c203a459987667d949f8fdae1` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:44.377989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557fa39-35ee-4744-aba6-fac28dbc9d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d96aa6c203a459987667d949f8fdae1)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:44.381518 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557fa39-35ee-4744-aba6-fac28dbc9d06 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:44.405551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1017/2029] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:44.408505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86955-3a1b-4f17-9f31-4756c3a19769 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:44.410384 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86955-3a1b-4f17-9f31-4756c3a19769 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:44.410384 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c86955-3a1b-4f17-9f31-4756c3a19769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-a8c86955-3a1b-4f17-9f31-4756c3a19769 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:43:44.423187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:43:44.424266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:43:44.425601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1018/2030] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:43:44 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 19 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 01 05:43:44.427242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c86955-3a1b-4f17-9f31-4756c3a19769 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:44.439963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a8c86955-3a1b-4f17-9f31-4756c3a19769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:44.457891 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c86955-3a1b-4f17-9f31-4756c3a19769 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:44.463020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87baf3-3860-4d78-ad02-1559fdb218c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:44.463637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87baf3-3860-4d78-ad02-1559fdb218c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:44.463990 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87baf3-3860-4d78-ad02-1559fdb218c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:44.464324 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87baf3-3860-4d78-ad02-1559fdb218c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:44.464984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87baf3-3860-4d78-ad02-1559fdb218c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:44.466694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87baf3-3860-4d78-ad02-1559fdb218c5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:44.478871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1019/2031] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:44.479964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87baf3-3860-4d78-ad02-1559fdb218c5 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:44.481729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8a87baf3-3860-4d78-ad02-1559fdb218c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:44.495714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87baf3-3860-4d78-ad02-1559fdb218c5 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:44.500776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:44.501449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:44.501731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:44.502003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] PATH_INFO: `/v3/users/d2f00a61084c4e73bfc9532c99379708` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:44.503167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f00a61084c4e73bfc9532c99379708)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:44.505104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:44.636278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:44.641497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b557fa39-35ee-4744-aba6-fac28dbc9d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d96aa6c203a459987667d949f8fdae1', 'request_id': 'req-b557fa39-35ee-4744-aba6-fac28dbc9d06'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:44.666752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b557fa39-35ee-4744-aba6-fac28dbc9d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d96aa6c203a459987667d949f8fdae1', 'request_id': 'req-b557fa39-35ee-4744-aba6-fac28dbc9d06'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:44.880061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b557fa39-35ee-4744-aba6-fac28dbc9d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d96aa6c203a459987667d949f8fdae1', 'request_id': 'req-b557fa39-35ee-4744-aba6-fac28dbc9d06'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:44.899657 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b557fa39-35ee-4744-aba6-fac28dbc9d06 admin admin] The token cache is being invalidate because project 6d96aa6c203a459987667d949f8fdae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:44.899963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b557fa39-35ee-4744-aba6-fac28dbc9d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:44.900672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b557fa39-35ee-4744-aba6-fac28dbc9d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:44.902407 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1013/2032] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:44 2022] DELETE /identity/v3/projects/6d96aa6c203a459987667d949f8fdae1 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:44.903669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370f094-850e-4b05-bc7b-52ae320f87b7 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:44.903957 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370f094-850e-4b05-bc7b-52ae320f87b7 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:44.904212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370f094-850e-4b05-bc7b-52ae320f87b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:44.906527 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f00a61084c4e73bfc9532c99379708'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:44.926256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f00a61084c4e73bfc9532c99379708'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:44.937843 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f00a61084c4e73bfc9532c99379708'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:44.956197 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-d370f094-850e-4b05-bc7b-52ae320f87b7 None None] MFA Rules not processed for user `fe8c793e5f764238957aa2e6b66ba988`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:44.958155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d370f094-850e-4b05-bc7b-52ae320f87b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:45.063810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1014/2033] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:45.063810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6baec-c5cf-4462-abe0-885af97d0b47 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:45.063810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6baec-c5cf-4462-abe0-885af97d0b47 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:45.063810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6baec-c5cf-4462-abe0-885af97d0b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:45.087070 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-c6d6baec-c5cf-4462-abe0-885af97d0b47 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:45.088520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c6d6baec-c5cf-4462-abe0-885af97d0b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:45.091549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f00a61084c4e73bfc9532c99379708'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:45.092303 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f00a61084c4e73bfc9532c99379708'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:45.102568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1020/2034] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:44 2022] DELETE /identity/v3/users/d2f00a61084c4e73bfc9532c99379708 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:45.106979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:45.111300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:45.221423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1015/2035] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:45.222760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45fa3f-f082-48b4-a4db-82127e3aac4b None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:45.223319 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45fa3f-f082-48b4-a4db-82127e3aac4b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:45.223594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45fa3f-f082-48b4-a4db-82127e3aac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:45.231502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ddf66-a866-4466-aec1-71b2d7e1fcc6 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:45.239696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1438a0-91d4-4436-9970-ec5f848f5156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:45.240541 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1438a0-91d4-4436-9970-ec5f848f5156 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:45.241008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1438a0-91d4-4436-9970-ec5f848f5156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:45.242124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1438a0-91d4-4436-9970-ec5f848f5156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:45.243016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1438a0-91d4-4436-9970-ec5f848f5156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:45.245930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1438a0-91d4-4436-9970-ec5f848f5156 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:45.248717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-8c45fa3f-f082-48b4-a4db-82127e3aac4b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:45.250529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8c45fa3f-f082-48b4-a4db-82127e3aac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:45.267433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1021/2036] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:45.268821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1016/2037] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:45.269926 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1438a0-91d4-4436-9970-ec5f848f5156 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:45.271368 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0506d6-0b2a-42c0-bd6f-e67ab8cade7c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:45.271890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0506d6-0b2a-42c0-bd6f-e67ab8cade7c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:45.272404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0506d6-0b2a-42c0-bd6f-e67ab8cade7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:45.281501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-bb1438a0-91d4-4436-9970-ec5f848f5156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:45.303373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-5c0506d6-0b2a-42c0-bd6f-e67ab8cade7c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:45.305475 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5c0506d6-0b2a-42c0-bd6f-e67ab8cade7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:45.313270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1438a0-91d4-4436-9970-ec5f848f5156 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:45.317166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1017/2038] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:45.318274 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0506d6-0b2a-42c0-bd6f-e67ab8cade7c None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:45.321903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b861289-da9a-4d80-bbe7-0f1384795f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:45.322753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b861289-da9a-4d80-bbe7-0f1384795f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:45.323225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b861289-da9a-4d80-bbe7-0f1384795f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:45.323805 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b861289-da9a-4d80-bbe7-0f1384795f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:45.324833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b861289-da9a-4d80-bbe7-0f1384795f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:45.327076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b861289-da9a-4d80-bbe7-0f1384795f8c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:45.328073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5c0506d6-0b2a-42c0-bd6f-e67ab8cade7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:45.346245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0506d6-0b2a-42c0-bd6f-e67ab8cade7c None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:45.352873 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3dd1e-738d-4ee4-b83c-4bd26018a729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:45.355264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3dd1e-738d-4ee4-b83c-4bd26018a729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:45.355264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3dd1e-738d-4ee4-b83c-4bd26018a729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:45.355264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3dd1e-738d-4ee4-b83c-4bd26018a729 admin admin] PATH_INFO: `/v3/projects/c18414ce188a4276b24d7a3f35b429ed` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:45.356114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3dd1e-738d-4ee4-b83c-4bd26018a729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c18414ce188a4276b24d7a3f35b429ed)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:45.358160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3dd1e-738d-4ee4-b83c-4bd26018a729 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:45.576288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1022/2039] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:45 2022] POST /identity/v3/projects => generated 387 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:45.576288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b861289-da9a-4d80-bbe7-0f1384795f8c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:45.590228 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83e3dd1e-738d-4ee4-b83c-4bd26018a729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c18414ce188a4276b24d7a3f35b429ed', 'request_id': 'req-83e3dd1e-738d-4ee4-b83c-4bd26018a729'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:45.597273 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83e3dd1e-738d-4ee4-b83c-4bd26018a729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c18414ce188a4276b24d7a3f35b429ed', 'request_id': 'req-83e3dd1e-738d-4ee4-b83c-4bd26018a729'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:45.680373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b861289-da9a-4d80-bbe7-0f1384795f8c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:45.775255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83e3dd1e-738d-4ee4-b83c-4bd26018a729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c18414ce188a4276b24d7a3f35b429ed', 'request_id': 'req-83e3dd1e-738d-4ee4-b83c-4bd26018a729'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:45.786565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0cf62-bd09-4b01-82b6-71ee3a234b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:45.795427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0cf62-bd09-4b01-82b6-71ee3a234b80 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:45.795427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0cf62-bd09-4b01-82b6-71ee3a234b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:45.795427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0cf62-bd09-4b01-82b6-71ee3a234b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:45.795427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0cf62-bd09-4b01-82b6-71ee3a234b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:45.795427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0cf62-bd09-4b01-82b6-71ee3a234b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:45.795427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0cf62-bd09-4b01-82b6-71ee3a234b80 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:45.798213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83e3dd1e-738d-4ee4-b83c-4bd26018a729 admin admin] The token cache is being invalidate because project c18414ce188a4276b24d7a3f35b429ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:45.798955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83e3dd1e-738d-4ee4-b83c-4bd26018a729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:45.800895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83e3dd1e-738d-4ee4-b83c-4bd26018a729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:45.805434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1018/2040] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:45 2022] DELETE /identity/v3/projects/c18414ce188a4276b24d7a3f35b429ed => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:45.806969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd7ec9-bdbe-4e97-a439-cadf5bc8e33f None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:45.808453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd7ec9-bdbe-4e97-a439-cadf5bc8e33f None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:45.808887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd7ec9-bdbe-4e97-a439-cadf5bc8e33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:45.818405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1023/2041] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:45.820086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0cf62-bd09-4b01-82b6-71ee3a234b80 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:45.823115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3aa0cf62-bd09-4b01-82b6-71ee3a234b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:45.849423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0cf62-bd09-4b01-82b6-71ee3a234b80 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:45.856763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-f3cd7ec9-bdbe-4e97-a439-cadf5bc8e33f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:45.858779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f3cd7ec9-bdbe-4e97-a439-cadf5bc8e33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:45.859180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0440a91-6c23-45a5-875c-264ff33ff3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:45.860360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0440a91-6c23-45a5-875c-264ff33ff3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:45.860861 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0440a91-6c23-45a5-875c-264ff33ff3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:45.861352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0440a91-6c23-45a5-875c-264ff33ff3e9 admin admin] PATH_INFO: `/v3/projects/6c24471039bc4593ac3a97259da50427/users/e31b35e7cbf34632810edf4c6ba39966/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:45.875164 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1019/2042] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:45.876502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd7ec9-bdbe-4e97-a439-cadf5bc8e33f None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:45.878322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f3cd7ec9-bdbe-4e97-a439-cadf5bc8e33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:45.891871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0440a91-6c23-45a5-875c-264ff33ff3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c24471039bc4593ac3a97259da50427, user_id=e31b35e7cbf34632810edf4c6ba39966, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:45.897063 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0440a91-6c23-45a5-875c-264ff33ff3e9 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:45.971311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd7ec9-bdbe-4e97-a439-cadf5bc8e33f None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:45.978556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7a84d-5327-4574-a44a-c89b072d9a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:45.979459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7a84d-5327-4574-a44a-c89b072d9a09 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:45.980166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7a84d-5327-4574-a44a-c89b072d9a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:45.980446 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7a84d-5327-4574-a44a-c89b072d9a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:45.983592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-55b7a84d-5327-4574-a44a-c89b072d9a09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:46.004668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7a84d-5327-4574-a44a-c89b072d9a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:46.007872 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7a84d-5327-4574-a44a-c89b072d9a09 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:46.029053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1020/2043] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:46.030430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7a84d-5327-4574-a44a-c89b072d9a09 service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:46.033023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-55b7a84d-5327-4574-a44a-c89b072d9a09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:46.045585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1024/2044] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:45 2022] PUT /identity/v3/projects/6c24471039bc4593ac3a97259da50427/users/e31b35e7cbf34632810edf4c6ba39966/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:46.048302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09195369-0aeb-40e3-ab6c-302ce73d612b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:46.048816 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09195369-0aeb-40e3-ab6c-302ce73d612b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:46.049316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09195369-0aeb-40e3-ab6c-302ce73d612b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:46.056564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7a84d-5327-4574-a44a-c89b072d9a09 service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:46.111985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-09195369-0aeb-40e3-ab6c-302ce73d612b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:46.113871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-09195369-0aeb-40e3-ab6c-302ce73d612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:46.217441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cc3f1-8c73-4841-ad78-c01f19e6b517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:46.218955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cc3f1-8c73-4841-ad78-c01f19e6b517 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:46.219616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cc3f1-8c73-4841-ad78-c01f19e6b517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:46.220434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cc3f1-8c73-4841-ad78-c01f19e6b517 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:46.222022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cc3f1-8c73-4841-ad78-c01f19e6b517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:46.227018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cc3f1-8c73-4841-ad78-c01f19e6b517 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:46.238969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1025/2045] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:46.242018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09195369-0aeb-40e3-ab6c-302ce73d612b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:46.253476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-09195369-0aeb-40e3-ab6c-302ce73d612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:46.281732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09195369-0aeb-40e3-ab6c-302ce73d612b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:46.291487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d84ead-e6b5-410a-82da-8e05ad9c9f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:46.292585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84ead-e6b5-410a-82da-8e05ad9c9f7c admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:46.293098 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84ead-e6b5-410a-82da-8e05ad9c9f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:46.293639 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d84ead-e6b5-410a-82da-8e05ad9c9f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:46.294907 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d84ead-e6b5-410a-82da-8e05ad9c9f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:46.298985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d84ead-e6b5-410a-82da-8e05ad9c9f7c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:46.459269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1021/2046] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:46 2022] POST /identity/v3/users => generated 300 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:46.464218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cc3f1-8c73-4841-ad78-c01f19e6b517 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:46.484351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1026/2047] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:46 2022] POST /identity/v3/projects => generated 357 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:46.486131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cc3f1-8c73-4841-ad78-c01f19e6b517 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:46.489443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019e7dd-0af1-4e3a-ab38-0e1acfd49270 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:46.489768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019e7dd-0af1-4e3a-ab38-0e1acfd49270 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:46.490011 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019e7dd-0af1-4e3a-ab38-0e1acfd49270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:46.524418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-8019e7dd-0af1-4e3a-ab38-0e1acfd49270 None None] MFA Rules not processed for user `e31b35e7cbf34632810edf4c6ba39966`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:46.525717 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8019e7dd-0af1-4e3a-ab38-0e1acfd49270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:46.613644 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8a1a4-9369-46dd-adcd-a6436329c0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:46.614962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8a1a4-9369-46dd-adcd-a6436329c0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:46.615381 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8a1a4-9369-46dd-adcd-a6436329c0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:46.615826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c8a1a4-9369-46dd-adcd-a6436329c0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:46.617556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8a1a4-9369-46dd-adcd-a6436329c0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:46.618084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8a1a4-9369-46dd-adcd-a6436329c0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:46.621237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c8a1a4-9369-46dd-adcd-a6436329c0f2 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:46.627704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1027/2048] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:46.630389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca3bfd-6b40-443a-b126-7ec16078fcd5 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:46.631204 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca3bfd-6b40-443a-b126-7ec16078fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:46.632097 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca3bfd-6b40-443a-b126-7ec16078fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:46.685786 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-b6ca3bfd-6b40-443a-b126-7ec16078fcd5 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:46.685786 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b6ca3bfd-6b40-443a-b126-7ec16078fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:46.686906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1022/2049] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:46.686906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8a1a4-9369-46dd-adcd-a6436329c0f2 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:46.695451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1028/2050] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:46.695451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca3bfd-6b40-443a-b126-7ec16078fcd5 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:46.699688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c8a1a4-9369-46dd-adcd-a6436329c0f2 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:46.704943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca3bfd-6b40-443a-b126-7ec16078fcd5 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:46.707934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815de9fa-7416-45d1-bde8-ea673c890ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:46.708614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815de9fa-7416-45d1-bde8-ea673c890ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:46.708961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815de9fa-7416-45d1-bde8-ea673c890ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:46.709244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815de9fa-7416-45d1-bde8-ea673c890ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:46.710206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815de9fa-7416-45d1-bde8-ea673c890ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:46.711530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058efdb-5617-4478-b8a2-5870a4bdc9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:46.712179 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815de9fa-7416-45d1-bde8-ea673c890ba4 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:46.712385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058efdb-5617-4478-b8a2-5870a4bdc9ec admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:46.712542 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058efdb-5617-4478-b8a2-5870a4bdc9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:46.712789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058efdb-5617-4478-b8a2-5870a4bdc9ec admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:46.713472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058efdb-5617-4478-b8a2-5870a4bdc9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:46.715589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058efdb-5617-4478-b8a2-5870a4bdc9ec admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:46.730009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1023/2051] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:46.730009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815de9fa-7416-45d1-bde8-ea673c890ba4 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:46.743326 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815de9fa-7416-45d1-bde8-ea673c890ba4 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:46.748945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99b356-ade2-4dd5-a2b5-8ef935b79047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:46.749625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99b356-ade2-4dd5-a2b5-8ef935b79047 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:46.759151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99b356-ade2-4dd5-a2b5-8ef935b79047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:46.759151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99b356-ade2-4dd5-a2b5-8ef935b79047 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:46.759151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99b356-ade2-4dd5-a2b5-8ef935b79047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:46.759151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99b356-ade2-4dd5-a2b5-8ef935b79047 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:47.032198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1024/2052] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:46 2022] POST /identity/v3/projects => generated 367 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:47.032198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99b356-ade2-4dd5-a2b5-8ef935b79047 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:47.039823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1029/2053] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:46 2022] POST /identity/v3/users => generated 279 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:47.039823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058efdb-5617-4478-b8a2-5870a4bdc9ec admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:47.052501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058efdb-5617-4478-b8a2-5870a4bdc9ec admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:47.123005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9766284-8bbf-4443-92f6-00a929d7b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:47.123615 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9766284-8bbf-4443-92f6-00a929d7b7ee admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:47.123898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9766284-8bbf-4443-92f6-00a929d7b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:47.124299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9766284-8bbf-4443-92f6-00a929d7b7ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:47.124951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9766284-8bbf-4443-92f6-00a929d7b7ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:47.125249 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9766284-8bbf-4443-92f6-00a929d7b7ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:47.126971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9766284-8bbf-4443-92f6-00a929d7b7ee admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:47.127104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99b356-ade2-4dd5-a2b5-8ef935b79047 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:47.140579 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f63d8-345c-40eb-980e-7678fbf50f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:47.144393 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f63d8-345c-40eb-980e-7678fbf50f3b admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:47.144554 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1030/2054] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:47.144640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f63d8-345c-40eb-980e-7678fbf50f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:47.144640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f63d8-345c-40eb-980e-7678fbf50f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:47.144866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9766284-8bbf-4443-92f6-00a929d7b7ee admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:47.144970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f63d8-345c-40eb-980e-7678fbf50f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:47.144970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f63d8-345c-40eb-980e-7678fbf50f3b admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:47.156984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9766284-8bbf-4443-92f6-00a929d7b7ee admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:47.162374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24bbd-4508-4881-9088-72a260c01d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:47.163057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24bbd-4508-4881-9088-72a260c01d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:47.163360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24bbd-4508-4881-9088-72a260c01d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:47.163636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad24bbd-4508-4881-9088-72a260c01d8b admin admin] PATH_INFO: `/v3/projects/e1a87b86a5724d268eda731bb8eae288/users/d00eca197f7e471d82d501b04afe3d32/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:47.184753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad24bbd-4508-4881-9088-72a260c01d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a87b86a5724d268eda731bb8eae288, user_id=d00eca197f7e471d82d501b04afe3d32, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:47.188499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad24bbd-4508-4881-9088-72a260c01d8b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:47.311345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1025/2055] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:47 2022] POST /identity/v3/projects => generated 373 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:47.311345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f63d8-345c-40eb-980e-7678fbf50f3b admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:47.313653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-640f63d8-345c-40eb-980e-7678fbf50f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:47.364878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1031/2056] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:47 2022] PUT /identity/v3/projects/e1a87b86a5724d268eda731bb8eae288/users/d00eca197f7e471d82d501b04afe3d32/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:47.369850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24bbd-4508-4881-9088-72a260c01d8b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:47.454742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f63d8-345c-40eb-980e-7678fbf50f3b admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:47.479069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad24bbd-4508-4881-9088-72a260c01d8b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:47.486210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fc6c4-e9e7-44e1-9b78-6185de44d10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:47.486942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fc6c4-e9e7-44e1-9b78-6185de44d10b admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:47.487235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fc6c4-e9e7-44e1-9b78-6185de44d10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:47.487490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fc6c4-e9e7-44e1-9b78-6185de44d10b admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:47.488167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fc6c4-e9e7-44e1-9b78-6185de44d10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:47.489950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fc6c4-e9e7-44e1-9b78-6185de44d10b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:47.505663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1032/2057] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:47.505663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fc6c4-e9e7-44e1-9b78-6185de44d10b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:47.525736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fc6c4-e9e7-44e1-9b78-6185de44d10b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:47.533708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fefc58-70c9-4aeb-8e83-ad976c235706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:47.535341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fefc58-70c9-4aeb-8e83-ad976c235706 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:47.535925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fefc58-70c9-4aeb-8e83-ad976c235706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:47.536524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fefc58-70c9-4aeb-8e83-ad976c235706 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:47.537800 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fefc58-70c9-4aeb-8e83-ad976c235706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:47.541823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fefc58-70c9-4aeb-8e83-ad976c235706 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:47.542438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:47.543272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:47.543733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:47.544213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] PATH_INFO: `/v3/projects/0d3acf7db89f4e02b5e456e76722fb2c` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:47.546400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3acf7db89f4e02b5e456e76722fb2c)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:47.550641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:47.680889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:47.790570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1033/2058] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:47 2022] POST /identity/v3/users => generated 290 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:47.792137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fefc58-70c9-4aeb-8e83-ad976c235706 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:47.811204 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fefc58-70c9-4aeb-8e83-ad976c235706 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:47.824533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3acf7db89f4e02b5e456e76722fb2c', 'request_id': 'req-285a4703-a88f-408e-a4a2-2ab63d90aae3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:47.838223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3acf7db89f4e02b5e456e76722fb2c', 'request_id': 'req-285a4703-a88f-408e-a4a2-2ab63d90aae3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:47.882416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548270a-49ba-479d-a73e-56f8d3c31b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:47.889772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548270a-49ba-479d-a73e-56f8d3c31b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:47.889772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548270a-49ba-479d-a73e-56f8d3c31b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:47.889772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548270a-49ba-479d-a73e-56f8d3c31b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:47.889772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548270a-49ba-479d-a73e-56f8d3c31b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:47.889772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548270a-49ba-479d-a73e-56f8d3c31b2a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:47.948572 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3acf7db89f4e02b5e456e76722fb2c', 'request_id': 'req-285a4703-a88f-408e-a4a2-2ab63d90aae3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:47.961232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] The token cache is being invalidate because project 0d3acf7db89f4e02b5e456e76722fb2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:47.961583 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:47.962305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:47.964039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1026/2059] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:47 2022] DELETE /identity/v3/projects/0d3acf7db89f4e02b5e456e76722fb2c => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:47.965024 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:47.966789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:47.986113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a4703-a88f-408e-a4a2-2ab63d90aae3 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:47.993537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d21b6-b2bd-48b0-8b32-e2639e1b9a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:47.993537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d21b6-b2bd-48b0-8b32-e2639e1b9a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:47.993537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d21b6-b2bd-48b0-8b32-e2639e1b9a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:47.993537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d21b6-b2bd-48b0-8b32-e2639e1b9a12 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:47.994290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d21b6-b2bd-48b0-8b32-e2639e1b9a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:47.996912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d21b6-b2bd-48b0-8b32-e2639e1b9a12 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:48.123341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1034/2060] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:47 2022] POST /identity/v3/projects => generated 387 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:48.124713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548270a-49ba-479d-a73e-56f8d3c31b2a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:48.127465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9548270a-49ba-479d-a73e-56f8d3c31b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:48.164236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1027/2061] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:47 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:48.165900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d21b6-b2bd-48b0-8b32-e2639e1b9a12 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:48.170651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-075d21b6-b2bd-48b0-8b32-e2639e1b9a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:48.185539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d21b6-b2bd-48b0-8b32-e2639e1b9a12 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:48.218642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548270a-49ba-479d-a73e-56f8d3c31b2a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:48.224136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d6588-b8e1-4337-8876-8da31c3cdf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:48.224771 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d6588-b8e1-4337-8876-8da31c3cdf69 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:48.225035 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d6588-b8e1-4337-8876-8da31c3cdf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:48.225311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d6588-b8e1-4337-8876-8da31c3cdf69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:48.226050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d6588-b8e1-4337-8876-8da31c3cdf69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:48.228275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d6588-b8e1-4337-8876-8da31c3cdf69 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:48.239537 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1035/2062] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:48.240234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d6588-b8e1-4337-8876-8da31c3cdf69 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:48.243472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0f1d6588-b8e1-4337-8876-8da31c3cdf69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:48.259028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d6588-b8e1-4337-8876-8da31c3cdf69 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:48.260004 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182cdce-7b43-4e69-a9f7-374b361ea14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:48.260640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182cdce-7b43-4e69-a9f7-374b361ea14b admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:48.260923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182cdce-7b43-4e69-a9f7-374b361ea14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:48.261427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182cdce-7b43-4e69-a9f7-374b361ea14b admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:48.262212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182cdce-7b43-4e69-a9f7-374b361ea14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:48.264027 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182cdce-7b43-4e69-a9f7-374b361ea14b admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:48.264934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0bd3e-0d12-45c7-82ae-c9e045de55ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:48.265635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0bd3e-0d12-45c7-82ae-c9e045de55ff admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:48.265914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0bd3e-0d12-45c7-82ae-c9e045de55ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:48.266192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0bd3e-0d12-45c7-82ae-c9e045de55ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:48.266869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0bd3e-0d12-45c7-82ae-c9e045de55ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:48.268519 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0bd3e-0d12-45c7-82ae-c9e045de55ff admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:48.280471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1036/2063] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:48.281968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1028/2064] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:48.283008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182cdce-7b43-4e69-a9f7-374b361ea14b admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:48.285024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f73bc-5e6e-406c-802a-15d41326ec9b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:48.285319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f73bc-5e6e-406c-802a-15d41326ec9b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:48.285622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f73bc-5e6e-406c-802a-15d41326ec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:48.287044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8182cdce-7b43-4e69-a9f7-374b361ea14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:48.303651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182cdce-7b43-4e69-a9f7-374b361ea14b admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:48.306391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c63f73bc-5e6e-406c-802a-15d41326ec9b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:48.307613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c63f73bc-5e6e-406c-802a-15d41326ec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:48.310094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:48.311133 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:48.311374 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:48.311715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] PATH_INFO: `/v3/users/4ea713937f994ac4b34653bf6d1ca3b3` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:48.312868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea713937f994ac4b34653bf6d1ca3b3)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:48.314957 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:48.317898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1037/2065] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:48.317898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f73bc-5e6e-406c-802a-15d41326ec9b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:48.329227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c63f73bc-5e6e-406c-802a-15d41326ec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:48.335908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f73bc-5e6e-406c-802a-15d41326ec9b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:48.345401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19dc9-a995-42c7-bdc8-7b7d4de49ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:48.346101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19dc9-a995-42c7-bdc8-7b7d4de49ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:48.346457 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19dc9-a995-42c7-bdc8-7b7d4de49ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:48.346804 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d19dc9-a995-42c7-bdc8-7b7d4de49ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:48.347691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d19dc9-a995-42c7-bdc8-7b7d4de49ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:48.350000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d19dc9-a995-42c7-bdc8-7b7d4de49ee0 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:48.574438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:48.582780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1038/2066] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:48 2022] POST /identity/v3/users => generated 294 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:48.582780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19dc9-a995-42c7-bdc8-7b7d4de49ee0 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:48.593627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d19dc9-a995-42c7-bdc8-7b7d4de49ee0 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:48.599604 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b9a62-3c65-4bfd-b8e6-0080a2490d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:48.600356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b9a62-3c65-4bfd-b8e6-0080a2490d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:48.600791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b9a62-3c65-4bfd-b8e6-0080a2490d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:48.601163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b9a62-3c65-4bfd-b8e6-0080a2490d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:48.602310 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b9a62-3c65-4bfd-b8e6-0080a2490d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:48.604115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b9a62-3c65-4bfd-b8e6-0080a2490d1e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:48.618514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1039/2067] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:48.619573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b9a62-3c65-4bfd-b8e6-0080a2490d1e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:48.633546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b9a62-3c65-4bfd-b8e6-0080a2490d1e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:48.640385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b665f-6347-4f29-8a41-c7ca8cdeeded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:48.641077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b665f-6347-4f29-8a41-c7ca8cdeeded admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:48.641355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b665f-6347-4f29-8a41-c7ca8cdeeded admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:48.641667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b665f-6347-4f29-8a41-c7ca8cdeeded admin admin] PATH_INFO: `/v3/projects/e1a87b86a5724d268eda731bb8eae288/users/d00eca197f7e471d82d501b04afe3d32/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:48.649900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b665f-6347-4f29-8a41-c7ca8cdeeded admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a87b86a5724d268eda731bb8eae288, user_id=d00eca197f7e471d82d501b04afe3d32, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:48.653511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b665f-6347-4f29-8a41-c7ca8cdeeded admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:48.675524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1040/2068] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:48 2022] PUT /identity/v3/projects/e1a87b86a5724d268eda731bb8eae288/users/d00eca197f7e471d82d501b04afe3d32/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:48.675524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b665f-6347-4f29-8a41-c7ca8cdeeded admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:48.675819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea713937f994ac4b34653bf6d1ca3b3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:48.689541 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea713937f994ac4b34653bf6d1ca3b3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:48.748360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b665f-6347-4f29-8a41-c7ca8cdeeded admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:48.753042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af319885-b3f4-4db8-8f8a-6bd10aa8df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:48.753864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af319885-b3f4-4db8-8f8a-6bd10aa8df13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:48.754144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af319885-b3f4-4db8-8f8a-6bd10aa8df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:48.754411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af319885-b3f4-4db8-8f8a-6bd10aa8df13 admin admin] PATH_INFO: `/v3/projects/92b6b0497a8a4b2b91ddb9d0661c07cc/users/a75bd1c3326c4c7c8d64d2ce52a466d8/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:48.771097 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af319885-b3f4-4db8-8f8a-6bd10aa8df13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92b6b0497a8a4b2b91ddb9d0661c07cc, user_id=a75bd1c3326c4c7c8d64d2ce52a466d8, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:48.774138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af319885-b3f4-4db8-8f8a-6bd10aa8df13 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:48.896655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea713937f994ac4b34653bf6d1ca3b3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:48.897963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea713937f994ac4b34653bf6d1ca3b3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:48.899170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea713937f994ac4b34653bf6d1ca3b3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:48.926928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1029/2069] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:48 2022] DELETE /identity/v3/users/4ea713937f994ac4b34653bf6d1ca3b3 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:48.928206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:48.931432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:48.946680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1041/2070] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:48 2022] PUT /identity/v3/projects/92b6b0497a8a4b2b91ddb9d0661c07cc/users/a75bd1c3326c4c7c8d64d2ce52a466d8/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:48.947991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e7931-e437-477b-aa49-b57e88f21ddc None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:48.953121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e7931-e437-477b-aa49-b57e88f21ddc None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:48.953121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e7931-e437-477b-aa49-b57e88f21ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:48.984738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-f70e7931-e437-477b-aa49-b57e88f21ddc None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:48.986313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f70e7931-e437-477b-aa49-b57e88f21ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:49.084811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179feaf-76cb-41c4-abb6-122e0c4ce42c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:49.102474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1042/2071] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:49.107146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e7931-e437-477b-aa49-b57e88f21ddc None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:49.107146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f70e7931-e437-477b-aa49-b57e88f21ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:49.122359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe82ea-3860-41fd-89f3-31bf05b9a66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:49.122359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe82ea-3860-41fd-89f3-31bf05b9a66c admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.122359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe82ea-3860-41fd-89f3-31bf05b9a66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.122359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe82ea-3860-41fd-89f3-31bf05b9a66c admin admin] PATH_INFO: `/v3/projects/3befd67f235940edbb172e943fdcc198/users/b40656e81d37492dbdb3d70140080e7c/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.139496 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe82ea-3860-41fd-89f3-31bf05b9a66c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3befd67f235940edbb172e943fdcc198, user_id=b40656e81d37492dbdb3d70140080e7c, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:49.142535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe82ea-3860-41fd-89f3-31bf05b9a66c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:49.144837 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e7931-e437-477b-aa49-b57e88f21ddc None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:49.151185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b86d-71a4-4528-aaeb-274962e84dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:49.151885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b86d-71a4-4528-aaeb-274962e84dfd admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.152287 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b86d-71a4-4528-aaeb-274962e84dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.152567 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11b86d-71a4-4528-aaeb-274962e84dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.153287 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11b86d-71a4-4528-aaeb-274962e84dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:49.155277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11b86d-71a4-4528-aaeb-274962e84dfd admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:49.170936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1043/2072] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:49.175976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b86d-71a4-4528-aaeb-274962e84dfd admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:49.180833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-cc11b86d-71a4-4528-aaeb-274962e84dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:49.203426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11b86d-71a4-4528-aaeb-274962e84dfd admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:49.210687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b074e-639c-48f1-b177-22719c119aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:49.211488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b074e-639c-48f1-b177-22719c119aef admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.211927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b074e-639c-48f1-b177-22719c119aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.212339 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b074e-639c-48f1-b177-22719c119aef admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.213238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b074e-639c-48f1-b177-22719c119aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:49.215453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b074e-639c-48f1-b177-22719c119aef admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:49.227436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1044/2073] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:49.228937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feb17d-019e-4db3-9230-23a8d0529dbe None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.229327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feb17d-019e-4db3-9230-23a8d0529dbe None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.229737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feb17d-019e-4db3-9230-23a8d0529dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.263917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-17feb17d-019e-4db3-9230-23a8d0529dbe None None] MFA Rules not processed for user `d00eca197f7e471d82d501b04afe3d32`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:49.265061 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-17feb17d-019e-4db3-9230-23a8d0529dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:49.344254 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1045/2074] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:49.345841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454180a1-f11d-426a-b2ef-8c8765b85267 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.346124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454180a1-f11d-426a-b2ef-8c8765b85267 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.346396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454180a1-f11d-426a-b2ef-8c8765b85267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.355025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1030/2075] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:48 2022] PUT /identity/v3/projects/3befd67f235940edbb172e943fdcc198/users/b40656e81d37492dbdb3d70140080e7c/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:49.359418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c942ed-4573-41bf-ab68-8f05a2557d5a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.359418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c942ed-4573-41bf-ab68-8f05a2557d5a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.359418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c942ed-4573-41bf-ab68-8f05a2557d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.383075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-454180a1-f11d-426a-b2ef-8c8765b85267 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:49.384676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-454180a1-f11d-426a-b2ef-8c8765b85267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:49.394757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-87c942ed-4573-41bf-ab68-8f05a2557d5a None None] MFA Rules not processed for user `a75bd1c3326c4c7c8d64d2ce52a466d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:49.396004 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-87c942ed-4573-41bf-ab68-8f05a2557d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:49.486800 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1046/2076] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:49.487685 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454180a1-f11d-426a-b2ef-8c8765b85267 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:49.498252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1031/2077] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:49.499550 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c942ed-4573-41bf-ab68-8f05a2557d5a None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:49.508688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454180a1-f11d-426a-b2ef-8c8765b85267 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:49.513309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c942ed-4573-41bf-ab68-8f05a2557d5a None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:49.518068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61004a8-4296-4597-b1b1-80339094a1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:49.518801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61004a8-4296-4597-b1b1-80339094a1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.519088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61004a8-4296-4597-b1b1-80339094a1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.519364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61004a8-4296-4597-b1b1-80339094a1d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.520051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61004a8-4296-4597-b1b1-80339094a1d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:49.520352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61004a8-4296-4597-b1b1-80339094a1d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:49.522175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61004a8-4296-4597-b1b1-80339094a1d6 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:49.522476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1d8d3-f345-44f6-93c0-501430c5b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:49.523861 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1d8d3-f345-44f6-93c0-501430c5b38e admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.524290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1d8d3-f345-44f6-93c0-501430c5b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.525019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b1d8d3-f345-44f6-93c0-501430c5b38e admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.525910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1d8d3-f345-44f6-93c0-501430c5b38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:49.527595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b1d8d3-f345-44f6-93c0-501430c5b38e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:49.537808 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1047/2078] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:49.542607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61004a8-4296-4597-b1b1-80339094a1d6 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:49.542748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1032/2079] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:49.542748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1d8d3-f345-44f6-93c0-501430c5b38e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:49.546919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-44b1d8d3-f345-44f6-93c0-501430c5b38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:49.551145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61004a8-4296-4597-b1b1-80339094a1d6 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:49.558354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d994e4-8de2-4e4c-b3d5-367bf245b337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:49.559040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d994e4-8de2-4e4c-b3d5-367bf245b337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.559734 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d994e4-8de2-4e4c-b3d5-367bf245b337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.560029 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d994e4-8de2-4e4c-b3d5-367bf245b337 admin admin] PATH_INFO: `/v3/projects/075c9b8febed440abc1df698f1406650/users/12274478c8614fb8bc4c2e9f23f41022/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.582402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d994e4-8de2-4e4c-b3d5-367bf245b337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=075c9b8febed440abc1df698f1406650, user_id=12274478c8614fb8bc4c2e9f23f41022, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:49.588553 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d994e4-8de2-4e4c-b3d5-367bf245b337 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:49.638150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b1d8d3-f345-44f6-93c0-501430c5b38e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:49.643089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7a343-d486-40d2-9283-41c3b4c83ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:49.644107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7a343-d486-40d2-9283-41c3b4c83ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.644362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7a343-d486-40d2-9283-41c3b4c83ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.644708 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7a343-d486-40d2-9283-41c3b4c83ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.719640 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1048/2080] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:49 2022] PUT /identity/v3/projects/075c9b8febed440abc1df698f1406650/users/12274478c8614fb8bc4c2e9f23f41022/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:49.720523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d994e4-8de2-4e4c-b3d5-367bf245b337 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:49.738568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7a343-d486-40d2-9283-41c3b4c83ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:49.739765 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7a343-d486-40d2-9283-41c3b4c83ac9 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:49.751692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1033/2081] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:49.752577 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7a343-d486-40d2-9283-41c3b4c83ac9 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:49.754017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-18a7a343-d486-40d2-9283-41c3b4c83ac9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:49.815299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d994e4-8de2-4e4c-b3d5-367bf245b337 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:49.822744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037cde6-0970-4b97-adc6-76139da94cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:49.823375 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037cde6-0970-4b97-adc6-76139da94cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.823663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037cde6-0970-4b97-adc6-76139da94cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.824078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037cde6-0970-4b97-adc6-76139da94cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.824590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037cde6-0970-4b97-adc6-76139da94cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:49.825885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7a343-d486-40d2-9283-41c3b4c83ac9 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:49.826314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037cde6-0970-4b97-adc6-76139da94cf6 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:49.838570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1049/2082] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:49.839718 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037cde6-0970-4b97-adc6-76139da94cf6 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:49.841533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f037cde6-0970-4b97-adc6-76139da94cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:49.856620 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037cde6-0970-4b97-adc6-76139da94cf6 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:49.869135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b4e8a-28a1-43d7-8be1-2dd83d3d50bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:49.877481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4e8a-28a1-43d7-8be1-2dd83d3d50bf admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.877481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4e8a-28a1-43d7-8be1-2dd83d3d50bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.877481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b4e8a-28a1-43d7-8be1-2dd83d3d50bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.877481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b4e8a-28a1-43d7-8be1-2dd83d3d50bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:49.877481 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b4e8a-28a1-43d7-8be1-2dd83d3d50bf admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:49.912106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdc768-5fca-41b9-a24f-6fb7a37f7f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:49.912906 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdc768-5fca-41b9-a24f-6fb7a37f7f7a service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.923330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdc768-5fca-41b9-a24f-6fb7a37f7f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.923330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdc768-5fca-41b9-a24f-6fb7a37f7f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:49.926260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdc768-5fca-41b9-a24f-6fb7a37f7f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:49.929758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdc768-5fca-41b9-a24f-6fb7a37f7f7a service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:49.955032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1034/2083] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:49.957660 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdc768-5fca-41b9-a24f-6fb7a37f7f7a service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:49.971418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdc768-5fca-41b9-a24f-6fb7a37f7f7a service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:49.985224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a72cc7-cde3-4477-a252-cd92543f9fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:49.985224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a72cc7-cde3-4477-a252-cd92543f9fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:49.985224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a72cc7-cde3-4477-a252-cd92543f9fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:49.985224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a72cc7-cde3-4477-a252-cd92543f9fe1 admin admin] PATH_INFO: `/v3/projects/5517b532b8e54ed99277742404361ce8/users/a9f4056056d5446481b99b61972ee346/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:50.014862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a72cc7-cde3-4477-a252-cd92543f9fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5517b532b8e54ed99277742404361ce8, user_id=a9f4056056d5446481b99b61972ee346, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:50.018050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a72cc7-cde3-4477-a252-cd92543f9fe1 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:50.040728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1050/2084] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:49 2022] POST /identity/v3/projects => generated 357 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:50.041893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b4e8a-28a1-43d7-8be1-2dd83d3d50bf admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:50.131359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b4e8a-28a1-43d7-8be1-2dd83d3d50bf admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:50.137573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fecf28-2c64-4e48-a703-13c8514b35ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:50.138212 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fecf28-2c64-4e48-a703-13c8514b35ae admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:50.138483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fecf28-2c64-4e48-a703-13c8514b35ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:50.138797 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fecf28-2c64-4e48-a703-13c8514b35ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:50.139513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fecf28-2c64-4e48-a703-13c8514b35ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:50.141666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fecf28-2c64-4e48-a703-13c8514b35ae admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:50.214364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1035/2085] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:49 2022] PUT /identity/v3/projects/5517b532b8e54ed99277742404361ce8/users/a9f4056056d5446481b99b61972ee346/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:50.218256 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ea394-1afe-4ccf-b58f-690f01f1fd01 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:50.218744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ea394-1afe-4ccf-b58f-690f01f1fd01 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:50.219290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ea394-1afe-4ccf-b58f-690f01f1fd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:50.254128 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-247ea394-1afe-4ccf-b58f-690f01f1fd01 None None] MFA Rules not processed for user `12274478c8614fb8bc4c2e9f23f41022`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:50.255447 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-247ea394-1afe-4ccf-b58f-690f01f1fd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:50.369514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1036/2086] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:50.376412 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ea394-1afe-4ccf-b58f-690f01f1fd01 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:50.379335 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-247ea394-1afe-4ccf-b58f-690f01f1fd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:50.409250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1051/2087] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:50 2022] POST /identity/v3/projects => generated 361 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:50.411149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fecf28-2c64-4e48-a703-13c8514b35ae admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:50.436193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:50.505595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ea394-1afe-4ccf-b58f-690f01f1fd01 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:50.530240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fecf28-2c64-4e48-a703-13c8514b35ae admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:50.535374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbcfe7-a471-407e-8d35-7c57fb16fdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:50.536175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbcfe7-a471-407e-8d35-7c57fb16fdb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:50.536570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbcfe7-a471-407e-8d35-7c57fb16fdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:50.536982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbcfe7-a471-407e-8d35-7c57fb16fdb0 admin admin] PATH_INFO: `/v3/projects/3befd67f235940edbb172e943fdcc198/users/b40656e81d37492dbdb3d70140080e7c/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:50.540095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbcfe7-a471-407e-8d35-7c57fb16fdb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3befd67f235940edbb172e943fdcc198, user_id=b40656e81d37492dbdb3d70140080e7c, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:50.543191 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbcfe7-a471-407e-8d35-7c57fb16fdb0 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:50.563233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1052/2088] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:50 2022] PUT /identity/v3/projects/3befd67f235940edbb172e943fdcc198/users/b40656e81d37492dbdb3d70140080e7c/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:50.563233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbcfe7-a471-407e-8d35-7c57fb16fdb0 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:50.642649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764a17d-6043-4d05-b725-4bb342c525d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:50.643801 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764a17d-6043-4d05-b725-4bb342c525d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:50.645458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764a17d-6043-4d05-b725-4bb342c525d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:50.649616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764a17d-6043-4d05-b725-4bb342c525d9 admin admin] PATH_INFO: `/v3/users/fe8c793e5f764238957aa2e6b66ba988` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:50.649616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764a17d-6043-4d05-b725-4bb342c525d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8c793e5f764238957aa2e6b66ba988)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:50.651505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbcfe7-a471-407e-8d35-7c57fb16fdb0 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:50.652093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764a17d-6043-4d05-b725-4bb342c525d9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:50.658624 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc4e14-f178-4698-ae96-af9b2236de3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:50.659415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc4e14-f178-4698-ae96-af9b2236de3c admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:50.659699 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc4e14-f178-4698-ae96-af9b2236de3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:50.660165 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc4e14-f178-4698-ae96-af9b2236de3c admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:50.660625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc4e14-f178-4698-ae96-af9b2236de3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:50.662781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc4e14-f178-4698-ae96-af9b2236de3c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:50.858510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1053/2089] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:50 2022] POST /identity/v3/users => generated 285 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:50.860042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824c74f-5378-4251-9d11-99aeeed53aef None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:50.861019 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824c74f-5378-4251-9d11-99aeeed53aef None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:50.861311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824c74f-5378-4251-9d11-99aeeed53aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:50.909553 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-8824c74f-5378-4251-9d11-99aeeed53aef None None] MFA Rules not processed for user `a9f4056056d5446481b99b61972ee346`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:50.910963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8824c74f-5378-4251-9d11-99aeeed53aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:51.017026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1054/2090] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:51.017974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824c74f-5378-4251-9d11-99aeeed53aef None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:51.023443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8824c74f-5378-4251-9d11-99aeeed53aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:51.092514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824c74f-5378-4251-9d11-99aeeed53aef None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:51.103605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b338c-1aad-47c1-86a9-26841f604cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:51.108987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b338c-1aad-47c1-86a9-26841f604cdf service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:51.108987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b338c-1aad-47c1-86a9-26841f604cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:51.108987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b338c-1aad-47c1-86a9-26841f604cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:51.121910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-0764a17d-6043-4d05-b725-4bb342c525d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8c793e5f764238957aa2e6b66ba988'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:51.131658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-0764a17d-6043-4d05-b725-4bb342c525d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8c793e5f764238957aa2e6b66ba988'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:51.189508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b338c-1aad-47c1-86a9-26841f604cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:51.191038 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b338c-1aad-47c1-86a9-26841f604cdf service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:51.201205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1055/2091] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:51.202087 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b338c-1aad-47c1-86a9-26841f604cdf service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:51.228623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b338c-1aad-47c1-86a9-26841f604cdf service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:51.228623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19740276-a3bd-4e90-a4ff-03898d39117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:51.228623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19740276-a3bd-4e90-a4ff-03898d39117b admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:51.228623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19740276-a3bd-4e90-a4ff-03898d39117b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:51.229097 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19740276-a3bd-4e90-a4ff-03898d39117b admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:51.229097 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19740276-a3bd-4e90-a4ff-03898d39117b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:51.229097 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19740276-a3bd-4e90-a4ff-03898d39117b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:51.278068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-0764a17d-6043-4d05-b725-4bb342c525d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8c793e5f764238957aa2e6b66ba988'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:51.278068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-0764a17d-6043-4d05-b725-4bb342c525d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8c793e5f764238957aa2e6b66ba988'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:51.278068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-0764a17d-6043-4d05-b725-4bb342c525d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8c793e5f764238957aa2e6b66ba988'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:51.309613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1037/2092] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:50 2022] DELETE /identity/v3/users/fe8c793e5f764238957aa2e6b66ba988 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:51.312031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f0ffd-1edb-4944-a3ac-80737072b8d5 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:51.314531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f0ffd-1edb-4944-a3ac-80737072b8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:51.319403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f0ffd-1edb-4944-a3ac-80737072b8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:51.349643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ba9f0ffd-1edb-4944-a3ac-80737072b8d5 None None] MFA Rules not processed for user `b40656e81d37492dbdb3d70140080e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:51.351622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ba9f0ffd-1edb-4944-a3ac-80737072b8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:51.427531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1038/2093] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:51.428343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f0ffd-1edb-4944-a3ac-80737072b8d5 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:51.430329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ba9f0ffd-1edb-4944-a3ac-80737072b8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:51.442105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1056/2094] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:51 2022] POST /identity/v3/users => generated 281 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:51.443272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19740276-a3bd-4e90-a4ff-03898d39117b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:51.446346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-19740276-a3bd-4e90-a4ff-03898d39117b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:51.459072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19740276-a3bd-4e90-a4ff-03898d39117b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:51.475625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:51.528738 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f0ffd-1edb-4944-a3ac-80737072b8d5 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:51.533565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de63899-1289-4af5-b159-44043e0faa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:51.534191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de63899-1289-4af5-b159-44043e0faa8c admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:51.534467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de63899-1289-4af5-b159-44043e0faa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:51.534583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510461e1-fc41-47ae-9fc2-aa87f4b52363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:51.534743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de63899-1289-4af5-b159-44043e0faa8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:51.535187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510461e1-fc41-47ae-9fc2-aa87f4b52363 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:51.535398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de63899-1289-4af5-b159-44043e0faa8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:51.535518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510461e1-fc41-47ae-9fc2-aa87f4b52363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:51.536461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510461e1-fc41-47ae-9fc2-aa87f4b52363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:51.537036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de63899-1289-4af5-b159-44043e0faa8c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:51.537142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510461e1-fc41-47ae-9fc2-aa87f4b52363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:51.539130 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510461e1-fc41-47ae-9fc2-aa87f4b52363 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:51.548595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1039/2095] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:51.549347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de63899-1289-4af5-b159-44043e0faa8c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:51.551465 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1de63899-1289-4af5-b159-44043e0faa8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:51.570654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de63899-1289-4af5-b159-44043e0faa8c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:51.576654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654183a-c52a-4b46-be8e-3f952d1facdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:51.577327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654183a-c52a-4b46-be8e-3f952d1facdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:51.577643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654183a-c52a-4b46-be8e-3f952d1facdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:51.577920 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654183a-c52a-4b46-be8e-3f952d1facdb admin admin] PATH_INFO: `/v3/projects/387f8659c9b449f6a5be51eebb9a5f2f` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:51.579076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654183a-c52a-4b46-be8e-3f952d1facdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=387f8659c9b449f6a5be51eebb9a5f2f)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:51.581022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654183a-c52a-4b46-be8e-3f952d1facdb admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:51.751039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1057/2096] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:51 2022] POST /identity/v3/projects => generated 385 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:51.752084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510461e1-fc41-47ae-9fc2-aa87f4b52363 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:51.753765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-510461e1-fc41-47ae-9fc2-aa87f4b52363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:51.797854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8654183a-c52a-4b46-be8e-3f952d1facdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387f8659c9b449f6a5be51eebb9a5f2f', 'request_id': 'req-8654183a-c52a-4b46-be8e-3f952d1facdb'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:51.810530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8654183a-c52a-4b46-be8e-3f952d1facdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387f8659c9b449f6a5be51eebb9a5f2f', 'request_id': 'req-8654183a-c52a-4b46-be8e-3f952d1facdb'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:51.835853 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510461e1-fc41-47ae-9fc2-aa87f4b52363 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:51.910742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:51.911391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:51.911676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:51.911950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] PATH_INFO: `/v3/users/d5e35757fcf046bdbb34dee53a336a26` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:51.913694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e35757fcf046bdbb34dee53a336a26)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:51.915660 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:52.006472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8654183a-c52a-4b46-be8e-3f952d1facdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387f8659c9b449f6a5be51eebb9a5f2f', 'request_id': 'req-8654183a-c52a-4b46-be8e-3f952d1facdb'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:52.022011 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8654183a-c52a-4b46-be8e-3f952d1facdb admin admin] The token cache is being invalidate because project 387f8659c9b449f6a5be51eebb9a5f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:52.023043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8654183a-c52a-4b46-be8e-3f952d1facdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:52.023882 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8654183a-c52a-4b46-be8e-3f952d1facdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:52.025419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1040/2097] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:51 2022] DELETE /identity/v3/projects/387f8659c9b449f6a5be51eebb9a5f2f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:52.026743 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28adad-49f0-4b04-aa24-faf87b9f5279 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:52.027174 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28adad-49f0-4b04-aa24-faf87b9f5279 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:52.027449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28adad-49f0-4b04-aa24-faf87b9f5279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:52.047544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-2b28adad-49f0-4b04-aa24-faf87b9f5279 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:52.048755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2b28adad-49f0-4b04-aa24-faf87b9f5279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:52.057090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1041/2098] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:52.059405 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28adad-49f0-4b04-aa24-faf87b9f5279 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:52.063014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2b28adad-49f0-4b04-aa24-faf87b9f5279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:52.137223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28adad-49f0-4b04-aa24-faf87b9f5279 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:52.141510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477b767-d467-49f2-b8b0-cb14e8f8a712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:52.142199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b767-d467-49f2-b8b0-cb14e8f8a712 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:52.142674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b767-d467-49f2-b8b0-cb14e8f8a712 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:52.142674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477b767-d467-49f2-b8b0-cb14e8f8a712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:52.144643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0477b767-d467-49f2-b8b0-cb14e8f8a712 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:52.190889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e35757fcf046bdbb34dee53a336a26'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:52.205989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e35757fcf046bdbb34dee53a336a26'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:52.216516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e35757fcf046bdbb34dee53a336a26'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:52.236066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477b767-d467-49f2-b8b0-cb14e8f8a712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:52.237887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0477b767-d467-49f2-b8b0-cb14e8f8a712 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:52.248523 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1042/2099] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:52.249676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477b767-d467-49f2-b8b0-cb14e8f8a712 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:52.251180 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0477b767-d467-49f2-b8b0-cb14e8f8a712 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:52.272221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477b767-d467-49f2-b8b0-cb14e8f8a712 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:52.278383 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7db8f1-758a-49fc-8f8a-73328b9737fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:52.279072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7db8f1-758a-49fc-8f8a-73328b9737fb admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:52.279351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7db8f1-758a-49fc-8f8a-73328b9737fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:52.279619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7db8f1-758a-49fc-8f8a-73328b9737fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:52.280262 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7db8f1-758a-49fc-8f8a-73328b9737fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:52.282017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7db8f1-758a-49fc-8f8a-73328b9737fb admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:52.294525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1043/2100] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:52.294525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7db8f1-758a-49fc-8f8a-73328b9737fb admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:52.298761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8d7db8f1-758a-49fc-8f8a-73328b9737fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:52.315628 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7db8f1-758a-49fc-8f8a-73328b9737fb admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:52.324640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6ddec-0bd6-4ecc-a677-4fca8e95c4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:52.325742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6ddec-0bd6-4ecc-a677-4fca8e95c4c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:52.326176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6ddec-0bd6-4ecc-a677-4fca8e95c4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:52.326568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6ddec-0bd6-4ecc-a677-4fca8e95c4c7 admin admin] PATH_INFO: `/v3/projects/2075a12a1b0849fbb34a1ea96bcccfeb/users/3ec0447fe9d74375aa3e1b373916978a/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:52.350698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6ddec-0bd6-4ecc-a677-4fca8e95c4c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2075a12a1b0849fbb34a1ea96bcccfeb, user_id=3ec0447fe9d74375aa3e1b373916978a, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:52.353457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d6ddec-0bd6-4ecc-a677-4fca8e95c4c7 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:52.383332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e35757fcf046bdbb34dee53a336a26'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:52.384046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e35757fcf046bdbb34dee53a336a26'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:52.390762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1058/2101] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:51 2022] DELETE /identity/v3/users/d5e35757fcf046bdbb34dee53a336a26 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:52.391551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:52.393016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:52.478078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd275c-5c3e-4175-afe2-ec7b5802b306 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:52.484648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22af40-6ba0-49c7-ab08-97b6b6f4728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:52.485486 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22af40-6ba0-49c7-ab08-97b6b6f4728b admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:52.495858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22af40-6ba0-49c7-ab08-97b6b6f4728b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:52.495858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22af40-6ba0-49c7-ab08-97b6b6f4728b admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:52.495858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22af40-6ba0-49c7-ab08-97b6b6f4728b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:52.495858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22af40-6ba0-49c7-ab08-97b6b6f4728b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:52.524569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1044/2102] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:52 2022] PUT /identity/v3/projects/2075a12a1b0849fbb34a1ea96bcccfeb/users/3ec0447fe9d74375aa3e1b373916978a/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:52.527106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6ddec-0bd6-4ecc-a677-4fca8e95c4c7 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:52.530919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-09d6ddec-0bd6-4ecc-a677-4fca8e95c4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:52.624676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d6ddec-0bd6-4ecc-a677-4fca8e95c4c7 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:52.629725 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:52.630391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:52.630681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:52.630932 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] PATH_INFO: `/v3/users/c30f0510a9794fbfa53260354bde4b86` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:52.632719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30f0510a9794fbfa53260354bde4b86)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:52.634888 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:52.666972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1059/2103] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:52 2022] POST /identity/v3/users => generated 299 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:52.673575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22af40-6ba0-49c7-ab08-97b6b6f4728b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:52.673575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9f22af40-6ba0-49c7-ab08-97b6b6f4728b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:52.750539 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22af40-6ba0-49c7-ab08-97b6b6f4728b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:52.812534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1f9b9-76f9-4afc-8601-070586eec4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:52.813425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1f9b9-76f9-4afc-8601-070586eec4df service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:52.813847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1f9b9-76f9-4afc-8601-070586eec4df service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:52.814225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1f9b9-76f9-4afc-8601-070586eec4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:52.817172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-86b1f9b9-76f9-4afc-8601-070586eec4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:52.833201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1f9b9-76f9-4afc-8601-070586eec4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:52.834693 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1f9b9-76f9-4afc-8601-070586eec4df service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:52.846962 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1060/2104] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:52.848666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1f9b9-76f9-4afc-8601-070586eec4df service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:52.851458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-86b1f9b9-76f9-4afc-8601-070586eec4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:52.874977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1f9b9-76f9-4afc-8601-070586eec4df service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:52.884037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fd2c9-b68c-4bad-9dee-f2535c0c87cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:52.885490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fd2c9-b68c-4bad-9dee-f2535c0c87cf admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:52.886143 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fd2c9-b68c-4bad-9dee-f2535c0c87cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:52.886640 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fd2c9-b68c-4bad-9dee-f2535c0c87cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:52.888300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fd2c9-b68c-4bad-9dee-f2535c0c87cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:52.891145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fd2c9-b68c-4bad-9dee-f2535c0c87cf admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:52.907303 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1061/2105] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:52.908208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fd2c9-b68c-4bad-9dee-f2535c0c87cf admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:52.910075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1b3fd2c9-b68c-4bad-9dee-f2535c0c87cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:52.924320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fd2c9-b68c-4bad-9dee-f2535c0c87cf admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:52.932224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd565586-1b13-4713-af41-ad98ce27dc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:52.934308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd565586-1b13-4713-af41-ad98ce27dc66 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:52.934308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd565586-1b13-4713-af41-ad98ce27dc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:52.934308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd565586-1b13-4713-af41-ad98ce27dc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:52.934308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd565586-1b13-4713-af41-ad98ce27dc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:52.937120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd565586-1b13-4713-af41-ad98ce27dc66 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:52.953122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30f0510a9794fbfa53260354bde4b86'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:52.957580 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1062/2106] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:52.957580 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd565586-1b13-4713-af41-ad98ce27dc66 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:52.962461 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30f0510a9794fbfa53260354bde4b86'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:52.971968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd565586-1b13-4713-af41-ad98ce27dc66 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:52.977995 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cbf49-099e-4e24-a280-a81bf8758bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:52.978806 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cbf49-099e-4e24-a280-a81bf8758bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:52.979094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cbf49-099e-4e24-a280-a81bf8758bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:52.979380 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cbf49-099e-4e24-a280-a81bf8758bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:52.980276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cbf49-099e-4e24-a280-a81bf8758bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:52.981711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cbf49-099e-4e24-a280-a81bf8758bd5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:52.995129 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1063/2107] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:52.996016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cbf49-099e-4e24-a280-a81bf8758bd5 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:52.997900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-939cbf49-099e-4e24-a280-a81bf8758bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:53.013413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cbf49-099e-4e24-a280-a81bf8758bd5 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:53.018141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:53.018770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:53.019048 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:53.022595 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] PATH_INFO: `/v3/projects/2b9baf9cac4a4b2686e7c2f033ef9efb` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:53.022595 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9baf9cac4a4b2686e7c2f033ef9efb)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:53.022789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:53.143218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30f0510a9794fbfa53260354bde4b86'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:53.144123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30f0510a9794fbfa53260354bde4b86'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:53.144783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30f0510a9794fbfa53260354bde4b86'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:53.169769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1045/2108] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:52 2022] DELETE /identity/v3/users/c30f0510a9794fbfa53260354bde4b86 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:53.170579 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:53.172215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:53.246098 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9baf9cac4a4b2686e7c2f033ef9efb', 'request_id': 'req-4c6c303c-3bec-4268-869d-c9624245b7bc'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:53.296218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c2c7d-848f-41d0-a5d9-533c3f92ad9b admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:53.378527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaaa6b2-ae31-40f6-9021-83754aba3359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:53.379526 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaa6b2-ae31-40f6-9021-83754aba3359 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:53.380002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaa6b2-ae31-40f6-9021-83754aba3359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:53.380426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaaa6b2-ae31-40f6-9021-83754aba3359 admin admin] PATH_INFO: `/v3/projects/be10d7e1d4a04a70abac1de4b068320d/users/af2056ad640341d4925fb27eec0e7a5d/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:53.396903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaaa6b2-ae31-40f6-9021-83754aba3359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be10d7e1d4a04a70abac1de4b068320d, user_id=af2056ad640341d4925fb27eec0e7a5d, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:53.400212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaaa6b2-ae31-40f6-9021-83754aba3359 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:53.405833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9baf9cac4a4b2686e7c2f033ef9efb', 'request_id': 'req-4c6c303c-3bec-4268-869d-c9624245b7bc'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:53.415130 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9baf9cac4a4b2686e7c2f033ef9efb', 'request_id': 'req-4c6c303c-3bec-4268-869d-c9624245b7bc'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:53.427549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] The token cache is being invalidate because project 2b9baf9cac4a4b2686e7c2f033ef9efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:53.427841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:53.428515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:53.430289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1064/2109] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:52 2022] DELETE /identity/v3/projects/2b9baf9cac4a4b2686e7c2f033ef9efb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:53.435281 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:53.435281 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:53.446040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c303c-3bec-4268-869d-c9624245b7bc admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:53.450991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eb7a3-614b-4f22-8cc8-fb82112ac540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:53.451851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eb7a3-614b-4f22-8cc8-fb82112ac540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:53.452315 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eb7a3-614b-4f22-8cc8-fb82112ac540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:53.452466 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eb7a3-614b-4f22-8cc8-fb82112ac540 admin admin] PATH_INFO: `/v3/projects/2075a12a1b0849fbb34a1ea96bcccfeb/users/3ec0447fe9d74375aa3e1b373916978a/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:53.454715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19eb7a3-614b-4f22-8cc8-fb82112ac540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2075a12a1b0849fbb34a1ea96bcccfeb, user_id=3ec0447fe9d74375aa3e1b373916978a, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:53.458396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19eb7a3-614b-4f22-8cc8-fb82112ac540 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:53.470015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1065/2110] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:53 2022] PUT /identity/v3/projects/2075a12a1b0849fbb34a1ea96bcccfeb/users/3ec0447fe9d74375aa3e1b373916978a/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:53.470890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eb7a3-614b-4f22-8cc8-fb82112ac540 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:53.472613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b19eb7a3-614b-4f22-8cc8-fb82112ac540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:53.558935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eb7a3-614b-4f22-8cc8-fb82112ac540 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:53.564325 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e911d-19eb-4d44-9814-a711431752a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:53.565013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e911d-19eb-4d44-9814-a711431752a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:53.565311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e911d-19eb-4d44-9814-a711431752a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:53.565658 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e911d-19eb-4d44-9814-a711431752a4 admin admin] PATH_INFO: `/v3/projects/0ce5dad95c984d7388c7c9609711c035/users/f23a605ef4c14d3d85d04134ed4d6f8a/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:53.591692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e911d-19eb-4d44-9814-a711431752a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce5dad95c984d7388c7c9609711c035, user_id=f23a605ef4c14d3d85d04134ed4d6f8a, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:53.598585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e911d-19eb-4d44-9814-a711431752a4 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:53.616829 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1046/2111] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:53 2022] PUT /identity/v3/projects/be10d7e1d4a04a70abac1de4b068320d/users/af2056ad640341d4925fb27eec0e7a5d/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:53.618990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8887666-7cd6-4a88-895b-ca616ba28d08 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:53.619371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8887666-7cd6-4a88-895b-ca616ba28d08 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:53.619740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8887666-7cd6-4a88-895b-ca616ba28d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:53.669354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a8887666-7cd6-4a88-895b-ca616ba28d08 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:53.671732 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a8887666-7cd6-4a88-895b-ca616ba28d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:53.746409 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:53.766069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1047/2112] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:53.768183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa375fb3-e2e2-478d-a5e0-55856aaf948e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:53.768556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa375fb3-e2e2-478d-a5e0-55856aaf948e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:53.768835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa375fb3-e2e2-478d-a5e0-55856aaf948e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:53.790621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1066/2113] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:53 2022] PUT /identity/v3/projects/0ce5dad95c984d7388c7c9609711c035/users/f23a605ef4c14d3d85d04134ed4d6f8a/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:53.790621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e911d-19eb-4d44-9814-a711431752a4 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:53.790621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-cf4e911d-19eb-4d44-9814-a711431752a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:53.812976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-fa375fb3-e2e2-478d-a5e0-55856aaf948e None None] MFA Rules not processed for user `3ec0447fe9d74375aa3e1b373916978a`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:53.815106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fa375fb3-e2e2-478d-a5e0-55856aaf948e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:53.869982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e911d-19eb-4d44-9814-a711431752a4 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:53.889567 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:53.890315 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:53.890718 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:53.890935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] PATH_INFO: `/v3/projects/ecf8dac03eb54416a4fe67dd64e0d469` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:53.892689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf8dac03eb54416a4fe67dd64e0d469)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:53.897616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:53.903174 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1048/2114] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:53.904624 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4ef3-49c0-484e-a023-7cf662d39735 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:53.904972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4ef3-49c0-484e-a023-7cf662d39735 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:53.905307 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4ef3-49c0-484e-a023-7cf662d39735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:53.940110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-418f4ef3-49c0-484e-a023-7cf662d39735 None None] MFA Rules not processed for user `af2056ad640341d4925fb27eec0e7a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:53.941665 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-418f4ef3-49c0-484e-a023-7cf662d39735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:54.016694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1049/2115] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:54.018213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb481db-4c90-48bb-9937-f5827e35b676 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:54.018509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb481db-4c90-48bb-9937-f5827e35b676 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:54.018783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb481db-4c90-48bb-9937-f5827e35b676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:54.040994 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-3eb481db-4c90-48bb-9937-f5827e35b676 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:54.042212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3eb481db-4c90-48bb-9937-f5827e35b676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:54.051565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1050/2116] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:54.052612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb481db-4c90-48bb-9937-f5827e35b676 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:54.063382 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb481db-4c90-48bb-9937-f5827e35b676 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:54.068256 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef4b0e-6692-462a-8033-2bce30ad18e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:54.068872 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef4b0e-6692-462a-8033-2bce30ad18e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:54.069150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef4b0e-6692-462a-8033-2bce30ad18e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:54.070175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef4b0e-6692-462a-8033-2bce30ad18e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:54.070979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef4b0e-6692-462a-8033-2bce30ad18e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:54.072528 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef4b0e-6692-462a-8033-2bce30ad18e4 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:54.091186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1051/2117] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:54.091186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef4b0e-6692-462a-8033-2bce30ad18e4 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:54.091186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b2ef4b0e-6692-462a-8033-2bce30ad18e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:54.166627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef4b0e-6692-462a-8033-2bce30ad18e4 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:54.178266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf8dac03eb54416a4fe67dd64e0d469', 'request_id': 'req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:54.226193 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07e3d-26bf-4fb8-9d91-82041dbb419e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:54.226811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07e3d-26bf-4fb8-9d91-82041dbb419e service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:54.227094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07e3d-26bf-4fb8-9d91-82041dbb419e service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:54.227368 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07e3d-26bf-4fb8-9d91-82041dbb419e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:54.300240 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad07e3d-26bf-4fb8-9d91-82041dbb419e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:54.301655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad07e3d-26bf-4fb8-9d91-82041dbb419e service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:54.317814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1052/2118] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:54.319215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07e3d-26bf-4fb8-9d91-82041dbb419e service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:54.321731 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-cad07e3d-26bf-4fb8-9d91-82041dbb419e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:54.372117 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf8dac03eb54416a4fe67dd64e0d469', 'request_id': 'req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:54.379551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf8dac03eb54416a4fe67dd64e0d469', 'request_id': 'req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:54.396757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] The token cache is being invalidate because project ecf8dac03eb54416a4fe67dd64e0d469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:54.397107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:54.398042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:54.400101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1067/2119] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:53 2022] DELETE /identity/v3/projects/ecf8dac03eb54416a4fe67dd64e0d469 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:54.401466 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:54.404009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07e3d-26bf-4fb8-9d91-82041dbb419e service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:54.404531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:54.410037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:54.410699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:54.411154 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:54.411281 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] PATH_INFO: `/v3/projects/e0b780a1d061475680c06cdfd779ef2f` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:54.412421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b780a1d061475680c06cdfd779ef2f)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:54.414754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:54.424047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f3c3c-f000-413a-bc0d-a9f266c0219c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:54.430101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b7af3-27a3-46af-aba1-01b58e4a070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:54.430937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b7af3-27a3-46af-aba1-01b58e4a070b admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:54.431053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b7af3-27a3-46af-aba1-01b58e4a070b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:54.431265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b7af3-27a3-46af-aba1-01b58e4a070b admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:54.431928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b7af3-27a3-46af-aba1-01b58e4a070b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:54.432235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b7af3-27a3-46af-aba1-01b58e4a070b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:54.433917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b7af3-27a3-46af-aba1-01b58e4a070b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:54.447185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1068/2120] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:54.448188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b7af3-27a3-46af-aba1-01b58e4a070b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:54.450069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-194b7af3-27a3-46af-aba1-01b58e4a070b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:54.465358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b7af3-27a3-46af-aba1-01b58e4a070b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:54.470225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1624cc-819e-4a97-b948-8115e5643d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:54.470909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1624cc-819e-4a97-b948-8115e5643d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:54.471195 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1624cc-819e-4a97-b948-8115e5643d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:54.471465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1624cc-819e-4a97-b948-8115e5643d59 admin admin] PATH_INFO: `/v3/projects/0ce5dad95c984d7388c7c9609711c035/users/f23a605ef4c14d3d85d04134ed4d6f8a/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:54.473760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1624cc-819e-4a97-b948-8115e5643d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce5dad95c984d7388c7c9609711c035, user_id=f23a605ef4c14d3d85d04134ed4d6f8a, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:54.477096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1624cc-819e-4a97-b948-8115e5643d59 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:54.489198 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1069/2121] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:54 2022] PUT /identity/v3/projects/0ce5dad95c984d7388c7c9609711c035/users/f23a605ef4c14d3d85d04134ed4d6f8a/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:54.490206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1624cc-819e-4a97-b948-8115e5643d59 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:54.492933 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0c1624cc-819e-4a97-b948-8115e5643d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:54.590974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1624cc-819e-4a97-b948-8115e5643d59 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:54.599670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431f6d9-4280-48f4-8ec0-79fb69c19ea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:54.599670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431f6d9-4280-48f4-8ec0-79fb69c19ea9 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:54.599670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431f6d9-4280-48f4-8ec0-79fb69c19ea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:54.599670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431f6d9-4280-48f4-8ec0-79fb69c19ea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:54.603628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3431f6d9-4280-48f4-8ec0-79fb69c19ea9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:54.656153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b780a1d061475680c06cdfd779ef2f', 'request_id': 'req-e6cdad29-4e8d-4b90-858a-9c3349686d8f'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:54.663724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b780a1d061475680c06cdfd779ef2f', 'request_id': 'req-e6cdad29-4e8d-4b90-858a-9c3349686d8f'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:54.691987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431f6d9-4280-48f4-8ec0-79fb69c19ea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:54.693488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431f6d9-4280-48f4-8ec0-79fb69c19ea9 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:54.704531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1070/2122] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:54.705424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431f6d9-4280-48f4-8ec0-79fb69c19ea9 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:54.706838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3431f6d9-4280-48f4-8ec0-79fb69c19ea9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:54.791355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431f6d9-4280-48f4-8ec0-79fb69c19ea9 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:54.872566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c34e9-0122-4404-a5d3-7a057626c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:54.877848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b780a1d061475680c06cdfd779ef2f', 'request_id': 'req-e6cdad29-4e8d-4b90-858a-9c3349686d8f'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:54.878602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c34e9-0122-4404-a5d3-7a057626c370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:54.878602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c34e9-0122-4404-a5d3-7a057626c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:54.878602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c34e9-0122-4404-a5d3-7a057626c370 admin admin] PATH_INFO: `/v3/users/d00eca197f7e471d82d501b04afe3d32` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:54.878602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c34e9-0122-4404-a5d3-7a057626c370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00eca197f7e471d82d501b04afe3d32)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:54.879141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c34e9-0122-4404-a5d3-7a057626c370 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:54.901753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] The token cache is being invalidate because project e0b780a1d061475680c06cdfd779ef2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:54.902236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:54.903270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:54.905892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1053/2123] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:54 2022] DELETE /identity/v3/projects/e0b780a1d061475680c06cdfd779ef2f => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:54.907207 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:54.909690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:54.932378 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdad29-4e8d-4b90-858a-9c3349686d8f admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:54.937490 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa33be0-884e-4cf7-8dbd-da9ef985de69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:54.938123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa33be0-884e-4cf7-8dbd-da9ef985de69 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:54.938400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa33be0-884e-4cf7-8dbd-da9ef985de69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:54.938721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa33be0-884e-4cf7-8dbd-da9ef985de69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:54.939374 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa33be0-884e-4cf7-8dbd-da9ef985de69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:54.941503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa33be0-884e-4cf7-8dbd-da9ef985de69 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:55.073531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1054/2124] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:54 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:55.074819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd624bf-3f3b-4825-b86a-c624d0dbbc11 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:55.075121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd624bf-3f3b-4825-b86a-c624d0dbbc11 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:55.075387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd624bf-3f3b-4825-b86a-c624d0dbbc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:55.107799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-4fd624bf-3f3b-4825-b86a-c624d0dbbc11 None None] MFA Rules not processed for user `f23a605ef4c14d3d85d04134ed4d6f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:55.109031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4fd624bf-3f3b-4825-b86a-c624d0dbbc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:55.192151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1055/2125] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:55.193973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd624bf-3f3b-4825-b86a-c624d0dbbc11 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:55.196930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4fd624bf-3f3b-4825-b86a-c624d0dbbc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:55.223984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5b8c34e9-0122-4404-a5d3-7a057626c370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00eca197f7e471d82d501b04afe3d32'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:55.244219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5b8c34e9-0122-4404-a5d3-7a057626c370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00eca197f7e471d82d501b04afe3d32'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:55.247832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:55.255021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5b8c34e9-0122-4404-a5d3-7a057626c370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00eca197f7e471d82d501b04afe3d32'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:55.296979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd624bf-3f3b-4825-b86a-c624d0dbbc11 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:55.306491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e10b0-7801-4fd2-a1fd-e0d09eb350d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:55.307191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e10b0-7801-4fd2-a1fd-e0d09eb350d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:55.307473 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e10b0-7801-4fd2-a1fd-e0d09eb350d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:55.307744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e10b0-7801-4fd2-a1fd-e0d09eb350d7 admin admin] PATH_INFO: `/v3/users/af2056ad640341d4925fb27eec0e7a5d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:55.309059 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e10b0-7801-4fd2-a1fd-e0d09eb350d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2056ad640341d4925fb27eec0e7a5d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:55.311064 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e10b0-7801-4fd2-a1fd-e0d09eb350d7 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:55.720528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5b8c34e9-0122-4404-a5d3-7a057626c370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00eca197f7e471d82d501b04afe3d32'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:55.721167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5b8c34e9-0122-4404-a5d3-7a057626c370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00eca197f7e471d82d501b04afe3d32'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:55.729295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1071/2126] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:54 2022] DELETE /identity/v3/users/d00eca197f7e471d82d501b04afe3d32 => generated 0 bytes in 1024 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:55.730807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfd38b-1320-4c65-8aed-c4bb61aa1324 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:55.731116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfd38b-1320-4c65-8aed-c4bb61aa1324 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:55.731401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfd38b-1320-4c65-8aed-c4bb61aa1324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:55.757022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-78dfd38b-1320-4c65-8aed-c4bb61aa1324 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:55.758882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-78dfd38b-1320-4c65-8aed-c4bb61aa1324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:55.849545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1072/2127] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:55.851424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfd38b-1320-4c65-8aed-c4bb61aa1324 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:55.855455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-78dfd38b-1320-4c65-8aed-c4bb61aa1324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:55.855610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-322e10b0-7801-4fd2-a1fd-e0d09eb350d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2056ad640341d4925fb27eec0e7a5d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:55.866191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-322e10b0-7801-4fd2-a1fd-e0d09eb350d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2056ad640341d4925fb27eec0e7a5d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:55.940575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfd38b-1320-4c65-8aed-c4bb61aa1324 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:55.946576 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7625633-d046-4e90-aabd-a12cd2fce9fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:55.947382 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625633-d046-4e90-aabd-a12cd2fce9fd service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:55.947816 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625633-d046-4e90-aabd-a12cd2fce9fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:55.948099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625633-d046-4e90-aabd-a12cd2fce9fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:55.950920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a7625633-d046-4e90-aabd-a12cd2fce9fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:56.026283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7625633-d046-4e90-aabd-a12cd2fce9fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:56.027874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7625633-d046-4e90-aabd-a12cd2fce9fd service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:56.038988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1073/2128] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:56.039906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7625633-d046-4e90-aabd-a12cd2fce9fd service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:56.041414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a7625633-d046-4e90-aabd-a12cd2fce9fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:56.044796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-322e10b0-7801-4fd2-a1fd-e0d09eb350d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2056ad640341d4925fb27eec0e7a5d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:56.045787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-322e10b0-7801-4fd2-a1fd-e0d09eb350d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2056ad640341d4925fb27eec0e7a5d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:56.046806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-322e10b0-7801-4fd2-a1fd-e0d09eb350d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2056ad640341d4925fb27eec0e7a5d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:56.058603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7625633-d046-4e90-aabd-a12cd2fce9fd service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:56.067345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161511c-8c4c-4ff4-b166-c142aa2a00d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:56.067985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161511c-8c4c-4ff4-b166-c142aa2a00d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:56.068266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161511c-8c4c-4ff4-b166-c142aa2a00d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:56.068551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161511c-8c4c-4ff4-b166-c142aa2a00d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:56.069325 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161511c-8c4c-4ff4-b166-c142aa2a00d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:56.071642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161511c-8c4c-4ff4-b166-c142aa2a00d0 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:56.077911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1056/2129] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:55 2022] DELETE /identity/v3/users/af2056ad640341d4925fb27eec0e7a5d => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:56.079903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eba96-bf8f-471a-b58e-77aa48ca7019 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:56.080363 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eba96-bf8f-471a-b58e-77aa48ca7019 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:56.080854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670eba96-bf8f-471a-b58e-77aa48ca7019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:56.115082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-670eba96-bf8f-471a-b58e-77aa48ca7019 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:56.116686 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-670eba96-bf8f-471a-b58e-77aa48ca7019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:56.195359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1057/2130] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:56.196145 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670eba96-bf8f-471a-b58e-77aa48ca7019 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:56.197728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-670eba96-bf8f-471a-b58e-77aa48ca7019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:56.273998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670eba96-bf8f-471a-b58e-77aa48ca7019 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:56.278169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8a63-e941-4e5b-aa0d-8662774cbed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:56.278928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8a63-e941-4e5b-aa0d-8662774cbed8 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:56.279205 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8a63-e941-4e5b-aa0d-8662774cbed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:56.279474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa8a63-e941-4e5b-aa0d-8662774cbed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:56.281881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fdfa8a63-e941-4e5b-aa0d-8662774cbed8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:56.291734 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1074/2131] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:56 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:56.293483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908901d-2747-40c6-bd37-139351183a54 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:56.293743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908901d-2747-40c6-bd37-139351183a54 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:56.294012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908901d-2747-40c6-bd37-139351183a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:56.316233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-e908901d-2747-40c6-bd37-139351183a54 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:56.317512 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e908901d-2747-40c6-bd37-139351183a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:56.328150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1075/2132] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:56.330691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908901d-2747-40c6-bd37-139351183a54 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:56.346646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908901d-2747-40c6-bd37-139351183a54 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:56.355276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bb2a4-bd0a-4717-8135-f93ea8666302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:56.356206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bb2a4-bd0a-4717-8135-f93ea8666302 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:56.356664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bb2a4-bd0a-4717-8135-f93ea8666302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:56.357033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bb2a4-bd0a-4717-8135-f93ea8666302 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:56.365065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bb2a4-bd0a-4717-8135-f93ea8666302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:56.365065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bb2a4-bd0a-4717-8135-f93ea8666302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:56.365065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bb2a4-bd0a-4717-8135-f93ea8666302 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:56.376751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1076/2133] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:56.377443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa8a63-e941-4e5b-aa0d-8662774cbed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:56.377682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bb2a4-bd0a-4717-8135-f93ea8666302 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:56.379642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ed2bb2a4-bd0a-4717-8135-f93ea8666302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:56.380431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa8a63-e941-4e5b-aa0d-8662774cbed8 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:56.393464 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1058/2134] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:56.406149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bb2a4-bd0a-4717-8135-f93ea8666302 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:56.406694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8a63-e941-4e5b-aa0d-8662774cbed8 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:56.406694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fdfa8a63-e941-4e5b-aa0d-8662774cbed8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:56.407013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181fa15-055f-450d-acf5-1cdde05f2362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:56.407013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181fa15-055f-450d-acf5-1cdde05f2362 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:56.407013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181fa15-055f-450d-acf5-1cdde05f2362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:56.407013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181fa15-055f-450d-acf5-1cdde05f2362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:56.407511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181fa15-055f-450d-acf5-1cdde05f2362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:56.407511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181fa15-055f-450d-acf5-1cdde05f2362 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:56.416003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1077/2135] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:56.416978 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181fa15-055f-450d-acf5-1cdde05f2362 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:56.442045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181fa15-055f-450d-acf5-1cdde05f2362 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:56.448331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e9b8d-a9eb-43e5-b6ba-6e95a0689625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:56.449067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e9b8d-a9eb-43e5-b6ba-6e95a0689625 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:56.449515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e9b8d-a9eb-43e5-b6ba-6e95a0689625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:56.449932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e9b8d-a9eb-43e5-b6ba-6e95a0689625 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:56.450696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e9b8d-a9eb-43e5-b6ba-6e95a0689625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:56.453352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e9b8d-a9eb-43e5-b6ba-6e95a0689625 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:56.483259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa8a63-e941-4e5b-aa0d-8662774cbed8 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:56.500845 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b4a2a-5447-4ee9-884b-4a22935b2d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:56.500845 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b4a2a-5447-4ee9-884b-4a22935b2d1f service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:56.500845 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b4a2a-5447-4ee9-884b-4a22935b2d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:56.500845 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b4a2a-5447-4ee9-884b-4a22935b2d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:56.503842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b4a2a-5447-4ee9-884b-4a22935b2d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:56.503842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b4a2a-5447-4ee9-884b-4a22935b2d1f service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:56.518291 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1059/2136] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:56.519535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b4a2a-5447-4ee9-884b-4a22935b2d1f service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:56.521118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e85b4a2a-5447-4ee9-884b-4a22935b2d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:56.538250 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b4a2a-5447-4ee9-884b-4a22935b2d1f service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:56.544090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:56.544774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:56.545069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:56.545346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] PATH_INFO: `/v3/projects/e1a87b86a5724d268eda731bb8eae288` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:56.546698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a87b86a5724d268eda731bb8eae288)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:56.548665 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:56.587648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1078/2137] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:56 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:56.590102 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e9b8d-a9eb-43e5-b6ba-6e95a0689625 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:56.677679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e9b8d-a9eb-43e5-b6ba-6e95a0689625 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:56.684154 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daa484-3ca2-4430-8e79-a515a096dd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:56.684760 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daa484-3ca2-4430-8e79-a515a096dd4e admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:56.685041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daa484-3ca2-4430-8e79-a515a096dd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:56.685318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8daa484-3ca2-4430-8e79-a515a096dd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:56.686029 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8daa484-3ca2-4430-8e79-a515a096dd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:56.687623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8daa484-3ca2-4430-8e79-a515a096dd4e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:56.699353 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1079/2138] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:56.700262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daa484-3ca2-4430-8e79-a515a096dd4e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:56.711728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8daa484-3ca2-4430-8e79-a515a096dd4e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:56.716475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19b46a-a953-46f0-980e-01687a9d6a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:56.717071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19b46a-a953-46f0-980e-01687a9d6a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:56.717350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19b46a-a953-46f0-980e-01687a9d6a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:56.717648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19b46a-a953-46f0-980e-01687a9d6a6a admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:56.718331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19b46a-a953-46f0-980e-01687a9d6a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:56.720282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19b46a-a953-46f0-980e-01687a9d6a6a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:56.841101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a87b86a5724d268eda731bb8eae288', 'request_id': 'req-2cd18713-438c-403c-9b37-25c88ea8fb2d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:56.855769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a87b86a5724d268eda731bb8eae288', 'request_id': 'req-2cd18713-438c-403c-9b37-25c88ea8fb2d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:56.890304 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1080/2139] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:56 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:56.890304 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19b46a-a953-46f0-980e-01687a9d6a6a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:56.912086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19b46a-a953-46f0-980e-01687a9d6a6a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:57.029947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ae1d7-1da2-4ff2-8506-ee195586d0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:57.031037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ae1d7-1da2-4ff2-8506-ee195586d0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:57.031404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ae1d7-1da2-4ff2-8506-ee195586d0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:57.031810 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ae1d7-1da2-4ff2-8506-ee195586d0c4 admin admin] PATH_INFO: `/v3/projects/c8fab6b7fbde40e3aec32324f6ba78b6/users/aafebb9172ab4fc0a2034f4297d9a0fe/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:57.049568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ae1d7-1da2-4ff2-8506-ee195586d0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fab6b7fbde40e3aec32324f6ba78b6, user_id=aafebb9172ab4fc0a2034f4297d9a0fe, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:57.052640 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ae1d7-1da2-4ff2-8506-ee195586d0c4 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:57.065021 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a87b86a5724d268eda731bb8eae288', 'request_id': 'req-2cd18713-438c-403c-9b37-25c88ea8fb2d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:57.088631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] The token cache is being invalidate because project e1a87b86a5724d268eda731bb8eae288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:57.089233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:57.090650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:57.093717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1060/2140] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:56 2022] DELETE /identity/v3/projects/e1a87b86a5724d268eda731bb8eae288 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:57.095120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:57.097362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:57.124029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd18713-438c-403c-9b37-25c88ea8fb2d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:57.135115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9a134-f52f-400f-a2bd-614bf5a00e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:57.136501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9a134-f52f-400f-a2bd-614bf5a00e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:57.136803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9a134-f52f-400f-a2bd-614bf5a00e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:57.137320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9a134-f52f-400f-a2bd-614bf5a00e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:57.138551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9a134-f52f-400f-a2bd-614bf5a00e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:57.142584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9a134-f52f-400f-a2bd-614bf5a00e82 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:57.162838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1061/2141] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:57.164846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9a134-f52f-400f-a2bd-614bf5a00e82 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:57.167976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c5f9a134-f52f-400f-a2bd-614bf5a00e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:57.171783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1081/2142] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:56 2022] PUT /identity/v3/projects/c8fab6b7fbde40e3aec32324f6ba78b6/users/aafebb9172ab4fc0a2034f4297d9a0fe/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:57.172914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fa58c-27df-4f66-8183-01834e5d8776 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:57.173208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fa58c-27df-4f66-8183-01834e5d8776 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:57.173521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fa58c-27df-4f66-8183-01834e5d8776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:57.188154 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9a134-f52f-400f-a2bd-614bf5a00e82 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:57.199566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-b47fa58c-27df-4f66-8183-01834e5d8776 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:57.201456 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b47fa58c-27df-4f66-8183-01834e5d8776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:57.260635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:57.261423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:57.261857 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:57.262273 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] PATH_INFO: `/v3/users/a9f4056056d5446481b99b61972ee346` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:57.263956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f4056056d5446481b99b61972ee346)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:57.266510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:57.288057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1082/2143] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:57.289669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fa58c-27df-4f66-8183-01834e5d8776 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:57.301714 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fa58c-27df-4f66-8183-01834e5d8776 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:57.306203 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601a35d-6ac1-4e4d-8c9c-d1b7ca37ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:57.306819 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601a35d-6ac1-4e4d-8c9c-d1b7ca37ab35 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:57.307104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601a35d-6ac1-4e4d-8c9c-d1b7ca37ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:57.307381 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601a35d-6ac1-4e4d-8c9c-d1b7ca37ab35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:57.308036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601a35d-6ac1-4e4d-8c9c-d1b7ca37ab35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:57.309692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601a35d-6ac1-4e4d-8c9c-d1b7ca37ab35 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:57.321664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1083/2144] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:57.323021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca4c0-f943-436e-8247-6dff643449bc None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:57.323317 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca4c0-f943-436e-8247-6dff643449bc None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:57.323593 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdca4c0-f943-436e-8247-6dff643449bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:57.360828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5cdca4c0-f943-436e-8247-6dff643449bc None None] MFA Rules not processed for user `aafebb9172ab4fc0a2034f4297d9a0fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:57.364063 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5cdca4c0-f943-436e-8247-6dff643449bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:57.421030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:57.449232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1084/2145] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:57.450560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c3df9-06f7-4fe6-8151-ef4845bfc7d3 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:57.450843 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c3df9-06f7-4fe6-8151-ef4845bfc7d3 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:57.451390 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c3df9-06f7-4fe6-8151-ef4845bfc7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:57.472998 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-684c3df9-06f7-4fe6-8151-ef4845bfc7d3 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:57.474530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-684c3df9-06f7-4fe6-8151-ef4845bfc7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:57.484003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1085/2146] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:57.484850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c3df9-06f7-4fe6-8151-ef4845bfc7d3 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:57.496263 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c3df9-06f7-4fe6-8151-ef4845bfc7d3 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:57.501106 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49852-e64c-4b5f-922d-388d062ba890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:57.501802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49852-e64c-4b5f-922d-388d062ba890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:57.502083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49852-e64c-4b5f-922d-388d062ba890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:57.502359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a49852-e64c-4b5f-922d-388d062ba890 admin admin] PATH_INFO: `/v3/projects/2c554e5f7ba8459d87ff5ecb7fa5d72d/users/78e7f0a4eaee428f8510f1b358d6d3c5/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:57.522752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a49852-e64c-4b5f-922d-388d062ba890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c554e5f7ba8459d87ff5ecb7fa5d72d, user_id=78e7f0a4eaee428f8510f1b358d6d3c5, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:57.525769 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a49852-e64c-4b5f-922d-388d062ba890 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:57.774180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1086/2147] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:57 2022] PUT /identity/v3/projects/2c554e5f7ba8459d87ff5ecb7fa5d72d/users/78e7f0a4eaee428f8510f1b358d6d3c5/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:57.777653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49852-e64c-4b5f-922d-388d062ba890 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:57.788543 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f4056056d5446481b99b61972ee346'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:57.790663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f6a49852-e64c-4b5f-922d-388d062ba890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:57.805229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f4056056d5446481b99b61972ee346'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:57.894816 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a49852-e64c-4b5f-922d-388d062ba890 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:57.899856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:57.900500 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:57.903892 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:57.903892 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13 admin admin] PATH_INFO: `/v3/projects/be10d7e1d4a04a70abac1de4b068320d` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:57.903892 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be10d7e1d4a04a70abac1de4b068320d)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:57.904278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:57.929751 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f4056056d5446481b99b61972ee346'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:57.937868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f4056056d5446481b99b61972ee346'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:57.937868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f4056056d5446481b99b61972ee346'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:57.950251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1062/2148] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:57 2022] DELETE /identity/v3/users/a9f4056056d5446481b99b61972ee346 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:57.951106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:57.952497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:58.007000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:43:58.034760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21931be9-6af7-4e0a-bcee-f32430e84058 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:58.041873 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d29eb2-00cf-4042-96ba-5923871ec033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:58.042499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d29eb2-00cf-4042-96ba-5923871ec033 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:58.042780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d29eb2-00cf-4042-96ba-5923871ec033 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:58.043055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d29eb2-00cf-4042-96ba-5923871ec033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:58.044859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d5d29eb2-00cf-4042-96ba-5923871ec033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:58.117979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d29eb2-00cf-4042-96ba-5923871ec033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:58.120130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d29eb2-00cf-4042-96ba-5923871ec033 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:58.130486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1063/2149] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:58.134517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d29eb2-00cf-4042-96ba-5923871ec033 service nova] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:58.136793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d5d29eb2-00cf-4042-96ba-5923871ec033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:58.192217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be10d7e1d4a04a70abac1de4b068320d', 'request_id': 'req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:58.234945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d29eb2-00cf-4042-96ba-5923871ec033 service nova] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:58.297002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be10d7e1d4a04a70abac1de4b068320d', 'request_id': 'req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:58.304064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be10d7e1d4a04a70abac1de4b068320d', 'request_id': 'req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:58.306403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afa3b8-59f6-45bd-8dd0-18b395f5ff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:58.307054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa3b8-59f6-45bd-8dd0-18b395f5ff0d admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:58.307328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa3b8-59f6-45bd-8dd0-18b395f5ff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:58.309559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afa3b8-59f6-45bd-8dd0-18b395f5ff0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:58.309559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afa3b8-59f6-45bd-8dd0-18b395f5ff0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:58.309559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afa3b8-59f6-45bd-8dd0-18b395f5ff0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:58.310201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72afa3b8-59f6-45bd-8dd0-18b395f5ff0d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:58.319257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13 admin admin] The token cache is being invalidate because project be10d7e1d4a04a70abac1de4b068320d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:43:58.319745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:58.320653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-f6527f9b-7f7b-4a77-9f16-94a1f55bae13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:58.322281 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1087/2150] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:57 2022] DELETE /identity/v3/projects/be10d7e1d4a04a70abac1de4b068320d => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:58.323673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9554ce-93a1-49e3-ad9d-c7763101cf13 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:58.324095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9554ce-93a1-49e3-ad9d-c7763101cf13 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:58.324521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9554ce-93a1-49e3-ad9d-c7763101cf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:58.330194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1064/2151] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:58.331570 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871fd7d-93f1-49a5-80d1-08872647782e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:58.331864 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871fd7d-93f1-49a5-80d1-08872647782e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:58.332173 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871fd7d-93f1-49a5-80d1-08872647782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:58.354883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-6871fd7d-93f1-49a5-80d1-08872647782e None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:58.356146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6871fd7d-93f1-49a5-80d1-08872647782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:58.359509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-8d9554ce-93a1-49e3-ad9d-c7763101cf13 None None] MFA Rules not processed for user `78e7f0a4eaee428f8510f1b358d6d3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:58.360773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8d9554ce-93a1-49e3-ad9d-c7763101cf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:58.366200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1065/2152] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:58.368029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e21cd-0156-42c6-b642-d88aea35a1ca None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:58.368313 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e21cd-0156-42c6-b642-d88aea35a1ca None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:58.368668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e21cd-0156-42c6-b642-d88aea35a1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:58.395668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-9b0e21cd-0156-42c6-b642-d88aea35a1ca None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:58.398867 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9b0e21cd-0156-42c6-b642-d88aea35a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:58.409416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1066/2153] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:58.409416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e21cd-0156-42c6-b642-d88aea35a1ca None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:58.410873 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9b0e21cd-0156-42c6-b642-d88aea35a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:58.428993 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e21cd-0156-42c6-b642-d88aea35a1ca None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:58.434622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f0feb-5b36-4c31-a515-05eb37aa9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:58.435364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f0feb-5b36-4c31-a515-05eb37aa9f13 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:58.435644 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f0feb-5b36-4c31-a515-05eb37aa9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:58.435914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f0feb-5b36-4c31-a515-05eb37aa9f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:58.436646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f0feb-5b36-4c31-a515-05eb37aa9f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:58.438687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991f0feb-5b36-4c31-a515-05eb37aa9f13 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:58.455082 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1088/2154] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:58.455976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9554ce-93a1-49e3-ad9d-c7763101cf13 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:58.457417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8d9554ce-93a1-49e3-ad9d-c7763101cf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:58.535443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9554ce-93a1-49e3-ad9d-c7763101cf13 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:58.540177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e49b0-c457-40e1-a711-fe2f097b0e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:58.540828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e49b0-c457-40e1-a711-fe2f097b0e0a service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:58.541548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e49b0-c457-40e1-a711-fe2f097b0e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:58.542094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e49b0-c457-40e1-a711-fe2f097b0e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:58.557920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e49b0-c457-40e1-a711-fe2f097b0e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:58.557920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e49b0-c457-40e1-a711-fe2f097b0e0a service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:58.569932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1089/2155] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:43:58.572236 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971b811-f5a8-4b10-b09d-a901fafe4c6b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:58.572642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971b811-f5a8-4b10-b09d-a901fafe4c6b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:58.573093 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971b811-f5a8-4b10-b09d-a901fafe4c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:58.610458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1067/2156] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:58 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:58.611874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-e971b811-f5a8-4b10-b09d-a901fafe4c6b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:43:58.612811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f0feb-5b36-4c31-a515-05eb37aa9f13 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:58.615048 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e971b811-f5a8-4b10-b09d-a901fafe4c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:58.617571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-991f0feb-5b36-4c31-a515-05eb37aa9f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:58.737772 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991f0feb-5b36-4c31-a515-05eb37aa9f13 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:58.746288 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357069f-8fd0-43da-add7-e146ef556327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:58.746925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357069f-8fd0-43da-add7-e146ef556327 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:58.747349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357069f-8fd0-43da-add7-e146ef556327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:58.747628 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357069f-8fd0-43da-add7-e146ef556327 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:58.748268 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357069f-8fd0-43da-add7-e146ef556327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:58.753183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357069f-8fd0-43da-add7-e146ef556327 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:58.764939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1090/2157] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:43:58.766009 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971b811-f5a8-4b10-b09d-a901fafe4c6b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:58.780475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971b811-f5a8-4b10-b09d-a901fafe4c6b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:58.785284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47f12d-f6b6-4395-bd3d-def2cfb70edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:58.785949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47f12d-f6b6-4395-bd3d-def2cfb70edb admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:58.786224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47f12d-f6b6-4395-bd3d-def2cfb70edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:58.786538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47f12d-f6b6-4395-bd3d-def2cfb70edb admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:58.787334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47f12d-f6b6-4395-bd3d-def2cfb70edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:58.789518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47f12d-f6b6-4395-bd3d-def2cfb70edb admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:58.937063 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1091/2158] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:58 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:58.938269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47f12d-f6b6-4395-bd3d-def2cfb70edb admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:58.940473 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1068/2159] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:58 2022] POST /identity/v3/projects => generated 385 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:58.943042 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357069f-8fd0-43da-add7-e146ef556327 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:58.950592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-aa47f12d-f6b6-4395-bd3d-def2cfb70edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:58.967606 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47f12d-f6b6-4395-bd3d-def2cfb70edb admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:59.060283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357069f-8fd0-43da-add7-e146ef556327 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:59.066917 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5c924-1871-441b-9f51-eee2a3d7da62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:59.068241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5c924-1871-441b-9f51-eee2a3d7da62 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:59.068241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5c924-1871-441b-9f51-eee2a3d7da62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:59.068241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5c924-1871-441b-9f51-eee2a3d7da62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:59.069224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5c924-1871-441b-9f51-eee2a3d7da62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:43:59.069948 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5c924-1871-441b-9f51-eee2a3d7da62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:59.071730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5c924-1871-441b-9f51-eee2a3d7da62 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:59.097846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1069/2160] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:43:59.097846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5c924-1871-441b-9f51-eee2a3d7da62 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:59.113279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5c924-1871-441b-9f51-eee2a3d7da62 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:59.119051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d0bb4-2550-427f-8364-53a0f8b77c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:59.119824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d0bb4-2550-427f-8364-53a0f8b77c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:59.120209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d0bb4-2550-427f-8364-53a0f8b77c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:59.120588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d0bb4-2550-427f-8364-53a0f8b77c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:59.121346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d0bb4-2550-427f-8364-53a0f8b77c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:59.123379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d0bb4-2550-427f-8364-53a0f8b77c67 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:59.123573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:59.124806 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:59.125749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:59.126237 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] PATH_INFO: `/v3/users/aafebb9172ab4fc0a2034f4297d9a0fe` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:59.128918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aafebb9172ab4fc0a2034f4297d9a0fe)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:59.134015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:59.141458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1070/2161] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:59.141458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d0bb4-2550-427f-8364-53a0f8b77c67 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:59.160604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d0bb4-2550-427f-8364-53a0f8b77c67 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:59.168061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad009ac-7f84-4e4a-b480-808b4b4dd893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:59.168710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad009ac-7f84-4e4a-b480-808b4b4dd893 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:59.169037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad009ac-7f84-4e4a-b480-808b4b4dd893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:59.169319 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad009ac-7f84-4e4a-b480-808b4b4dd893 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:59.170113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad009ac-7f84-4e4a-b480-808b4b4dd893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:59.172247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad009ac-7f84-4e4a-b480-808b4b4dd893 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:59.326911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1071/2162] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:59 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:59.327805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad009ac-7f84-4e4a-b480-808b4b4dd893 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:59.339237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad009ac-7f84-4e4a-b480-808b4b4dd893 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:59.345354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3339a-e07c-4cd2-9244-fbf97d8fd867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:59.346016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3339a-e07c-4cd2-9244-fbf97d8fd867 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:59.346303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3339a-e07c-4cd2-9244-fbf97d8fd867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:59.346573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3339a-e07c-4cd2-9244-fbf97d8fd867 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:59.347216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3339a-e07c-4cd2-9244-fbf97d8fd867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:59.349438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3339a-e07c-4cd2-9244-fbf97d8fd867 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:59.482690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1072/2163] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:43:59 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:59.482690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3339a-e07c-4cd2-9244-fbf97d8fd867 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:59.483067 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aafebb9172ab4fc0a2034f4297d9a0fe'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:59.510332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aafebb9172ab4fc0a2034f4297d9a0fe'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:59.519925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aafebb9172ab4fc0a2034f4297d9a0fe'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:59.597929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3339a-e07c-4cd2-9244-fbf97d8fd867 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:59.604008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52cbde-6a5d-49ab-a5c3-b46df5fd2d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:59.604643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52cbde-6a5d-49ab-a5c3-b46df5fd2d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:59.604925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52cbde-6a5d-49ab-a5c3-b46df5fd2d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:59.605201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52cbde-6a5d-49ab-a5c3-b46df5fd2d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:59.605956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52cbde-6a5d-49ab-a5c3-b46df5fd2d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:59.607626 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52cbde-6a5d-49ab-a5c3-b46df5fd2d6a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:59.619646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1073/2164] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:59.620700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52cbde-6a5d-49ab-a5c3-b46df5fd2d6a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:59.632236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52cbde-6a5d-49ab-a5c3-b46df5fd2d6a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:59.637604 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20c658-28f7-4e3b-8aaf-f3c4ff546f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:59.638236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20c658-28f7-4e3b-8aaf-f3c4ff546f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:59.638522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20c658-28f7-4e3b-8aaf-f3c4ff546f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:59.638799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20c658-28f7-4e3b-8aaf-f3c4ff546f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:59.639449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20c658-28f7-4e3b-8aaf-f3c4ff546f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:59.641079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20c658-28f7-4e3b-8aaf-f3c4ff546f15 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:59.652056 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aafebb9172ab4fc0a2034f4297d9a0fe'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:59.652870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aafebb9172ab4fc0a2034f4297d9a0fe'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:59.654135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1074/2165] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:43:59.655344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20c658-28f7-4e3b-8aaf-f3c4ff546f15 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:59.657400 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2a20c658-28f7-4e3b-8aaf-f3c4ff546f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:59.664640 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1092/2166] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:43:58 2022] DELETE /identity/v3/users/aafebb9172ab4fc0a2034f4297d9a0fe => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:43:59.666265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:59.668828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:59.683362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20c658-28f7-4e3b-8aaf-f3c4ff546f15 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:59.761648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:59.763110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:59.763110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:59.763110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] PATH_INFO: `/v3/projects/5517b532b8e54ed99277742404361ce8` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:59.764494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5517b532b8e54ed99277742404361ce8)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:59.767800 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:59.784085 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f04a0-2f81-4910-a915-3649d2108b59 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:43:59.794509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019723e-83af-4834-ac9b-bf0f539cb471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:43:59.795586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019723e-83af-4834-ac9b-bf0f539cb471 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:43:59.796176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019723e-83af-4834-ac9b-bf0f539cb471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:43:59.796622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019723e-83af-4834-ac9b-bf0f539cb471 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:43:59.797661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019723e-83af-4834-ac9b-bf0f539cb471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:43:59.801462 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019723e-83af-4834-ac9b-bf0f539cb471 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:43:59.946916 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5517b532b8e54ed99277742404361ce8', 'request_id': 'req-ed8e6ad4-66d0-415e-b78e-91058e61715e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:59.960668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5517b532b8e54ed99277742404361ce8', 'request_id': 'req-ed8e6ad4-66d0-415e-b78e-91058e61715e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:43:59.977128 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1093/2167] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:43:59 2022] POST /identity/v3/users => generated 288 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:43:59.978639 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019723e-83af-4834-ac9b-bf0f539cb471 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:43:59.981541 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8019723e-83af-4834-ac9b-bf0f539cb471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:43:59.999420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019723e-83af-4834-ac9b-bf0f539cb471 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:00.059633 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f2191-cda8-44ba-be56-2fd328d91680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:00.060323 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f2191-cda8-44ba-be56-2fd328d91680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:00.060600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f2191-cda8-44ba-be56-2fd328d91680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:00.060872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f2191-cda8-44ba-be56-2fd328d91680 admin admin] PATH_INFO: `/v3/projects/85534645c64443d4bde0d2642f4a9cc2/users/774feb8667d8464bb11412cbda07e066/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:00.077739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f2191-cda8-44ba-be56-2fd328d91680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85534645c64443d4bde0d2642f4a9cc2, user_id=774feb8667d8464bb11412cbda07e066, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:00.080434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f2191-cda8-44ba-be56-2fd328d91680 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:00.100821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5517b532b8e54ed99277742404361ce8', 'request_id': 'req-ed8e6ad4-66d0-415e-b78e-91058e61715e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:00.116359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] The token cache is being invalidate because project 5517b532b8e54ed99277742404361ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:00.116359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:00.116359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:00.116359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1075/2168] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:43:59 2022] DELETE /identity/v3/projects/5517b532b8e54ed99277742404361ce8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:00.116359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:00.117649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:00.130769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e6ad4-66d0-415e-b78e-91058e61715e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:00.136635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfb755-3487-45e3-b31b-e82584ae7165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:00.137301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfb755-3487-45e3-b31b-e82584ae7165 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:00.137620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfb755-3487-45e3-b31b-e82584ae7165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:00.137895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfb755-3487-45e3-b31b-e82584ae7165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:00.138590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfb755-3487-45e3-b31b-e82584ae7165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:00.140219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfb755-3487-45e3-b31b-e82584ae7165 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:00.153837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1076/2169] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:00.163878 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbe259-273e-4a5c-9116-b1a937849350 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:00.163878 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbe259-273e-4a5c-9116-b1a937849350 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:00.163878 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bbe259-273e-4a5c-9116-b1a937849350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:00.177991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-34bbe259-273e-4a5c-9116-b1a937849350 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:00.179724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-34bbe259-273e-4a5c-9116-b1a937849350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:00.193610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1077/2170] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:00.196259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbe259-273e-4a5c-9116-b1a937849350 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:00.198937 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-34bbe259-273e-4a5c-9116-b1a937849350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:00.222175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bbe259-273e-4a5c-9116-b1a937849350 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:00.230775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:00.231836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:00.232204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:00.232429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] PATH_INFO: `/v3/users/e31b35e7cbf34632810edf4c6ba39966` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:00.234248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31b35e7cbf34632810edf4c6ba39966)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:00.236238 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:00.254642 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1094/2171] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:43:59 2022] PUT /identity/v3/projects/85534645c64443d4bde0d2642f4a9cc2/users/774feb8667d8464bb11412cbda07e066/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:00.261103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f2191-cda8-44ba-be56-2fd328d91680 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:00.261103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-790f2191-cda8-44ba-be56-2fd328d91680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:00.341982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f2191-cda8-44ba-be56-2fd328d91680 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:00.346960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e0f98-6ce7-48f3-83a7-0ff6dee48917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:00.347590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e0f98-6ce7-48f3-83a7-0ff6dee48917 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:00.347872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e0f98-6ce7-48f3-83a7-0ff6dee48917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:00.348397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e0f98-6ce7-48f3-83a7-0ff6dee48917 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:00.349057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e0f98-6ce7-48f3-83a7-0ff6dee48917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:00.350956 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e0f98-6ce7-48f3-83a7-0ff6dee48917 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:00.371228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1095/2172] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:00.386022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e0f98-6ce7-48f3-83a7-0ff6dee48917 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:00.386022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-cb7e0f98-6ce7-48f3-83a7-0ff6dee48917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:00.395507 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e0f98-6ce7-48f3-83a7-0ff6dee48917 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:00.402262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e83e14-6cf0-48c0-8e92-dd6e12346945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:00.403044 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83e14-6cf0-48c0-8e92-dd6e12346945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:00.403417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83e14-6cf0-48c0-8e92-dd6e12346945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:00.403784 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e83e14-6cf0-48c0-8e92-dd6e12346945 admin admin] PATH_INFO: `/v3/users/f23a605ef4c14d3d85d04134ed4d6f8a` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:00.405175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e83e14-6cf0-48c0-8e92-dd6e12346945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23a605ef4c14d3d85d04134ed4d6f8a)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:00.407809 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e83e14-6cf0-48c0-8e92-dd6e12346945 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:00.526904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31b35e7cbf34632810edf4c6ba39966'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:00.537933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31b35e7cbf34632810edf4c6ba39966'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:00.958632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31b35e7cbf34632810edf4c6ba39966'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:00.960633 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31b35e7cbf34632810edf4c6ba39966'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:00.960993 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31b35e7cbf34632810edf4c6ba39966'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:00.981639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1078/2173] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:00 2022] DELETE /identity/v3/users/e31b35e7cbf34632810edf4c6ba39966 => generated 0 bytes in 787 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:00.982496 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:00.983908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:01.066155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2a749-7cc1-4120-ae36-a141869d052d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:01.073221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce3c44-19e6-4785-a0ec-11d2fd3eddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:01.074163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3c44-19e6-4785-a0ec-11d2fd3eddb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:01.074517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3c44-19e6-4785-a0ec-11d2fd3eddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:01.074885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3c44-19e6-4785-a0ec-11d2fd3eddb9 admin admin] PATH_INFO: `/v3/projects/caa227816987426b8bd51cadc9a0970f/users/b703ab1c497f439c9c4f89fda5506eca/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:01.095002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce3c44-19e6-4785-a0ec-11d2fd3eddb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caa227816987426b8bd51cadc9a0970f, user_id=b703ab1c497f439c9c4f89fda5506eca, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:01.097895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce3c44-19e6-4785-a0ec-11d2fd3eddb9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:01.125867 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:01.142124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-35e83e14-6cf0-48c0-8e92-dd6e12346945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23a605ef4c14d3d85d04134ed4d6f8a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:01.211689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-35e83e14-6cf0-48c0-8e92-dd6e12346945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23a605ef4c14d3d85d04134ed4d6f8a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:01.211689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-35e83e14-6cf0-48c0-8e92-dd6e12346945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23a605ef4c14d3d85d04134ed4d6f8a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:01.817046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-35e83e14-6cf0-48c0-8e92-dd6e12346945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23a605ef4c14d3d85d04134ed4d6f8a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:01.817666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-35e83e14-6cf0-48c0-8e92-dd6e12346945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23a605ef4c14d3d85d04134ed4d6f8a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:01.824069 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1079/2174] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:00 2022] PUT /identity/v3/projects/caa227816987426b8bd51cadc9a0970f/users/b703ab1c497f439c9c4f89fda5506eca/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:01.824960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce3c44-19e6-4785-a0ec-11d2fd3eddb9 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:01.826789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-51ce3c44-19e6-4785-a0ec-11d2fd3eddb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:01.830142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1096/2175] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:00 2022] DELETE /identity/v3/users/f23a605ef4c14d3d85d04134ed4d6f8a => generated 0 bytes in 1455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:01.830142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae060127-5939-486b-a80f-bd818b05e5d5 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:01.830142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae060127-5939-486b-a80f-bd818b05e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:01.830142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae060127-5939-486b-a80f-bd818b05e5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:01.870895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-ae060127-5939-486b-a80f-bd818b05e5d5 None None] MFA Rules not processed for user `774feb8667d8464bb11412cbda07e066`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:01.872313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ae060127-5939-486b-a80f-bd818b05e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:01.923688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce3c44-19e6-4785-a0ec-11d2fd3eddb9 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:01.960798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1097/2176] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:01.962558 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae060127-5939-486b-a80f-bd818b05e5d5 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:01.971184 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ae060127-5939-486b-a80f-bd818b05e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:01.992808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b5e6e-34c3-4203-8740-0be0a2baf8d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:01.993646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b5e6e-34c3-4203-8740-0be0a2baf8d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:01.994030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b5e6e-34c3-4203-8740-0be0a2baf8d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:01.994390 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b5e6e-34c3-4203-8740-0be0a2baf8d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:01.996175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c43b5e6e-34c3-4203-8740-0be0a2baf8d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:02.039932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae060127-5939-486b-a80f-bd818b05e5d5 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:02.044751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86632775-2a6b-40d8-93cf-e4fcd97a8e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:02.051443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86632775-2a6b-40d8-93cf-e4fcd97a8e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:02.051443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86632775-2a6b-40d8-93cf-e4fcd97a8e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:02.051443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86632775-2a6b-40d8-93cf-e4fcd97a8e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:02.051443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86632775-2a6b-40d8-93cf-e4fcd97a8e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:02.051443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86632775-2a6b-40d8-93cf-e4fcd97a8e8b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:02.061756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1098/2177] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:02.061756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4083f-a183-449c-853a-bbe12bcb4182 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:02.061756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4083f-a183-449c-853a-bbe12bcb4182 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:02.061756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4083f-a183-449c-853a-bbe12bcb4182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:02.071815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b5e6e-34c3-4203-8740-0be0a2baf8d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:02.073203 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b5e6e-34c3-4203-8740-0be0a2baf8d8 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:02.081419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-a7e4083f-a183-449c-853a-bbe12bcb4182 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:02.081419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a7e4083f-a183-449c-853a-bbe12bcb4182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:02.084336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1080/2178] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:02.091232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1099/2179] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:02.092536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4083f-a183-449c-853a-bbe12bcb4182 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:02.100146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc4cf3-4e56-4731-a16e-cab561a3bebd None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:02.100146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc4cf3-4e56-4731-a16e-cab561a3bebd None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:02.100146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc4cf3-4e56-4731-a16e-cab561a3bebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:02.103307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a7e4083f-a183-449c-853a-bbe12bcb4182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:02.115898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4083f-a183-449c-853a-bbe12bcb4182 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:02.124601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4df23b-06a5-4d52-a94c-2fb4c7bad093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:02.128120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4df23b-06a5-4d52-a94c-2fb4c7bad093 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:02.128120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4df23b-06a5-4d52-a94c-2fb4c7bad093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:02.128120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4df23b-06a5-4d52-a94c-2fb4c7bad093 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:02.132578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4df23b-06a5-4d52-a94c-2fb4c7bad093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:02.133765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4df23b-06a5-4d52-a94c-2fb4c7bad093 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:02.136662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-69bc4cf3-4e56-4731-a16e-cab561a3bebd None None] MFA Rules not processed for user `b703ab1c497f439c9c4f89fda5506eca`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:02.138432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-69bc4cf3-4e56-4731-a16e-cab561a3bebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:02.233295 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1081/2180] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:02.234459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc4cf3-4e56-4731-a16e-cab561a3bebd None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:02.247567 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc4cf3-4e56-4731-a16e-cab561a3bebd None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:02.252662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dde8fa-7887-4165-a6ee-9451f42a618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:02.253348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dde8fa-7887-4165-a6ee-9451f42a618a admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:02.253652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dde8fa-7887-4165-a6ee-9451f42a618a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:02.253935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dde8fa-7887-4165-a6ee-9451f42a618a admin admin] PATH_INFO: `/v3/projects/59eac69d216046248710f1df59c9af0c/users/4e93f5d75a4040f98bd7d525f61754b3/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:02.276660 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dde8fa-7887-4165-a6ee-9451f42a618a admin admin] RBAC: Authorizing `identity:create_grant(project_id=59eac69d216046248710f1df59c9af0c, user_id=4e93f5d75a4040f98bd7d525f61754b3, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:02.296092 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dde8fa-7887-4165-a6ee-9451f42a618a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:02.307337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1100/2181] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:02 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:02.309175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4df23b-06a5-4d52-a94c-2fb4c7bad093 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:02.396445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1082/2182] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:02 2022] PUT /identity/v3/projects/59eac69d216046248710f1df59c9af0c/users/4e93f5d75a4040f98bd7d525f61754b3/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:02.396698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dde8fa-7887-4165-a6ee-9451f42a618a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:02.399397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-06dde8fa-7887-4165-a6ee-9451f42a618a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:02.429639 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4df23b-06a5-4d52-a94c-2fb4c7bad093 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:02.524078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b08077-d9c1-40aa-8b5b-668365fbbf79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:02.524428 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b08077-d9c1-40aa-8b5b-668365fbbf79 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:02.524736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b08077-d9c1-40aa-8b5b-668365fbbf79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:02.524939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b08077-d9c1-40aa-8b5b-668365fbbf79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:02.526317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dde8fa-7887-4165-a6ee-9451f42a618a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:02.536265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b08077-d9c1-40aa-8b5b-668365fbbf79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:02.536479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e77d48-5726-49ea-b809-6dd79fe6b021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:02.537542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e77d48-5726-49ea-b809-6dd79fe6b021 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:02.537869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b08077-d9c1-40aa-8b5b-668365fbbf79 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:02.538073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e77d48-5726-49ea-b809-6dd79fe6b021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:02.538964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e77d48-5726-49ea-b809-6dd79fe6b021 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:02.543476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e77d48-5726-49ea-b809-6dd79fe6b021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:02.544884 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e77d48-5726-49ea-b809-6dd79fe6b021 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:02.550595 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1101/2183] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:02.551745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b08077-d9c1-40aa-8b5b-668365fbbf79 service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:02.566692 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b08077-d9c1-40aa-8b5b-668365fbbf79 service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:02.574966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7dd29-12fe-4c2b-b855-2fcf3f888ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:02.575624 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7dd29-12fe-4c2b-b855-2fcf3f888ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:02.576053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7dd29-12fe-4c2b-b855-2fcf3f888ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:02.576460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7dd29-12fe-4c2b-b855-2fcf3f888ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:02.577328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7dd29-12fe-4c2b-b855-2fcf3f888ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:02.579823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7dd29-12fe-4c2b-b855-2fcf3f888ac8 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:02.700016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1083/2184] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:02 2022] POST /identity/v3/projects => generated 383 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:02.704421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e9bc0-d623-4010-ad1f-646d8c32a373 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:02.705222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e9bc0-d623-4010-ad1f-646d8c32a373 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:02.705963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880e9bc0-d623-4010-ad1f-646d8c32a373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:02.732166 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1102/2185] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:02 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:02.733826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7dd29-12fe-4c2b-b855-2fcf3f888ac8 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:02.737544 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-01a7dd29-12fe-4c2b-b855-2fcf3f888ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:02.755416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7dd29-12fe-4c2b-b855-2fcf3f888ac8 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:02.764717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-880e9bc0-d623-4010-ad1f-646d8c32a373 None None] MFA Rules not processed for user `4e93f5d75a4040f98bd7d525f61754b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:02.766275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-880e9bc0-d623-4010-ad1f-646d8c32a373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:02.846937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:02.847844 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:02.848470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:02.848880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] PATH_INFO: `/v3/projects/0ce5dad95c984d7388c7c9609711c035` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:02.851812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce5dad95c984d7388c7c9609711c035)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:02.854286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:02.861215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1084/2186] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:02.862482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e9bc0-d623-4010-ad1f-646d8c32a373 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:02.878366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880e9bc0-d623-4010-ad1f-646d8c32a373 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:02.885019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e29c8-85aa-4098-a0f8-4e3b3e406b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:02.885850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e29c8-85aa-4098-a0f8-4e3b3e406b87 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:02.886225 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e29c8-85aa-4098-a0f8-4e3b3e406b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:02.886636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e29c8-85aa-4098-a0f8-4e3b3e406b87 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:02.887548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e29c8-85aa-4098-a0f8-4e3b3e406b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:02.891204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e29c8-85aa-4098-a0f8-4e3b3e406b87 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:03.046683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce5dad95c984d7388c7c9609711c035', 'request_id': 'req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:03.067121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1085/2187] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:02 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:03.068342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e29c8-85aa-4098-a0f8-4e3b3e406b87 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:03.081481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e29c8-85aa-4098-a0f8-4e3b3e406b87 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:03.191649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce5dad95c984d7388c7c9609711c035', 'request_id': 'req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:03.194571 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72435a4d-9e50-49f5-8e2c-5089be3bf182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:03.195702 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72435a4d-9e50-49f5-8e2c-5089be3bf182 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:03.196186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72435a4d-9e50-49f5-8e2c-5089be3bf182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:03.197178 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72435a4d-9e50-49f5-8e2c-5089be3bf182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:03.198241 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72435a4d-9e50-49f5-8e2c-5089be3bf182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:03.201681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72435a4d-9e50-49f5-8e2c-5089be3bf182 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:03.206283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce5dad95c984d7388c7c9609711c035', 'request_id': 'req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:03.223429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] The token cache is being invalidate because project 0ce5dad95c984d7388c7c9609711c035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:03.223731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:03.224491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:03.224663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1086/2188] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:03.227290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72435a4d-9e50-49f5-8e2c-5089be3bf182 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:03.232720 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1103/2189] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:02 2022] DELETE /identity/v3/projects/0ce5dad95c984d7388c7c9609711c035 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:03.235615 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:03.237145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:03.252260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72435a4d-9e50-49f5-8e2c-5089be3bf182 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:03.260348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3a9b3-d536-4c3e-bd8b-da3a7aec64c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:03.261018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c242ddc-6cc7-4720-9de1-59bb41f7ff6c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:03.261310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3a9b3-d536-4c3e-bd8b-da3a7aec64c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:03.261783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3a9b3-d536-4c3e-bd8b-da3a7aec64c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:03.262212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3a9b3-d536-4c3e-bd8b-da3a7aec64c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:03.263245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3a9b3-d536-4c3e-bd8b-da3a7aec64c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:03.266612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3a9b3-d536-4c3e-bd8b-da3a7aec64c2 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:03.269926 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:03.271001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:03.271488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:03.272780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] PATH_INFO: `/v3/projects/c8fab6b7fbde40e3aec32324f6ba78b6` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:03.274982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fab6b7fbde40e3aec32324f6ba78b6)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:03.279042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:03.429859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1087/2190] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:03 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:03.429859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3a9b3-d536-4c3e-bd8b-da3a7aec64c2 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:03.429859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ede3a9b3-d536-4c3e-bd8b-da3a7aec64c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:03.449024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:03.484888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fab6b7fbde40e3aec32324f6ba78b6', 'request_id': 'req-61717b19-5686-45d8-beca-5562a37b1f06'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:03.553837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3a9b3-d536-4c3e-bd8b-da3a7aec64c2 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:03.577271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fab6b7fbde40e3aec32324f6ba78b6', 'request_id': 'req-61717b19-5686-45d8-beca-5562a37b1f06'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:03.585923 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fab6b7fbde40e3aec32324f6ba78b6', 'request_id': 'req-61717b19-5686-45d8-beca-5562a37b1f06'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:03.602159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] The token cache is being invalidate because project c8fab6b7fbde40e3aec32324f6ba78b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:03.602594 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:03.603470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:03.605404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1104/2191] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:03 2022] DELETE /identity/v3/projects/c8fab6b7fbde40e3aec32324f6ba78b6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:03.606883 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:03.609785 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:03.636444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d352f9-83c1-4539-b8db-866c837b4fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:03.637302 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d352f9-83c1-4539-b8db-866c837b4fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:03.637893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d352f9-83c1-4539-b8db-866c837b4fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:03.638268 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d352f9-83c1-4539-b8db-866c837b4fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:03.639076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d352f9-83c1-4539-b8db-866c837b4fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:03.641519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d352f9-83c1-4539-b8db-866c837b4fc9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:03.654492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1088/2192] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:03.656680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b9312-bcb2-4a01-8a1f-c8c2804791a6 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:03.657083 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b9312-bcb2-4a01-8a1f-c8c2804791a6 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:03.657540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b9312-bcb2-4a01-8a1f-c8c2804791a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:03.684511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ab2b9312-bcb2-4a01-8a1f-c8c2804791a6 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:03.686390 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ab2b9312-bcb2-4a01-8a1f-c8c2804791a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:03.696439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1089/2193] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:03.697486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b9312-bcb2-4a01-8a1f-c8c2804791a6 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:03.699230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ab2b9312-bcb2-4a01-8a1f-c8c2804791a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:03.705543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61717b19-5686-45d8-beca-5562a37b1f06 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:03.713938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35034229-cd1b-4a08-8e1a-17c360d679cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:03.715088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034229-cd1b-4a08-8e1a-17c360d679cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:03.715684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034229-cd1b-4a08-8e1a-17c360d679cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:03.715898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b9312-bcb2-4a01-8a1f-c8c2804791a6 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:03.716362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034229-cd1b-4a08-8e1a-17c360d679cb admin admin] PATH_INFO: `/v3/projects/f17ba7393e8546b7a9538c032b2b62d2/users/6969325e44d742e2a3b3ac7ca8629fad/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:03.721183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db2ea0-9f6d-4d73-b0aa-5740b15b5449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:03.721899 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db2ea0-9f6d-4d73-b0aa-5740b15b5449 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:03.722176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db2ea0-9f6d-4d73-b0aa-5740b15b5449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:03.722458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db2ea0-9f6d-4d73-b0aa-5740b15b5449 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:03.723125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db2ea0-9f6d-4d73-b0aa-5740b15b5449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:03.726054 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db2ea0-9f6d-4d73-b0aa-5740b15b5449 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:03.744285 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35034229-cd1b-4a08-8e1a-17c360d679cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17ba7393e8546b7a9538c032b2b62d2, user_id=6969325e44d742e2a3b3ac7ca8629fad, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:03.748313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35034229-cd1b-4a08-8e1a-17c360d679cb admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:03.858067 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1090/2194] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:03 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:03.858939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db2ea0-9f6d-4d73-b0aa-5740b15b5449 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:03.860909 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-08db2ea0-9f6d-4d73-b0aa-5740b15b5449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:03.874037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db2ea0-9f6d-4d73-b0aa-5740b15b5449 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:03.878963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36536640-48c1-43d9-a0d5-2409fedcf1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:03.879620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36536640-48c1-43d9-a0d5-2409fedcf1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:03.879901 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36536640-48c1-43d9-a0d5-2409fedcf1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:03.880176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36536640-48c1-43d9-a0d5-2409fedcf1a1 admin admin] PATH_INFO: `/v3/projects/6c24471039bc4593ac3a97259da50427` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:03.881850 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36536640-48c1-43d9-a0d5-2409fedcf1a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c24471039bc4593ac3a97259da50427)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:03.883946 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36536640-48c1-43d9-a0d5-2409fedcf1a1 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:03.895565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1105/2195] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:03 2022] PUT /identity/v3/projects/f17ba7393e8546b7a9538c032b2b62d2/users/6969325e44d742e2a3b3ac7ca8629fad/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:03.898291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e0bf8-7ee4-4d76-a423-6e0435518b88 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:03.898882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e0bf8-7ee4-4d76-a423-6e0435518b88 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:03.899367 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e0bf8-7ee4-4d76-a423-6e0435518b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:03.920662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c46e0bf8-7ee4-4d76-a423-6e0435518b88 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:03.922015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c46e0bf8-7ee4-4d76-a423-6e0435518b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:03.999192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1106/2196] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:04.000685 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e0bf8-7ee4-4d76-a423-6e0435518b88 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:04.002924 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c46e0bf8-7ee4-4d76-a423-6e0435518b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:04.024259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e0bf8-7ee4-4d76-a423-6e0435518b88 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:04.026210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-36536640-48c1-43d9-a0d5-2409fedcf1a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c24471039bc4593ac3a97259da50427', 'request_id': 'req-36536640-48c1-43d9-a0d5-2409fedcf1a1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:04.039596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-36536640-48c1-43d9-a0d5-2409fedcf1a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c24471039bc4593ac3a97259da50427', 'request_id': 'req-36536640-48c1-43d9-a0d5-2409fedcf1a1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:04.091963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d1ba2-63ec-45c0-a78c-35f4d2ac8e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:04.092634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d1ba2-63ec-45c0-a78c-35f4d2ac8e8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:04.092914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d1ba2-63ec-45c0-a78c-35f4d2ac8e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:04.093188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d1ba2-63ec-45c0-a78c-35f4d2ac8e8c admin admin] PATH_INFO: `/v3/projects/e8b2424924e64900a03a6924c6883aee/users/5103bcbe6721403a8eb3b5ecde60cc87/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:04.113276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d1ba2-63ec-45c0-a78c-35f4d2ac8e8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b2424924e64900a03a6924c6883aee, user_id=5103bcbe6721403a8eb3b5ecde60cc87, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:04.118109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d1ba2-63ec-45c0-a78c-35f4d2ac8e8c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:04.126115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:04.176680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-36536640-48c1-43d9-a0d5-2409fedcf1a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c24471039bc4593ac3a97259da50427', 'request_id': 'req-36536640-48c1-43d9-a0d5-2409fedcf1a1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:04.192468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-36536640-48c1-43d9-a0d5-2409fedcf1a1 admin admin] The token cache is being invalidate because project 6c24471039bc4593ac3a97259da50427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:04.192851 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-36536640-48c1-43d9-a0d5-2409fedcf1a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:04.193722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-36536640-48c1-43d9-a0d5-2409fedcf1a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:04.195960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1091/2197] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:03 2022] DELETE /identity/v3/projects/6c24471039bc4593ac3a97259da50427 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:04.197350 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22eaa1-b530-481c-a992-8472233bb92d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:04.197839 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22eaa1-b530-481c-a992-8472233bb92d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:04.198085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22eaa1-b530-481c-a992-8472233bb92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:04.224155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-8a22eaa1-b530-481c-a992-8472233bb92d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:04.226913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8a22eaa1-b530-481c-a992-8472233bb92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:04.244106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1092/2198] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:04.244106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22eaa1-b530-481c-a992-8472233bb92d None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:04.244106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8a22eaa1-b530-481c-a992-8472233bb92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:04.258361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22eaa1-b530-481c-a992-8472233bb92d None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:04.260486 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1107/2199] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:03 2022] PUT /identity/v3/projects/e8b2424924e64900a03a6924c6883aee/users/5103bcbe6721403a8eb3b5ecde60cc87/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:04.264670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d1ba2-63ec-45c0-a78c-35f4d2ac8e8c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:04.264670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-242d1ba2-63ec-45c0-a78c-35f4d2ac8e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:04.353437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477e639-faaf-4e33-acfb-f5a88456b489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:04.354190 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477e639-faaf-4e33-acfb-f5a88456b489 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:04.354543 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477e639-faaf-4e33-acfb-f5a88456b489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:04.354890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477e639-faaf-4e33-acfb-f5a88456b489 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:04.355756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477e639-faaf-4e33-acfb-f5a88456b489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:04.357689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7477e639-faaf-4e33-acfb-f5a88456b489 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:04.373690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d1ba2-63ec-45c0-a78c-35f4d2ac8e8c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:04.374750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1093/2200] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:04.377586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19badbbb-ac56-4675-8be6-760eca09d9a1 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:04.377824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19badbbb-ac56-4675-8be6-760eca09d9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:04.378074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19badbbb-ac56-4675-8be6-760eca09d9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:04.385830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5134783-27ab-4428-9e83-62da2327a205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:04.386990 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5134783-27ab-4428-9e83-62da2327a205 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:04.387500 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5134783-27ab-4428-9e83-62da2327a205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:04.387988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5134783-27ab-4428-9e83-62da2327a205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:04.389138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5134783-27ab-4428-9e83-62da2327a205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:04.392293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5134783-27ab-4428-9e83-62da2327a205 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:04.403368 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-19badbbb-ac56-4675-8be6-760eca09d9a1 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:04.404749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-19badbbb-ac56-4675-8be6-760eca09d9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:04.419655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1094/2201] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:04.419967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1108/2202] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:04.420132 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19badbbb-ac56-4675-8be6-760eca09d9a1 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:04.420321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5134783-27ab-4428-9e83-62da2327a205 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:04.420512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-19badbbb-ac56-4675-8be6-760eca09d9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:04.434993 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5134783-27ab-4428-9e83-62da2327a205 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:04.439669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19badbbb-ac56-4675-8be6-760eca09d9a1 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:04.441435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d15a1-19ef-498d-8a4f-83f885047a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:04.442158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d15a1-19ef-498d-8a4f-83f885047a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:04.442513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d15a1-19ef-498d-8a4f-83f885047a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:04.442858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d15a1-19ef-498d-8a4f-83f885047a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:04.443599 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d15a1-19ef-498d-8a4f-83f885047a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:04.444828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d15a1-19ef-498d-8a4f-83f885047a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:04.446878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d15a1-19ef-498d-8a4f-83f885047a67 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:04.448037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:04.448970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:04.449408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:04.449842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] PATH_INFO: `/v3/users/b40656e81d37492dbdb3d70140080e7c` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:04.451840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40656e81d37492dbdb3d70140080e7c)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:04.455075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:04.463023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1109/2203] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:04.464519 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d15a1-19ef-498d-8a4f-83f885047a67 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:04.470884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-501d15a1-19ef-498d-8a4f-83f885047a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:04.495730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d15a1-19ef-498d-8a4f-83f885047a67 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:04.502063 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215606-0526-492e-a380-5ed080b22407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:04.502885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215606-0526-492e-a380-5ed080b22407 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:04.503262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215606-0526-492e-a380-5ed080b22407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:04.503657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215606-0526-492e-a380-5ed080b22407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:04.504503 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84215606-0526-492e-a380-5ed080b22407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:04.508120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84215606-0526-492e-a380-5ed080b22407 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:04.527437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1110/2204] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:04.527437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215606-0526-492e-a380-5ed080b22407 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:04.543031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215606-0526-492e-a380-5ed080b22407 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:04.551446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719713ed-66df-4e61-9960-28f84b8dd377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:04.552515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719713ed-66df-4e61-9960-28f84b8dd377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:04.553006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719713ed-66df-4e61-9960-28f84b8dd377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:04.554441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719713ed-66df-4e61-9960-28f84b8dd377 admin admin] PATH_INFO: `/v3/projects/afe0e5119bb34dd183779eae6eda2c15/users/ec650544cb5d4eea83aad8982001da4d/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:04.582002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719713ed-66df-4e61-9960-28f84b8dd377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe0e5119bb34dd183779eae6eda2c15, user_id=ec650544cb5d4eea83aad8982001da4d, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:04.589350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719713ed-66df-4e61-9960-28f84b8dd377 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:04.706274 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40656e81d37492dbdb3d70140080e7c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:04.707239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1111/2205] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:04 2022] PUT /identity/v3/projects/afe0e5119bb34dd183779eae6eda2c15/users/ec650544cb5d4eea83aad8982001da4d/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:04.709018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719713ed-66df-4e61-9960-28f84b8dd377 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:04.716399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40656e81d37492dbdb3d70140080e7c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:04.805751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719713ed-66df-4e61-9960-28f84b8dd377 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:04.813520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35090c92-6c62-4599-885b-5f4399222c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:04.814412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35090c92-6c62-4599-885b-5f4399222c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:04.814799 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35090c92-6c62-4599-885b-5f4399222c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:04.815209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35090c92-6c62-4599-885b-5f4399222c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:04.816230 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35090c92-6c62-4599-885b-5f4399222c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:04.816689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35090c92-6c62-4599-885b-5f4399222c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:04.820081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35090c92-6c62-4599-885b-5f4399222c1d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:04.833845 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40656e81d37492dbdb3d70140080e7c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:04.836514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40656e81d37492dbdb3d70140080e7c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:04.840292 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40656e81d37492dbdb3d70140080e7c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:04.840904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1112/2206] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:04.842580 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35090c92-6c62-4599-885b-5f4399222c1d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:04.845943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-35090c92-6c62-4599-885b-5f4399222c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:04.870107 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35090c92-6c62-4599-885b-5f4399222c1d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:04.870427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1095/2207] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:04 2022] DELETE /identity/v3/users/b40656e81d37492dbdb3d70140080e7c => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:04.871388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:04.873388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:04.965063 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16733f-b4af-4a6c-acde-c47e28698119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:04.966931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16733f-b4af-4a6c-acde-c47e28698119 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:04.966931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16733f-b4af-4a6c-acde-c47e28698119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:04.967709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16733f-b4af-4a6c-acde-c47e28698119 admin admin] PATH_INFO: `/v3/projects/f17ba7393e8546b7a9538c032b2b62d2/users/6969325e44d742e2a3b3ac7ca8629fad/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:04.970602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16733f-b4af-4a6c-acde-c47e28698119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17ba7393e8546b7a9538c032b2b62d2, user_id=6969325e44d742e2a3b3ac7ca8629fad, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:04.974086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16733f-b4af-4a6c-acde-c47e28698119 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:04.990031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1113/2208] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:04 2022] PUT /identity/v3/projects/f17ba7393e8546b7a9538c032b2b62d2/users/6969325e44d742e2a3b3ac7ca8629fad/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:04.992185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16733f-b4af-4a6c-acde-c47e28698119 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:04.996749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39adf1-3435-43cc-89cb-34df03b3f53e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:04.996942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0c16733f-b4af-4a6c-acde-c47e28698119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:05.093290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16733f-b4af-4a6c-acde-c47e28698119 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:05.093824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158efb9-1e01-476e-a5f8-11b34dc8bf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:05.094914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158efb9-1e01-476e-a5f8-11b34dc8bf6d admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:05.095392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158efb9-1e01-476e-a5f8-11b34dc8bf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:05.095915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158efb9-1e01-476e-a5f8-11b34dc8bf6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:05.097051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158efb9-1e01-476e-a5f8-11b34dc8bf6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:05.098867 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e47ed9-2cdd-4cf0-9306-901659e556b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:05.099536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e47ed9-2cdd-4cf0-9306-901659e556b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:05.099822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e47ed9-2cdd-4cf0-9306-901659e556b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:05.100157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e47ed9-2cdd-4cf0-9306-901659e556b0 admin admin] PATH_INFO: `/v3/projects/e8b2424924e64900a03a6924c6883aee/users/5103bcbe6721403a8eb3b5ecde60cc87/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:05.101912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4158efb9-1e01-476e-a5f8-11b34dc8bf6d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:05.102928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e47ed9-2cdd-4cf0-9306-901659e556b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b2424924e64900a03a6924c6883aee, user_id=5103bcbe6721403a8eb3b5ecde60cc87, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:05.105701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e47ed9-2cdd-4cf0-9306-901659e556b0 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:05.118732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1114/2209] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:04 2022] PUT /identity/v3/projects/e8b2424924e64900a03a6924c6883aee/users/5103bcbe6721403a8eb3b5ecde60cc87/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:05.120064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e47ed9-2cdd-4cf0-9306-901659e556b0 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:05.121435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-34e47ed9-2cdd-4cf0-9306-901659e556b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:05.236904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e47ed9-2cdd-4cf0-9306-901659e556b0 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:05.243268 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c204b6-6147-4988-a2ff-3cf597e6c4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:05.244045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c204b6-6147-4988-a2ff-3cf597e6c4cf admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:05.244326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c204b6-6147-4988-a2ff-3cf597e6c4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:05.244652 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c204b6-6147-4988-a2ff-3cf597e6c4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:05.245279 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c204b6-6147-4988-a2ff-3cf597e6c4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:05.246958 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c204b6-6147-4988-a2ff-3cf597e6c4cf admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:05.264138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1115/2210] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:05.264138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c204b6-6147-4988-a2ff-3cf597e6c4cf admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:05.264138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c4c204b6-6147-4988-a2ff-3cf597e6c4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:05.282549 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1096/2211] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:04 2022] POST /identity/v3/projects => generated 381 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:05.286115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584331cf-cd3c-4db9-8d5b-a3bcfe706b19 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:05.286621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584331cf-cd3c-4db9-8d5b-a3bcfe706b19 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:05.287424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584331cf-cd3c-4db9-8d5b-a3bcfe706b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:05.294050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c204b6-6147-4988-a2ff-3cf597e6c4cf admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:05.339517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-584331cf-cd3c-4db9-8d5b-a3bcfe706b19 None None] MFA Rules not processed for user `6969325e44d742e2a3b3ac7ca8629fad`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:05.342052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-584331cf-cd3c-4db9-8d5b-a3bcfe706b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:05.371483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a06b3-688f-4562-b07f-a3008c8a458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:05.372171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a06b3-688f-4562-b07f-a3008c8a458a admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:05.372457 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a06b3-688f-4562-b07f-a3008c8a458a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:05.372733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a06b3-688f-4562-b07f-a3008c8a458a admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:05.375274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a06b3-688f-4562-b07f-a3008c8a458a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:05.375486 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a06b3-688f-4562-b07f-a3008c8a458a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:05.455148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1097/2212] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:05.455148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a99cd3-9ad9-42be-bc14-360ab774837a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:05.455148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a99cd3-9ad9-42be-bc14-360ab774837a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:05.455148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a99cd3-9ad9-42be-bc14-360ab774837a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:05.504486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-43a99cd3-9ad9-42be-bc14-360ab774837a None None] MFA Rules not processed for user `5103bcbe6721403a8eb3b5ecde60cc87`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:05.507885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-43a99cd3-9ad9-42be-bc14-360ab774837a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:05.533706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1116/2213] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:05 2022] POST /identity/v3/projects => generated 365 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:05.533706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a06b3-688f-4562-b07f-a3008c8a458a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:05.629922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a06b3-688f-4562-b07f-a3008c8a458a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:05.640401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1098/2214] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:05.640401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a99cd3-9ad9-42be-bc14-360ab774837a None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:05.650860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e82a1-bfaf-41b9-97b0-70faf2e2b0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:05.652140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e82a1-bfaf-41b9-97b0-70faf2e2b0ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:05.652752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e82a1-bfaf-41b9-97b0-70faf2e2b0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:05.653362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e82a1-bfaf-41b9-97b0-70faf2e2b0ed admin admin] PATH_INFO: `/v3/projects/afe0e5119bb34dd183779eae6eda2c15/users/ec650544cb5d4eea83aad8982001da4d/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:05.653947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a99cd3-9ad9-42be-bc14-360ab774837a None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:05.659027 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e82a1-bfaf-41b9-97b0-70faf2e2b0ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe0e5119bb34dd183779eae6eda2c15, user_id=ec650544cb5d4eea83aad8982001da4d, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:05.663622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d904b4-31de-4e0a-97b3-0be35762c2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:05.664780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d904b4-31de-4e0a-97b3-0be35762c2bb admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:05.664933 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e82a1-bfaf-41b9-97b0-70faf2e2b0ed admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:05.665582 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d904b4-31de-4e0a-97b3-0be35762c2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:05.666124 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d904b4-31de-4e0a-97b3-0be35762c2bb admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:05.667399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d904b4-31de-4e0a-97b3-0be35762c2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:05.670565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d904b4-31de-4e0a-97b3-0be35762c2bb admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:05.682503 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1117/2215] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:05 2022] PUT /identity/v3/projects/afe0e5119bb34dd183779eae6eda2c15/users/ec650544cb5d4eea83aad8982001da4d/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:05.684643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e82a1-bfaf-41b9-97b0-70faf2e2b0ed admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:05.687929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c71e82a1-bfaf-41b9-97b0-70faf2e2b0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:05.764148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:05.778526 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e82a1-bfaf-41b9-97b0-70faf2e2b0ed admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:05.784944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58322dee-69e0-4ad0-a9a0-51c29874f8c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:05.785946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58322dee-69e0-4ad0-a9a0-51c29874f8c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:05.786416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58322dee-69e0-4ad0-a9a0-51c29874f8c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:05.786890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58322dee-69e0-4ad0-a9a0-51c29874f8c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:05.790922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-58322dee-69e0-4ad0-a9a0-51c29874f8c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:05.805309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1099/2216] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:05 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:05.808771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d904b4-31de-4e0a-97b3-0be35762c2bb admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:05.808771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-89d904b4-31de-4e0a-97b3-0be35762c2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:05.823674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d904b4-31de-4e0a-97b3-0be35762c2bb admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:05.903878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58322dee-69e0-4ad0-a9a0-51c29874f8c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:05.905533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58322dee-69e0-4ad0-a9a0-51c29874f8c9 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:05.916599 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1118/2217] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:05.917580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de8931-f267-448a-a694-549a1ff9a93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:05.918564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de8931-f267-448a-a694-549a1ff9a93c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:05.919944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58322dee-69e0-4ad0-a9a0-51c29874f8c9 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:05.920194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de8931-f267-448a-a694-549a1ff9a93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:05.920194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de8931-f267-448a-a694-549a1ff9a93c admin admin] PATH_INFO: `/v3/projects/3befd67f235940edbb172e943fdcc198` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:05.921496 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de8931-f267-448a-a694-549a1ff9a93c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3befd67f235940edbb172e943fdcc198)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:05.925085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de8931-f267-448a-a694-549a1ff9a93c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:05.938144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58322dee-69e0-4ad0-a9a0-51c29874f8c9 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:05.942318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:05.950511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72568c64-4958-45d2-8186-e11aa0e2b527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:05.951585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72568c64-4958-45d2-8186-e11aa0e2b527 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:05.952269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72568c64-4958-45d2-8186-e11aa0e2b527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:05.952679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72568c64-4958-45d2-8186-e11aa0e2b527 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:05.953779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72568c64-4958-45d2-8186-e11aa0e2b527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:05.957239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72568c64-4958-45d2-8186-e11aa0e2b527 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:06.083660 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d3de8931-f267-448a-a694-549a1ff9a93c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3befd67f235940edbb172e943fdcc198', 'request_id': 'req-d3de8931-f267-448a-a694-549a1ff9a93c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:06.091301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d3de8931-f267-448a-a694-549a1ff9a93c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3befd67f235940edbb172e943fdcc198', 'request_id': 'req-d3de8931-f267-448a-a694-549a1ff9a93c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:06.104865 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1119/2218] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:05 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:06.107623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72568c64-4958-45d2-8186-e11aa0e2b527 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:06.107623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-72568c64-4958-45d2-8186-e11aa0e2b527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:06.121457 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72568c64-4958-45d2-8186-e11aa0e2b527 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:06.184333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2864c-5dc4-4e0d-8469-ac45b1b31dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:06.184989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2864c-5dc4-4e0d-8469-ac45b1b31dfd service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.185278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2864c-5dc4-4e0d-8469-ac45b1b31dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.185585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2864c-5dc4-4e0d-8469-ac45b1b31dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.192811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d3de8931-f267-448a-a694-549a1ff9a93c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3befd67f235940edbb172e943fdcc198', 'request_id': 'req-d3de8931-f267-448a-a694-549a1ff9a93c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:06.206676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d3de8931-f267-448a-a694-549a1ff9a93c admin admin] The token cache is being invalidate because project 3befd67f235940edbb172e943fdcc198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:06.207204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d3de8931-f267-448a-a694-549a1ff9a93c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:06.208160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-d3de8931-f267-448a-a694-549a1ff9a93c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:06.210370 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1100/2219] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:05 2022] DELETE /identity/v3/projects/3befd67f235940edbb172e943fdcc198 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:06.211762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe532a3-c812-400f-9ead-f8616c2fae74 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.212079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe532a3-c812-400f-9ead-f8616c2fae74 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.213039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe532a3-c812-400f-9ead-f8616c2fae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.246544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-fbe532a3-c812-400f-9ead-f8616c2fae74 None None] MFA Rules not processed for user `ec650544cb5d4eea83aad8982001da4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:06.247804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fbe532a3-c812-400f-9ead-f8616c2fae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:06.268240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2864c-5dc4-4e0d-8469-ac45b1b31dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:06.269730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2864c-5dc4-4e0d-8469-ac45b1b31dfd service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:06.286641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1120/2220] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:06.288735 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2864c-5dc4-4e0d-8469-ac45b1b31dfd service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:06.350455 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1101/2221] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:06.351609 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe532a3-c812-400f-9ead-f8616c2fae74 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:06.352987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fbe532a3-c812-400f-9ead-f8616c2fae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:06.377473 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2864c-5dc4-4e0d-8469-ac45b1b31dfd service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:06.384771 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeba431-b8db-4dca-9f20-ed21d786c0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:06.385585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeba431-b8db-4dca-9f20-ed21d786c0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.385909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeba431-b8db-4dca-9f20-ed21d786c0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.386382 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeba431-b8db-4dca-9f20-ed21d786c0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.387899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeba431-b8db-4dca-9f20-ed21d786c0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:06.389833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeba431-b8db-4dca-9f20-ed21d786c0c9 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:06.408291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1121/2222] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:06.410596 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adcdba-19fd-4169-94b2-340b488b64db None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.411103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adcdba-19fd-4169-94b2-340b488b64db None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.412030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adcdba-19fd-4169-94b2-340b488b64db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.440733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-92adcdba-19fd-4169-94b2-340b488b64db None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:06.442294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-92adcdba-19fd-4169-94b2-340b488b64db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:06.454476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe532a3-c812-400f-9ead-f8616c2fae74 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:06.455225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1122/2223] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:06.456754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adcdba-19fd-4169-94b2-340b488b64db None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:06.458964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-92adcdba-19fd-4169-94b2-340b488b64db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:06.461199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6675b5-dc7b-4e85-85d4-f32230fd874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:06.461886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6675b5-dc7b-4e85-85d4-f32230fd874c admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.462165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6675b5-dc7b-4e85-85d4-f32230fd874c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.462429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6675b5-dc7b-4e85-85d4-f32230fd874c admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.463083 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6675b5-dc7b-4e85-85d4-f32230fd874c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:06.464729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6675b5-dc7b-4e85-85d4-f32230fd874c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:06.479988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adcdba-19fd-4169-94b2-340b488b64db None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:06.483001 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1102/2224] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:06.484073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b451c-1592-40e5-a23f-b3800b0ba53e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:06.484732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b451c-1592-40e5-a23f-b3800b0ba53e service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.485001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b451c-1592-40e5-a23f-b3800b0ba53e service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.485169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6675b5-dc7b-4e85-85d4-f32230fd874c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:06.485413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b451c-1592-40e5-a23f-b3800b0ba53e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.487278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a21b451c-1592-40e5-a23f-b3800b0ba53e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:06.487700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ec6675b5-dc7b-4e85-85d4-f32230fd874c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:06.505303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6675b5-dc7b-4e85-85d4-f32230fd874c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:06.511486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38ea54-5290-4bd3-b348-4be80aa7a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:06.512150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38ea54-5290-4bd3-b348-4be80aa7a9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.512431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38ea54-5290-4bd3-b348-4be80aa7a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.512712 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38ea54-5290-4bd3-b348-4be80aa7a9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.513423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38ea54-5290-4bd3-b348-4be80aa7a9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:06.515204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38ea54-5290-4bd3-b348-4be80aa7a9c0 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:06.527920 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1103/2225] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:06.529500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab9cf1-c199-4e26-80fa-772d959f558a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.529792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab9cf1-c199-4e26-80fa-772d959f558a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.530072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab9cf1-c199-4e26-80fa-772d959f558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.552370 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-7bab9cf1-c199-4e26-80fa-772d959f558a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:06.555325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7bab9cf1-c199-4e26-80fa-772d959f558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:06.564553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1104/2226] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:06.565468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab9cf1-c199-4e26-80fa-772d959f558a None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:06.566949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b451c-1592-40e5-a23f-b3800b0ba53e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:06.568454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b451c-1592-40e5-a23f-b3800b0ba53e service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:06.577889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab9cf1-c199-4e26-80fa-772d959f558a None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:06.580062 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1123/2227] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:06.580992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b451c-1592-40e5-a23f-b3800b0ba53e service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:06.590332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f424d-7ab2-4ef0-8911-1de0c93cbe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:06.592234 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f424d-7ab2-4ef0-8911-1de0c93cbe25 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.592856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f424d-7ab2-4ef0-8911-1de0c93cbe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.593325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f424d-7ab2-4ef0-8911-1de0c93cbe25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.594804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f424d-7ab2-4ef0-8911-1de0c93cbe25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:06.597770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f424d-7ab2-4ef0-8911-1de0c93cbe25 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:06.600519 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b451c-1592-40e5-a23f-b3800b0ba53e service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:06.608449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d96814-fa59-4496-bef4-7b28d15ad873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:06.609305 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d96814-fa59-4496-bef4-7b28d15ad873 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.609730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d96814-fa59-4496-bef4-7b28d15ad873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.610141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d96814-fa59-4496-bef4-7b28d15ad873 admin admin] PATH_INFO: `/v3/projects/6b85a88f96aa42daa97f39cb07d89220/users/b26ac4d59cd447cfba9a84360da90136/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.625014 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1105/2228] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:06.630697 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f424d-7ab2-4ef0-8911-1de0c93cbe25 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:06.637518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d96814-fa59-4496-bef4-7b28d15ad873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b85a88f96aa42daa97f39cb07d89220, user_id=b26ac4d59cd447cfba9a84360da90136, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:06.643769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f424d-7ab2-4ef0-8911-1de0c93cbe25 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:06.649838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d96814-fa59-4496-bef4-7b28d15ad873 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:06.650028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354f3dc-8559-4203-a2fe-3ec8e7aa6956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:06.650204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f3dc-8559-4203-a2fe-3ec8e7aa6956 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.650425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f3dc-8559-4203-a2fe-3ec8e7aa6956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.650706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354f3dc-8559-4203-a2fe-3ec8e7aa6956 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.651374 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354f3dc-8559-4203-a2fe-3ec8e7aa6956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:06.651690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354f3dc-8559-4203-a2fe-3ec8e7aa6956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:06.653416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354f3dc-8559-4203-a2fe-3ec8e7aa6956 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:06.669172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1106/2229] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:06.670080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354f3dc-8559-4203-a2fe-3ec8e7aa6956 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:06.681129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354f3dc-8559-4203-a2fe-3ec8e7aa6956 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:06.688912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ffdca-5a61-47bf-a353-40a0ed8db949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:06.690029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ffdca-5a61-47bf-a353-40a0ed8db949 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.690460 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ffdca-5a61-47bf-a353-40a0ed8db949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.690882 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ffdca-5a61-47bf-a353-40a0ed8db949 admin admin] PATH_INFO: `/v3/projects/d544520f30a14679b9effde392687c1c/users/229d5cefc4224c40a6d72ec1e1bff05a/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.718607 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ffdca-5a61-47bf-a353-40a0ed8db949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d544520f30a14679b9effde392687c1c, user_id=229d5cefc4224c40a6d72ec1e1bff05a, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:06.722231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ffdca-5a61-47bf-a353-40a0ed8db949 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:06.796812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1124/2230] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:06 2022] PUT /identity/v3/projects/6b85a88f96aa42daa97f39cb07d89220/users/b26ac4d59cd447cfba9a84360da90136/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:06.797839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d96814-fa59-4496-bef4-7b28d15ad873 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:06.838593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1107/2231] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:06 2022] PUT /identity/v3/projects/d544520f30a14679b9effde392687c1c/users/229d5cefc4224c40a6d72ec1e1bff05a/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:06.839091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfddca1-4b64-42c2-b34f-1bf7b86d34f0 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.849084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfddca1-4b64-42c2-b34f-1bf7b86d34f0 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.849084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfddca1-4b64-42c2-b34f-1bf7b86d34f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.876410 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d96814-fa59-4496-bef4-7b28d15ad873 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:06.880834 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-cdfddca1-4b64-42c2-b34f-1bf7b86d34f0 None None] MFA Rules not processed for user `b26ac4d59cd447cfba9a84360da90136`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:06.883338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-cdfddca1-4b64-42c2-b34f-1bf7b86d34f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:06.949053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706e13b-4b5d-4ffa-81b3-052d97e5d485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:06.949793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706e13b-4b5d-4ffa-81b3-052d97e5d485 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:06.950073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706e13b-4b5d-4ffa-81b3-052d97e5d485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:06.950349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706e13b-4b5d-4ffa-81b3-052d97e5d485 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:06.951011 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706e13b-4b5d-4ffa-81b3-052d97e5d485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:06.953036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706e13b-4b5d-4ffa-81b3-052d97e5d485 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:07.000008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1108/2232] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:07.000008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e92587-c239-4147-baa8-ca80332c6fcc None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:07.000008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e92587-c239-4147-baa8-ca80332c6fcc None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:07.000008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e92587-c239-4147-baa8-ca80332c6fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:07.043641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-e6e92587-c239-4147-baa8-ca80332c6fcc None None] MFA Rules not processed for user `229d5cefc4224c40a6d72ec1e1bff05a`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:07.045653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e6e92587-c239-4147-baa8-ca80332c6fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:07.130913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1109/2233] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:07.137364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e92587-c239-4147-baa8-ca80332c6fcc None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:07.143844 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e92587-c239-4147-baa8-ca80332c6fcc None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:07.149587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc5e3d-7805-4b7a-868a-45c7d9e4e4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:07.150267 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc5e3d-7805-4b7a-868a-45c7d9e4e4dc admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:07.150553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc5e3d-7805-4b7a-868a-45c7d9e4e4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:07.150825 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc5e3d-7805-4b7a-868a-45c7d9e4e4dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:07.151486 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc5e3d-7805-4b7a-868a-45c7d9e4e4dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:07.153502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc5e3d-7805-4b7a-868a-45c7d9e4e4dc admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:07.194868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1125/2234] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:06 2022] POST /identity/v3/projects => generated 369 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:07.195977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706e13b-4b5d-4ffa-81b3-052d97e5d485 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:07.280099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706e13b-4b5d-4ffa-81b3-052d97e5d485 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:07.285367 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57665662-4a25-4b9c-8742-b19006467307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:07.286030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57665662-4a25-4b9c-8742-b19006467307 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:07.286310 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57665662-4a25-4b9c-8742-b19006467307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:07.286584 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57665662-4a25-4b9c-8742-b19006467307 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:07.299228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57665662-4a25-4b9c-8742-b19006467307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:07.299228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57665662-4a25-4b9c-8742-b19006467307 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:07.433135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1110/2235] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:07 2022] POST /identity/v3/projects => generated 381 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:07.433135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc5e3d-7805-4b7a-868a-45c7d9e4e4dc admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:07.457487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1126/2236] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:07 2022] POST /identity/v3/projects => generated 363 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:07.458777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57665662-4a25-4b9c-8742-b19006467307 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:07.530177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc5e3d-7805-4b7a-868a-45c7d9e4e4dc admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:07.550755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57665662-4a25-4b9c-8742-b19006467307 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:07.556509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b318cd-34df-4c20-9942-d2f29d0d0dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:07.557135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b318cd-34df-4c20-9942-d2f29d0d0dbc admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:07.557444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b318cd-34df-4c20-9942-d2f29d0d0dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:07.557730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b318cd-34df-4c20-9942-d2f29d0d0dbc admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:07.558542 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b318cd-34df-4c20-9942-d2f29d0d0dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:07.560530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b318cd-34df-4c20-9942-d2f29d0d0dbc admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:07.599515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108025f-8a24-48b3-b7ae-f15eb4c1de84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:07.600663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108025f-8a24-48b3-b7ae-f15eb4c1de84 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:07.600953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108025f-8a24-48b3-b7ae-f15eb4c1de84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:07.601318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108025f-8a24-48b3-b7ae-f15eb4c1de84 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:07.602393 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108025f-8a24-48b3-b7ae-f15eb4c1de84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:07.604391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108025f-8a24-48b3-b7ae-f15eb4c1de84 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:07.846935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1127/2237] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:07 2022] POST /identity/v3/users => generated 297 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:07.848591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b318cd-34df-4c20-9942-d2f29d0d0dbc admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:07.864893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b318cd-34df-4c20-9942-d2f29d0d0dbc admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:07.872772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fad3a-1286-4431-8713-ecf1543f43ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:07.873893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fad3a-1286-4431-8713-ecf1543f43ef admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:07.874347 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fad3a-1286-4431-8713-ecf1543f43ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:07.874814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47fad3a-1286-4431-8713-ecf1543f43ef admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:07.875805 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fad3a-1286-4431-8713-ecf1543f43ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:07.879160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47fad3a-1286-4431-8713-ecf1543f43ef admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:07.945951 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1111/2238] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:07 2022] POST /identity/v3/users => generated 285 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:07.945951 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108025f-8a24-48b3-b7ae-f15eb4c1de84 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:07.961769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108025f-8a24-48b3-b7ae-f15eb4c1de84 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:07.970773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2c96c-b55b-46bd-b3d7-cf4732d98fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:07.971780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2c96c-b55b-46bd-b3d7-cf4732d98fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:07.972236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2c96c-b55b-46bd-b3d7-cf4732d98fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:07.972693 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a2c96c-b55b-46bd-b3d7-cf4732d98fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:07.974131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2c96c-b55b-46bd-b3d7-cf4732d98fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:07.977113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a2c96c-b55b-46bd-b3d7-cf4732d98fe5 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:07.997295 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1112/2239] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:08.000586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2c96c-b55b-46bd-b3d7-cf4732d98fe5 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:08.016715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a2c96c-b55b-46bd-b3d7-cf4732d98fe5 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:08.026583 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d2aef-6a38-4dd0-bece-0fe71290885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:08.026583 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d2aef-6a38-4dd0-bece-0fe71290885d admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:08.026806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d2aef-6a38-4dd0-bece-0fe71290885d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:08.027331 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d2aef-6a38-4dd0-bece-0fe71290885d admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:08.028441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d2aef-6a38-4dd0-bece-0fe71290885d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:08.031263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d2aef-6a38-4dd0-bece-0fe71290885d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:08.050738 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1113/2240] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:08.051955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d2aef-6a38-4dd0-bece-0fe71290885d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:08.068113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d2aef-6a38-4dd0-bece-0fe71290885d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:08.076219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b63f6-0c98-46fc-aa58-66c8cbf555b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:08.077190 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b63f6-0c98-46fc-aa58-66c8cbf555b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:08.077637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b63f6-0c98-46fc-aa58-66c8cbf555b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:08.078044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b63f6-0c98-46fc-aa58-66c8cbf555b5 admin admin] PATH_INFO: `/v3/projects/372e95cb5e3e4152969b10a26a466835/users/3c70e50820e3477fbcbfa4bee20eae9e/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:08.104785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b63f6-0c98-46fc-aa58-66c8cbf555b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=372e95cb5e3e4152969b10a26a466835, user_id=3c70e50820e3477fbcbfa4bee20eae9e, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:08.109511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b63f6-0c98-46fc-aa58-66c8cbf555b5 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:08.156984 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1128/2241] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:07 2022] POST /identity/v3/users => generated 288 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:08.158132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fad3a-1286-4431-8713-ecf1543f43ef admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:08.173137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47fad3a-1286-4431-8713-ecf1543f43ef admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:08.178689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61426d70-345b-49b4-8786-1716287ddbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:08.179458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61426d70-345b-49b4-8786-1716287ddbdf admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:08.179819 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61426d70-345b-49b4-8786-1716287ddbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:08.180190 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61426d70-345b-49b4-8786-1716287ddbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:08.180916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61426d70-345b-49b4-8786-1716287ddbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:08.182676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61426d70-345b-49b4-8786-1716287ddbdf admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:08.195916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1129/2242] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:08.196534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61426d70-345b-49b4-8786-1716287ddbdf admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:08.216433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61426d70-345b-49b4-8786-1716287ddbdf admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:08.216433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c2aae-6fbb-4477-9222-335129ddf780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:08.216433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c2aae-6fbb-4477-9222-335129ddf780 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:08.216433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c2aae-6fbb-4477-9222-335129ddf780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:08.217439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c2aae-6fbb-4477-9222-335129ddf780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:08.217439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c2aae-6fbb-4477-9222-335129ddf780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:08.218629 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c2aae-6fbb-4477-9222-335129ddf780 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:08.230745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1130/2243] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:08.231323 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c2aae-6fbb-4477-9222-335129ddf780 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:08.246995 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c2aae-6fbb-4477-9222-335129ddf780 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:08.255073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9465d34-2901-4b31-b60a-c95ed21ebbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:08.255899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9465d34-2901-4b31-b60a-c95ed21ebbcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:08.256817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9465d34-2901-4b31-b60a-c95ed21ebbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:08.257215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9465d34-2901-4b31-b60a-c95ed21ebbcb admin admin] PATH_INFO: `/v3/projects/8b31ccbc87c24b638452b1bbc63c12b1/users/1426d68f936e43ec8857d1d9bd88af89/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:08.275473 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9465d34-2901-4b31-b60a-c95ed21ebbcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b31ccbc87c24b638452b1bbc63c12b1, user_id=1426d68f936e43ec8857d1d9bd88af89, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:08.278416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9465d34-2901-4b31-b60a-c95ed21ebbcb admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:08.302680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1114/2244] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:08 2022] PUT /identity/v3/projects/372e95cb5e3e4152969b10a26a466835/users/3c70e50820e3477fbcbfa4bee20eae9e/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:08.303612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b63f6-0c98-46fc-aa58-66c8cbf555b5 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:08.375359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b63f6-0c98-46fc-aa58-66c8cbf555b5 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:08.380898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38feb297-0117-43d2-93c4-1f41bd7918d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:08.382158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38feb297-0117-43d2-93c4-1f41bd7918d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:08.382441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38feb297-0117-43d2-93c4-1f41bd7918d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:08.382936 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38feb297-0117-43d2-93c4-1f41bd7918d4 admin admin] PATH_INFO: `/v3/projects/80e13004e5b34e55a92e9ecd51ee7f9c/users/f0f9a2e218b14daea9a4c74fbc0c7302/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:08.409112 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38feb297-0117-43d2-93c4-1f41bd7918d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e13004e5b34e55a92e9ecd51ee7f9c, user_id=f0f9a2e218b14daea9a4c74fbc0c7302, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:08.412172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38feb297-0117-43d2-93c4-1f41bd7918d4 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:08.457535 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1131/2245] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:08 2022] PUT /identity/v3/projects/8b31ccbc87c24b638452b1bbc63c12b1/users/1426d68f936e43ec8857d1d9bd88af89/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:08.457535 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9465d34-2901-4b31-b60a-c95ed21ebbcb admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:08.521913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9465d34-2901-4b31-b60a-c95ed21ebbcb admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:08.527857 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f91897-b3c9-4c7c-90c3-6459f57d6ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:08.528488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f91897-b3c9-4c7c-90c3-6459f57d6ddd admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:08.528774 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f91897-b3c9-4c7c-90c3-6459f57d6ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:08.529055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f91897-b3c9-4c7c-90c3-6459f57d6ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:08.529739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f91897-b3c9-4c7c-90c3-6459f57d6ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:08.531406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f91897-b3c9-4c7c-90c3-6459f57d6ddd admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:08.543273 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1132/2246] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:08.544637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e606a82-f676-4b48-acd4-b8fe50d1d7f8 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:08.544928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e606a82-f676-4b48-acd4-b8fe50d1d7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:08.545207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e606a82-f676-4b48-acd4-b8fe50d1d7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:08.576033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-0e606a82-f676-4b48-acd4-b8fe50d1d7f8 None None] MFA Rules not processed for user `1426d68f936e43ec8857d1d9bd88af89`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:08.577295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0e606a82-f676-4b48-acd4-b8fe50d1d7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:08.652342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1133/2247] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:08.653285 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e606a82-f676-4b48-acd4-b8fe50d1d7f8 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:08.665626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e606a82-f676-4b48-acd4-b8fe50d1d7f8 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:08.668237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1115/2248] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:08 2022] PUT /identity/v3/projects/80e13004e5b34e55a92e9ecd51ee7f9c/users/f0f9a2e218b14daea9a4c74fbc0c7302/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:08.669527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38feb297-0117-43d2-93c4-1f41bd7918d4 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:08.735131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2906a5-9e82-4eee-b864-14af1a9c3c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:08.736169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2906a5-9e82-4eee-b864-14af1a9c3c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:08.736601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2906a5-9e82-4eee-b864-14af1a9c3c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:08.737060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2906a5-9e82-4eee-b864-14af1a9c3c27 admin admin] PATH_INFO: `/v3/projects/372e95cb5e3e4152969b10a26a466835/users/3c70e50820e3477fbcbfa4bee20eae9e/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:08.739429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2906a5-9e82-4eee-b864-14af1a9c3c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=372e95cb5e3e4152969b10a26a466835, user_id=3c70e50820e3477fbcbfa4bee20eae9e, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:08.743413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2906a5-9e82-4eee-b864-14af1a9c3c27 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:08.773466 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1134/2249] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:08 2022] PUT /identity/v3/projects/372e95cb5e3e4152969b10a26a466835/users/3c70e50820e3477fbcbfa4bee20eae9e/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:08.774697 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2906a5-9e82-4eee-b864-14af1a9c3c27 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:08.813055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38feb297-0117-43d2-93c4-1f41bd7918d4 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:08.865298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2906a5-9e82-4eee-b864-14af1a9c3c27 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:08.871454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc19a413-c24b-4c2e-ad88-16e48d9d1ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:08.872084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19a413-c24b-4c2e-ad88-16e48d9d1ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:08.872397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19a413-c24b-4c2e-ad88-16e48d9d1ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:08.872672 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc19a413-c24b-4c2e-ad88-16e48d9d1ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:08.873367 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19a413-c24b-4c2e-ad88-16e48d9d1ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:08.875278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc19a413-c24b-4c2e-ad88-16e48d9d1ec6 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:08.879138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6818ff-261f-4bb8-812e-0d00b24efe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:08.880022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6818ff-261f-4bb8-812e-0d00b24efe3c admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:08.880022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6818ff-261f-4bb8-812e-0d00b24efe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:08.880343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6818ff-261f-4bb8-812e-0d00b24efe3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:08.881006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6818ff-261f-4bb8-812e-0d00b24efe3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:08.883560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6818ff-261f-4bb8-812e-0d00b24efe3c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:08.892438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1135/2250] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:08.895159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeafcf0-8ac2-4070-a2fe-3c79c88a559f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:08.895994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeafcf0-8ac2-4070-a2fe-3c79c88a559f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:08.896527 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeafcf0-8ac2-4070-a2fe-3c79c88a559f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:08.937422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-8aeafcf0-8ac2-4070-a2fe-3c79c88a559f None None] MFA Rules not processed for user `3c70e50820e3477fbcbfa4bee20eae9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:08.938699 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8aeafcf0-8ac2-4070-a2fe-3c79c88a559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:09.025121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1136/2251] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:09.026042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeafcf0-8ac2-4070-a2fe-3c79c88a559f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:09.027375 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8aeafcf0-8ac2-4070-a2fe-3c79c88a559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:09.090179 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1116/2252] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:08 2022] POST /identity/v3/projects => generated 367 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:09.091704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6818ff-261f-4bb8-812e-0d00b24efe3c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:09.106953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeafcf0-8ac2-4070-a2fe-3c79c88a559f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:09.172769 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64599967-a55a-4f64-bf9d-358cfc7fc43a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:09.173924 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64599967-a55a-4f64-bf9d-358cfc7fc43a service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:09.174426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64599967-a55a-4f64-bf9d-358cfc7fc43a service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:09.174926 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64599967-a55a-4f64-bf9d-358cfc7fc43a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:09.178010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-64599967-a55a-4f64-bf9d-358cfc7fc43a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:09.198165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6818ff-261f-4bb8-812e-0d00b24efe3c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:09.205522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8905b4-1ba0-41b5-8fe4-d22584239f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:09.206221 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8905b4-1ba0-41b5-8fe4-d22584239f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:09.206526 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8905b4-1ba0-41b5-8fe4-d22584239f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:09.206787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8905b4-1ba0-41b5-8fe4-d22584239f97 admin admin] PATH_INFO: `/v3/projects/80e13004e5b34e55a92e9ecd51ee7f9c/users/f0f9a2e218b14daea9a4c74fbc0c7302/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:09.208879 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8905b4-1ba0-41b5-8fe4-d22584239f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e13004e5b34e55a92e9ecd51ee7f9c, user_id=f0f9a2e218b14daea9a4c74fbc0c7302, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:09.213175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8905b4-1ba0-41b5-8fe4-d22584239f97 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:09.225229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1117/2253] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:09 2022] PUT /identity/v3/projects/80e13004e5b34e55a92e9ecd51ee7f9c/users/f0f9a2e218b14daea9a4c74fbc0c7302/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:09.226975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8905b4-1ba0-41b5-8fe4-d22584239f97 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:09.279113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:09.297908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64599967-a55a-4f64-bf9d-358cfc7fc43a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:09.300798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64599967-a55a-4f64-bf9d-358cfc7fc43a service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:09.306661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8905b4-1ba0-41b5-8fe4-d22584239f97 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:09.313314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8e374-4f27-438d-966c-1445785077d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:09.314442 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8e374-4f27-438d-966c-1445785077d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:09.314953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8e374-4f27-438d-966c-1445785077d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:09.315451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8e374-4f27-438d-966c-1445785077d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:09.316720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8e374-4f27-438d-966c-1445785077d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:09.318214 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1137/2254] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:09.320562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751796aa-3b58-4674-baab-fcf21fc2bf2f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:09.320978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8e374-4f27-438d-966c-1445785077d6 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:09.321104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751796aa-3b58-4674-baab-fcf21fc2bf2f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:09.321575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751796aa-3b58-4674-baab-fcf21fc2bf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:09.360013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-751796aa-3b58-4674-baab-fcf21fc2bf2f None None] MFA Rules not processed for user `f0f9a2e218b14daea9a4c74fbc0c7302`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:09.361261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-751796aa-3b58-4674-baab-fcf21fc2bf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:09.465439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1138/2255] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:09.564993 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751796aa-3b58-4674-baab-fcf21fc2bf2f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:09.629702 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751796aa-3b58-4674-baab-fcf21fc2bf2f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:09.634460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1290-5d76-42b7-bec6-e2daa36bd084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:09.635080 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1290-5d76-42b7-bec6-e2daa36bd084 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:09.635361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1290-5d76-42b7-bec6-e2daa36bd084 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:09.635630 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1290-5d76-42b7-bec6-e2daa36bd084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:09.647700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb1290-5d76-42b7-bec6-e2daa36bd084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:09.649244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb1290-5d76-42b7-bec6-e2daa36bd084 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:09.660118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1139/2256] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:09.667989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1118/2257] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:09 2022] POST /identity/v3/users => generated 290 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:09.670828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1290-5d76-42b7-bec6-e2daa36bd084 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:09.683008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1290-5d76-42b7-bec6-e2daa36bd084 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:09.688318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2add48-c1c4-4ec1-ab2f-5e3785514a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:09.689078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2add48-c1c4-4ec1-ab2f-5e3785514a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:09.689504 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2add48-c1c4-4ec1-ab2f-5e3785514a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:09.689863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2add48-c1c4-4ec1-ab2f-5e3785514a10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:09.690700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2add48-c1c4-4ec1-ab2f-5e3785514a10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:09.692906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2add48-c1c4-4ec1-ab2f-5e3785514a10 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:09.704700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1140/2258] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:09.709228 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8e374-4f27-438d-966c-1445785077d6 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:09.719826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8e374-4f27-438d-966c-1445785077d6 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:09.725435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953fe2b-0f6a-423f-aac9-92b890c2b649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:09.726579 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fe2b-0f6a-423f-aac9-92b890c2b649 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:09.727183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fe2b-0f6a-423f-aac9-92b890c2b649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:09.727676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953fe2b-0f6a-423f-aac9-92b890c2b649 admin admin] PATH_INFO: `/v3/projects/02a050aa230943dea8def94ab5dd074d/users/0ea0fd18158d46aa8d34008ec64ac832/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:09.752979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953fe2b-0f6a-423f-aac9-92b890c2b649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a050aa230943dea8def94ab5dd074d, user_id=0ea0fd18158d46aa8d34008ec64ac832, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:09.755683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953fe2b-0f6a-423f-aac9-92b890c2b649 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:09.799622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:09.925773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2add48-c1c4-4ec1-ab2f-5e3785514a10 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:09.926690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1119/2259] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:09 2022] PUT /identity/v3/projects/02a050aa230943dea8def94ab5dd074d/users/0ea0fd18158d46aa8d34008ec64ac832/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:09.942511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2add48-c1c4-4ec1-ab2f-5e3785514a10 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:10.029125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4156fb1-0a3f-4156-ac4f-2d4b83532451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:10.029593 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4156fb1-0a3f-4156-ac4f-2d4b83532451 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:10.029977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4156fb1-0a3f-4156-ac4f-2d4b83532451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:10.030267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4156fb1-0a3f-4156-ac4f-2d4b83532451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:10.031031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4156fb1-0a3f-4156-ac4f-2d4b83532451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:10.033218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4156fb1-0a3f-4156-ac4f-2d4b83532451 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:10.046931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1141/2260] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:10.050599 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953fe2b-0f6a-423f-aac9-92b890c2b649 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:10.062165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953fe2b-0f6a-423f-aac9-92b890c2b649 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:10.067300 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad7fad-5d08-4d6c-9f6b-24473d6d4ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:10.067978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad7fad-5d08-4d6c-9f6b-24473d6d4ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:10.068267 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad7fad-5d08-4d6c-9f6b-24473d6d4ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:10.068567 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad7fad-5d08-4d6c-9f6b-24473d6d4ac0 admin admin] PATH_INFO: `/v3/projects/02a050aa230943dea8def94ab5dd074d/users/0ea0fd18158d46aa8d34008ec64ac832/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:10.072227 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad7fad-5d08-4d6c-9f6b-24473d6d4ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a050aa230943dea8def94ab5dd074d, user_id=0ea0fd18158d46aa8d34008ec64ac832, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:10.075595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad7fad-5d08-4d6c-9f6b-24473d6d4ac0 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:10.088596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1120/2261] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:10 2022] PUT /identity/v3/projects/02a050aa230943dea8def94ab5dd074d/users/0ea0fd18158d46aa8d34008ec64ac832/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:44:10.101061 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab904373-d6e1-4edc-88ec-9cbbfe142baf None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:10.101345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab904373-d6e1-4edc-88ec-9cbbfe142baf None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:10.101661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab904373-d6e1-4edc-88ec-9cbbfe142baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:10.138197 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad7fad-5d08-4d6c-9f6b-24473d6d4ac0 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:10.150996 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-ab904373-d6e1-4edc-88ec-9cbbfe142baf None None] MFA Rules not processed for user `0ea0fd18158d46aa8d34008ec64ac832`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:10.152354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ab904373-d6e1-4edc-88ec-9cbbfe142baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:10.211753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad7fad-5d08-4d6c-9f6b-24473d6d4ac0 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:10.222651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa165d4c-d1c2-410e-8ced-d7f460050309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:10.224090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa165d4c-d1c2-410e-8ced-d7f460050309 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:10.224602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa165d4c-d1c2-410e-8ced-d7f460050309 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:10.225136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa165d4c-d1c2-410e-8ced-d7f460050309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:10.228468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fa165d4c-d1c2-410e-8ced-d7f460050309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:10.259468 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1142/2262] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:10.260474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab904373-d6e1-4edc-88ec-9cbbfe142baf None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:10.272736 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab904373-d6e1-4edc-88ec-9cbbfe142baf None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:10.277404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb661479-9f90-4792-872a-0b153981d88a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:10.277885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb661479-9f90-4792-872a-0b153981d88a service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:10.278166 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb661479-9f90-4792-872a-0b153981d88a service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:10.278440 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb661479-9f90-4792-872a-0b153981d88a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:10.320170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa165d4c-d1c2-410e-8ced-d7f460050309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:10.321696 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa165d4c-d1c2-410e-8ced-d7f460050309 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:10.336724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1121/2263] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:10.366463 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb661479-9f90-4792-872a-0b153981d88a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:10.368178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb661479-9f90-4792-872a-0b153981d88a service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:10.378967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1143/2264] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:11.474620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa165d4c-d1c2-410e-8ced-d7f460050309 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:11.483903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa165d4c-d1c2-410e-8ced-d7f460050309 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:11.487739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297378af-d047-4a3a-b1b4-d08752589769 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:11.488354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297378af-d047-4a3a-b1b4-d08752589769 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:11.488636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297378af-d047-4a3a-b1b4-d08752589769 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:11.488933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297378af-d047-4a3a-b1b4-d08752589769 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:11.501092 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297378af-d047-4a3a-b1b4-d08752589769 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:11.502930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297378af-d047-4a3a-b1b4-d08752589769 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:11.514228 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1122/2265] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:11.867445 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb661479-9f90-4792-872a-0b153981d88a service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:11.876751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb661479-9f90-4792-872a-0b153981d88a service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:11.880608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c932d8c-e28c-4a92-b65b-772fa72020d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:11.881793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932d8c-e28c-4a92-b65b-772fa72020d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:11.882266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932d8c-e28c-4a92-b65b-772fa72020d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:11.882765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c932d8c-e28c-4a92-b65b-772fa72020d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:11.947750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c932d8c-e28c-4a92-b65b-772fa72020d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:11.950758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c932d8c-e28c-4a92-b65b-772fa72020d0 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:11.970210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1144/2266] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:14.114690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:14.326005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:15.557255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297378af-d047-4a3a-b1b4-d08752589769 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:15.559282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-297378af-d047-4a3a-b1b4-d08752589769 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:15.640217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297378af-d047-4a3a-b1b4-d08752589769 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:15.646206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:15.649249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:15.650245 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:15.650892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] PATH_INFO: `/v3/users/4e93f5d75a4040f98bd7d525f61754b3` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:15.652851 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e93f5d75a4040f98bd7d525f61754b3)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:15.656178 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:16.006817 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e93f5d75a4040f98bd7d525f61754b3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:16.014471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e93f5d75a4040f98bd7d525f61754b3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:16.146358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e93f5d75a4040f98bd7d525f61754b3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:16.148105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e93f5d75a4040f98bd7d525f61754b3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:16.148784 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e93f5d75a4040f98bd7d525f61754b3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:16.171565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1123/2267] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:15 2022] DELETE /identity/v3/users/4e93f5d75a4040f98bd7d525f61754b3 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:16.176239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cb6ee-8661-4eb4-9c93-a4816ac7d713 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:16.176764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cb6ee-8661-4eb4-9c93-a4816ac7d713 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:16.176896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cb6ee-8661-4eb4-9c93-a4816ac7d713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:16.200232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-552cb6ee-8661-4eb4-9c93-a4816ac7d713 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:16.206266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-552cb6ee-8661-4eb4-9c93-a4816ac7d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:16.274454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1145/2268] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:44:16.289091 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:16.307052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:16.370023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c73b6d-ac63-43c9-8d82-066fd2943891 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:16.383257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9ce8c-7e88-4f7c-8b87-9798d6f0cd4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:16.385264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9ce8c-7e88-4f7c-8b87-9798d6f0cd4c service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:16.385264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9ce8c-7e88-4f7c-8b87-9798d6f0cd4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:16.385264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9ce8c-7e88-4f7c-8b87-9798d6f0cd4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:16.399597 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9ce8c-7e88-4f7c-8b87-9798d6f0cd4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:16.401187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9ce8c-7e88-4f7c-8b87-9798d6f0cd4c service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:16.411451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1124/2269] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:17.113632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cb6ee-8661-4eb4-9c93-a4816ac7d713 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:17.115954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-552cb6ee-8661-4eb4-9c93-a4816ac7d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:17.145052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cb6ee-8661-4eb4-9c93-a4816ac7d713 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:17.153632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:17.154622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:17.155023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:17.155392 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] PATH_INFO: `/v3/projects/59eac69d216046248710f1df59c9af0c` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:17.156745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59eac69d216046248710f1df59c9af0c)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:17.158945 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:17.520924 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59eac69d216046248710f1df59c9af0c', 'request_id': 'req-c178b233-3630-4767-88d8-8a6160d9761a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:17.625883 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59eac69d216046248710f1df59c9af0c', 'request_id': 'req-c178b233-3630-4767-88d8-8a6160d9761a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:17.633307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59eac69d216046248710f1df59c9af0c', 'request_id': 'req-c178b233-3630-4767-88d8-8a6160d9761a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:17.646152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] The token cache is being invalidate because project 59eac69d216046248710f1df59c9af0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:17.646450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:17.647547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:17.649296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1146/2270] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:17 2022] DELETE /identity/v3/projects/59eac69d216046248710f1df59c9af0c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:17.653657 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9ce8c-7e88-4f7c-8b87-9798d6f0cd4c service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:17.664011 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9ce8c-7e88-4f7c-8b87-9798d6f0cd4c service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:17.766360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90418494-65cb-4aa0-a52e-0e03a717d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:17.767444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90418494-65cb-4aa0-a52e-0e03a717d7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:17.767845 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90418494-65cb-4aa0-a52e-0e03a717d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:17.768223 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90418494-65cb-4aa0-a52e-0e03a717d7b1 admin admin] PATH_INFO: `/v3/users/ec650544cb5d4eea83aad8982001da4d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:17.772798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90418494-65cb-4aa0-a52e-0e03a717d7b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec650544cb5d4eea83aad8982001da4d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:17.775266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90418494-65cb-4aa0-a52e-0e03a717d7b1 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:18.112790 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-90418494-65cb-4aa0-a52e-0e03a717d7b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec650544cb5d4eea83aad8982001da4d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:18.122732 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-90418494-65cb-4aa0-a52e-0e03a717d7b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec650544cb5d4eea83aad8982001da4d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:18.292586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-90418494-65cb-4aa0-a52e-0e03a717d7b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec650544cb5d4eea83aad8982001da4d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:18.293402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-90418494-65cb-4aa0-a52e-0e03a717d7b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec650544cb5d4eea83aad8982001da4d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:18.294696 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-90418494-65cb-4aa0-a52e-0e03a717d7b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec650544cb5d4eea83aad8982001da4d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:18.323800 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1125/2271] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:17 2022] DELETE /identity/v3/users/ec650544cb5d4eea83aad8982001da4d => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:18.865750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:19.173490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:19.242262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:19.246227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:19.272600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178b233-3630-4767-88d8-8a6160d9761a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:19.388121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744736f7-e509-4221-9a4c-c977c55e1652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:19.389253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744736f7-e509-4221-9a4c-c977c55e1652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:19.389795 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744736f7-e509-4221-9a4c-c977c55e1652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:19.390288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744736f7-e509-4221-9a4c-c977c55e1652 admin admin] PATH_INFO: `/v3/projects/afe0e5119bb34dd183779eae6eda2c15` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:19.392302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744736f7-e509-4221-9a4c-c977c55e1652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe0e5119bb34dd183779eae6eda2c15)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:19.396085 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744736f7-e509-4221-9a4c-c977c55e1652 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:19.703017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-744736f7-e509-4221-9a4c-c977c55e1652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe0e5119bb34dd183779eae6eda2c15', 'request_id': 'req-744736f7-e509-4221-9a4c-c977c55e1652'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:19.874839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-744736f7-e509-4221-9a4c-c977c55e1652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe0e5119bb34dd183779eae6eda2c15', 'request_id': 'req-744736f7-e509-4221-9a4c-c977c55e1652'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:19.885932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-744736f7-e509-4221-9a4c-c977c55e1652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe0e5119bb34dd183779eae6eda2c15', 'request_id': 'req-744736f7-e509-4221-9a4c-c977c55e1652'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:19.908590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-744736f7-e509-4221-9a4c-c977c55e1652 admin admin] The token cache is being invalidate because project afe0e5119bb34dd183779eae6eda2c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:19.918689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-744736f7-e509-4221-9a4c-c977c55e1652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:19.918689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-744736f7-e509-4221-9a4c-c977c55e1652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:19.918689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1147/2272] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:19 2022] DELETE /identity/v3/projects/afe0e5119bb34dd183779eae6eda2c15 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:19.922555 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fde69-6f92-4608-a679-a88863fcf9e6 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:19.923306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fde69-6f92-4608-a679-a88863fcf9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:19.923306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82fde69-6f92-4608-a679-a88863fcf9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:19.947055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a82fde69-6f92-4608-a679-a88863fcf9e6 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:19.948390 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a82fde69-6f92-4608-a679-a88863fcf9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:20.025656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1126/2273] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:44:20.034881 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bad42-5629-4bdb-b421-8f928add2289 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:20.035177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bad42-5629-4bdb-b421-8f928add2289 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:20.035459 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bad42-5629-4bdb-b421-8f928add2289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:20.058477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-aa2bad42-5629-4bdb-b421-8f928add2289 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:20.059775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-aa2bad42-5629-4bdb-b421-8f928add2289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:20.070207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1148/2274] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:20.077283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fde69-6f92-4608-a679-a88863fcf9e6 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:20.096648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82fde69-6f92-4608-a679-a88863fcf9e6 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:20.106161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112b909-aaf0-46ad-9871-2a37c5b7627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:20.107437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112b909-aaf0-46ad-9871-2a37c5b7627d admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:20.107972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112b909-aaf0-46ad-9871-2a37c5b7627d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:20.108389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112b909-aaf0-46ad-9871-2a37c5b7627d admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:20.109191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112b909-aaf0-46ad-9871-2a37c5b7627d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:20.109749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112b909-aaf0-46ad-9871-2a37c5b7627d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:20.112661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112b909-aaf0-46ad-9871-2a37c5b7627d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:20.140017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1127/2275] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:44:20.145663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bad42-5629-4bdb-b421-8f928add2289 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:20.165800 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bad42-5629-4bdb-b421-8f928add2289 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:20.176081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2918c93-4f5f-48bd-bf1e-3fc65f0e426b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:20.177096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2918c93-4f5f-48bd-bf1e-3fc65f0e426b admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:20.177096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2918c93-4f5f-48bd-bf1e-3fc65f0e426b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:20.177405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2918c93-4f5f-48bd-bf1e-3fc65f0e426b admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:20.178418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2918c93-4f5f-48bd-bf1e-3fc65f0e426b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:20.182148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2918c93-4f5f-48bd-bf1e-3fc65f0e426b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:20.383418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1149/2276] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:20 2022] POST /identity/v3/projects => generated 375 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:44:20.392115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112b909-aaf0-46ad-9871-2a37c5b7627d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:20.404640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112b909-aaf0-46ad-9871-2a37c5b7627d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:20.476487 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10106201-7bab-4ce3-8ced-7b832aa12685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:20.476764 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10106201-7bab-4ce3-8ced-7b832aa12685 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:20.477003 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10106201-7bab-4ce3-8ced-7b832aa12685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:20.477416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10106201-7bab-4ce3-8ced-7b832aa12685 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:20.478466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10106201-7bab-4ce3-8ced-7b832aa12685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:20.479933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10106201-7bab-4ce3-8ced-7b832aa12685 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:20.669866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2918c93-4f5f-48bd-bf1e-3fc65f0e426b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:20.672590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b2918c93-4f5f-48bd-bf1e-3fc65f0e426b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:20.691838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2918c93-4f5f-48bd-bf1e-3fc65f0e426b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:20.703220 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:20.704069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:20.704645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:20.705142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] PATH_INFO: `/v3/users/774feb8667d8464bb11412cbda07e066` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:20.707385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] RBAC: Authorizing `identity:delete_user(user_id=774feb8667d8464bb11412cbda07e066)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:20.712057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:20.754991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1128/2277] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:20 2022] POST /identity/v3/users => generated 288 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:20.766768 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10106201-7bab-4ce3-8ced-7b832aa12685 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:20.793917 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10106201-7bab-4ce3-8ced-7b832aa12685 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:20.804399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85740d6f-0687-4b5b-87af-7491fd793941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:20.805430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85740d6f-0687-4b5b-87af-7491fd793941 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:20.806063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85740d6f-0687-4b5b-87af-7491fd793941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:20.806661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85740d6f-0687-4b5b-87af-7491fd793941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:20.808284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85740d6f-0687-4b5b-87af-7491fd793941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:20.811622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85740d6f-0687-4b5b-87af-7491fd793941 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:20.854232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1129/2278] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:44:20.860448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85740d6f-0687-4b5b-87af-7491fd793941 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:20.883394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85740d6f-0687-4b5b-87af-7491fd793941 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:20.895958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a00add-00c1-4f4d-87ad-54ae3910f60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:20.896960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a00add-00c1-4f4d-87ad-54ae3910f60f admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:20.897563 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a00add-00c1-4f4d-87ad-54ae3910f60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:20.898242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a00add-00c1-4f4d-87ad-54ae3910f60f admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:20.899278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a00add-00c1-4f4d-87ad-54ae3910f60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:20.902031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a00add-00c1-4f4d-87ad-54ae3910f60f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:20.917799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1130/2279] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:20.924209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a00add-00c1-4f4d-87ad-54ae3910f60f admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:20.936408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a00add-00c1-4f4d-87ad-54ae3910f60f admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:20.941555 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36243fe1-8e58-4355-b148-54a6801a418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:20.942239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36243fe1-8e58-4355-b148-54a6801a418a admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:20.942522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36243fe1-8e58-4355-b148-54a6801a418a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:20.942796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36243fe1-8e58-4355-b148-54a6801a418a admin admin] PATH_INFO: `/v3/projects/c78bf29078b448c69749efcaf615912c/users/142e7ad7c59c46efb62f934a7058fc02/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:20.961889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36243fe1-8e58-4355-b148-54a6801a418a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c78bf29078b448c69749efcaf615912c, user_id=142e7ad7c59c46efb62f934a7058fc02, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:20.964830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36243fe1-8e58-4355-b148-54a6801a418a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:21.143808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1131/2280] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:20 2022] PUT /identity/v3/projects/c78bf29078b448c69749efcaf615912c/users/142e7ad7c59c46efb62f934a7058fc02/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:44:21.165188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c64057-8005-41dc-b1fc-03d1709f7573 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:21.165612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c64057-8005-41dc-b1fc-03d1709f7573 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:21.172608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c64057-8005-41dc-b1fc-03d1709f7573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:21.172801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '774feb8667d8464bb11412cbda07e066'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:21.208406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '774feb8667d8464bb11412cbda07e066'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:21.219742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-63c64057-8005-41dc-b1fc-03d1709f7573 None None] MFA Rules not processed for user `142e7ad7c59c46efb62f934a7058fc02`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:21.221352 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-63c64057-8005-41dc-b1fc-03d1709f7573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:21.260829 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '774feb8667d8464bb11412cbda07e066'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:21.357947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1132/2281] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:44:21.357947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c64057-8005-41dc-b1fc-03d1709f7573 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:21.357947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-63c64057-8005-41dc-b1fc-03d1709f7573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:21.441362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c64057-8005-41dc-b1fc-03d1709f7573 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:21.445361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:21.446140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:21.446462 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:21.446785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] PATH_INFO: `/v3/users/229d5cefc4224c40a6d72ec1e1bff05a` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:21.448276 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229d5cefc4224c40a6d72ec1e1bff05a)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:21.451530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:21.462302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '774feb8667d8464bb11412cbda07e066'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:21.463459 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '774feb8667d8464bb11412cbda07e066'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:21.475461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1150/2282] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:20 2022] DELETE /identity/v3/users/774feb8667d8464bb11412cbda07e066 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:44:21.477042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:21.480342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:21.596405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead61cef-6894-4bd1-9f53-2d9f746d978f admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:21.605564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e2dc9-d242-4c42-b4dd-79aa64faa5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:21.613812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2dc9-d242-4c42-b4dd-79aa64faa5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:21.613812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2dc9-d242-4c42-b4dd-79aa64faa5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:21.613812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2dc9-d242-4c42-b4dd-79aa64faa5d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:21.613812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e2dc9-d242-4c42-b4dd-79aa64faa5d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:21.613812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e2dc9-d242-4c42-b4dd-79aa64faa5d3 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:21.800317 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1151/2283] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:21 2022] POST /identity/v3/projects => generated 375 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:21.801828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea249ee-f309-4493-82df-b48fd0746d00 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:21.802129 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea249ee-f309-4493-82df-b48fd0746d00 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:21.802435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea249ee-f309-4493-82df-b48fd0746d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:21.824969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5ea249ee-f309-4493-82df-b48fd0746d00 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:21.826283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5ea249ee-f309-4493-82df-b48fd0746d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:21.873422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229d5cefc4224c40a6d72ec1e1bff05a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:21.882357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229d5cefc4224c40a6d72ec1e1bff05a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:21.921244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1152/2284] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:21.922331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea249ee-f309-4493-82df-b48fd0746d00 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:21.923691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5ea249ee-f309-4493-82df-b48fd0746d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:21.937686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea249ee-f309-4493-82df-b48fd0746d00 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:21.942758 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e576b73c-e119-436a-89ef-7cb1371b9e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:21.943794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576b73c-e119-436a-89ef-7cb1371b9e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:21.944504 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576b73c-e119-436a-89ef-7cb1371b9e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:21.944841 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576b73c-e119-436a-89ef-7cb1371b9e0a admin admin] PATH_INFO: `/v3/users/12274478c8614fb8bc4c2e9f23f41022` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:21.946091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576b73c-e119-436a-89ef-7cb1371b9e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=12274478c8614fb8bc4c2e9f23f41022)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:21.948172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e576b73c-e119-436a-89ef-7cb1371b9e0a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:22.011773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229d5cefc4224c40a6d72ec1e1bff05a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:22.012844 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229d5cefc4224c40a6d72ec1e1bff05a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:22.013616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229d5cefc4224c40a6d72ec1e1bff05a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:22.044820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1133/2285] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:21 2022] DELETE /identity/v3/users/229d5cefc4224c40a6d72ec1e1bff05a => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:22.046452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:22.048687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:22.130354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b56353-c652-48f9-be8e-c0014ce5b452 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:22.135962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f3847-b860-4d67-9fd7-9e4abe1ad816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:22.136738 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f3847-b860-4d67-9fd7-9e4abe1ad816 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:22.137051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f3847-b860-4d67-9fd7-9e4abe1ad816 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:22.137409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f3847-b860-4d67-9fd7-9e4abe1ad816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:22.139497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-633f3847-b860-4d67-9fd7-9e4abe1ad816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:22.231373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f3847-b860-4d67-9fd7-9e4abe1ad816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:22.233427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f3847-b860-4d67-9fd7-9e4abe1ad816 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:22.247819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1134/2286] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:22.248713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f3847-b860-4d67-9fd7-9e4abe1ad816 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:22.250719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-633f3847-b860-4d67-9fd7-9e4abe1ad816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:22.358628 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f3847-b860-4d67-9fd7-9e4abe1ad816 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:22.364237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186d85e-e951-4ac8-ac1b-6abc245ae7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:22.364866 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186d85e-e951-4ac8-ac1b-6abc245ae7c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:22.365676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186d85e-e951-4ac8-ac1b-6abc245ae7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:22.365676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186d85e-e951-4ac8-ac1b-6abc245ae7c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:22.366350 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186d85e-e951-4ac8-ac1b-6abc245ae7c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:22.368336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186d85e-e951-4ac8-ac1b-6abc245ae7c7 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:22.403260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e576b73c-e119-436a-89ef-7cb1371b9e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12274478c8614fb8bc4c2e9f23f41022'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:22.418818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e576b73c-e119-436a-89ef-7cb1371b9e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12274478c8614fb8bc4c2e9f23f41022'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:22.426706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e576b73c-e119-436a-89ef-7cb1371b9e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12274478c8614fb8bc4c2e9f23f41022'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:22.507387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1135/2287] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:22 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:22.508220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186d85e-e951-4ac8-ac1b-6abc245ae7c7 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:22.510116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1186d85e-e951-4ac8-ac1b-6abc245ae7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:22.573956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186d85e-e951-4ac8-ac1b-6abc245ae7c7 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:22.578835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccb1f5-cb60-4b79-81e3-604c5989c2ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:22.579478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccb1f5-cb60-4b79-81e3-604c5989c2ef service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:22.579758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccb1f5-cb60-4b79-81e3-604c5989c2ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:22.580034 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccb1f5-cb60-4b79-81e3-604c5989c2ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:22.581852 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e576b73c-e119-436a-89ef-7cb1371b9e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12274478c8614fb8bc4c2e9f23f41022'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:22.582883 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-e576b73c-e119-436a-89ef-7cb1371b9e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12274478c8614fb8bc4c2e9f23f41022'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:22.583275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-86ccb1f5-cb60-4b79-81e3-604c5989c2ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:22.598322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccb1f5-cb60-4b79-81e3-604c5989c2ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:22.600216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1153/2288] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:21 2022] DELETE /identity/v3/users/12274478c8614fb8bc4c2e9f23f41022 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:22.602811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186884a1-d306-4288-96d2-fab11106c8b7 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:22.603369 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186884a1-d306-4288-96d2-fab11106c8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:22.603852 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186884a1-d306-4288-96d2-fab11106c8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:22.606458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccb1f5-cb60-4b79-81e3-604c5989c2ef service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:22.617343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1136/2289] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:22.618389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccb1f5-cb60-4b79-81e3-604c5989c2ef service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:22.628616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccb1f5-cb60-4b79-81e3-604c5989c2ef service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:22.642065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-186884a1-d306-4288-96d2-fab11106c8b7 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:22.644366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-186884a1-d306-4288-96d2-fab11106c8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:22.736032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba23375-76b4-4b37-ade3-77a364c97f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:22.737079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba23375-76b4-4b37-ade3-77a364c97f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:22.737631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba23375-76b4-4b37-ade3-77a364c97f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:22.738193 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba23375-76b4-4b37-ade3-77a364c97f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:22.739462 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba23375-76b4-4b37-ade3-77a364c97f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:22.743722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba23375-76b4-4b37-ade3-77a364c97f0e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:22.764040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1154/2290] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:22.764040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e67985-ecb7-43af-9ee2-d6594fcbafe0 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:22.764040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e67985-ecb7-43af-9ee2-d6594fcbafe0 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:22.764040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e67985-ecb7-43af-9ee2-d6594fcbafe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:22.769266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1137/2291] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:22.771094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba23375-76b4-4b37-ade3-77a364c97f0e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:22.774520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4ba23375-76b4-4b37-ade3-77a364c97f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:22.792904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-70e67985-ecb7-43af-9ee2-d6594fcbafe0 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:22.795027 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-70e67985-ecb7-43af-9ee2-d6594fcbafe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:22.799169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba23375-76b4-4b37-ade3-77a364c97f0e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:22.812706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1155/2292] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:22.812706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e67985-ecb7-43af-9ee2-d6594fcbafe0 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:22.813032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5b97-6021-48b6-b9b1-63362342d9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:22.813201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-70e67985-ecb7-43af-9ee2-d6594fcbafe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:22.814256 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5b97-6021-48b6-b9b1-63362342d9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:22.814694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5b97-6021-48b6-b9b1-63362342d9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:22.815174 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5b97-6021-48b6-b9b1-63362342d9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:22.816366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df5b97-6021-48b6-b9b1-63362342d9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:22.820122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df5b97-6021-48b6-b9b1-63362342d9c3 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:22.837535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1138/2293] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:22.839055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5b97-6021-48b6-b9b1-63362342d9c3 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:22.841771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f6df5b97-6021-48b6-b9b1-63362342d9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:22.926336 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e67985-ecb7-43af-9ee2-d6594fcbafe0 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:22.933031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f1260-66dd-4e61-a057-56435d18433d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:22.934055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f1260-66dd-4e61-a057-56435d18433d service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:22.934526 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f1260-66dd-4e61-a057-56435d18433d service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:22.934982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f1260-66dd-4e61-a057-56435d18433d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:22.949440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5b97-6021-48b6-b9b1-63362342d9c3 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:22.951707 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f1260-66dd-4e61-a057-56435d18433d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:22.954515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f1260-66dd-4e61-a057-56435d18433d service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:22.955668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09035e49-afc1-42ba-8aa1-cf5c61c5464a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:22.956670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09035e49-afc1-42ba-8aa1-cf5c61c5464a service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:22.957137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09035e49-afc1-42ba-8aa1-cf5c61c5464a service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:22.957644 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09035e49-afc1-42ba-8aa1-cf5c61c5464a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:22.972385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1156/2294] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:22.974556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f1260-66dd-4e61-a057-56435d18433d service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:22.976319 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09035e49-afc1-42ba-8aa1-cf5c61c5464a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:22.978499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09035e49-afc1-42ba-8aa1-cf5c61c5464a service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:22.992730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1139/2295] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:22.993703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09035e49-afc1-42ba-8aa1-cf5c61c5464a service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:22.995176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-09035e49-afc1-42ba-8aa1-cf5c61c5464a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:22.995913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f1260-66dd-4e61-a057-56435d18433d service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:23.011610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:23.018060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9f8e8-df1a-4524-95a8-ca2211061597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:23.019600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09035e49-afc1-42ba-8aa1-cf5c61c5464a service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:23.020366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f8e8-df1a-4524-95a8-ca2211061597 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:23.022030 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f8e8-df1a-4524-95a8-ca2211061597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:23.022539 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9f8e8-df1a-4524-95a8-ca2211061597 admin admin] PATH_INFO: `/v3/projects/5ff8ba193dad416880661db6e9a93125/users/b9ad9c41b2094b5589c3aa8e15a8b32e/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:23.028978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:23.030108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:23.031062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:23.031704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] PATH_INFO: `/v3/users/1426d68f936e43ec8857d1d9bd88af89` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:23.033969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1426d68f936e43ec8857d1d9bd88af89)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:23.037420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:23.081231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f8e8-df1a-4524-95a8-ca2211061597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff8ba193dad416880661db6e9a93125, user_id=b9ad9c41b2094b5589c3aa8e15a8b32e, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:23.087650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c9f8e8-df1a-4524-95a8-ca2211061597 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:23.215731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1157/2296] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:22 2022] PUT /identity/v3/projects/5ff8ba193dad416880661db6e9a93125/users/b9ad9c41b2094b5589c3aa8e15a8b32e/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:23.232466 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7ef47-ac5b-420c-9474-d504b177bb62 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:23.232744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7ef47-ac5b-420c-9474-d504b177bb62 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:23.233020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7ef47-ac5b-420c-9474-d504b177bb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:23.264780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-1ce7ef47-ac5b-420c-9474-d504b177bb62 None None] MFA Rules not processed for user `b9ad9c41b2094b5589c3aa8e15a8b32e`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:23.266114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1ce7ef47-ac5b-420c-9474-d504b177bb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:23.335584 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:23.346161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1158/2297] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:23.351794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7ef47-ac5b-420c-9474-d504b177bb62 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:23.419875 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1426d68f936e43ec8857d1d9bd88af89'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:23.435535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1426d68f936e43ec8857d1d9bd88af89'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:23.435712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7ef47-ac5b-420c-9474-d504b177bb62 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:23.441231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4e5b4-a212-44a5-9850-785119a01d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:23.441769 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4e5b4-a212-44a5-9850-785119a01d98 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:23.442054 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4e5b4-a212-44a5-9850-785119a01d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:23.442480 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4e5b4-a212-44a5-9850-785119a01d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:23.443374 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4e5b4-a212-44a5-9850-785119a01d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:23.445467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4e5b4-a212-44a5-9850-785119a01d98 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:23.664007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1426d68f936e43ec8857d1d9bd88af89'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:23.665125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1426d68f936e43ec8857d1d9bd88af89'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:23.666231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1426d68f936e43ec8857d1d9bd88af89'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:23.680479 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1159/2298] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:23 2022] POST /identity/v3/projects => generated 377 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:44:23.680479 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4e5b4-a212-44a5-9850-785119a01d98 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:23.683180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b9a4e5b4-a212-44a5-9850-785119a01d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:23.710912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1140/2299] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:22 2022] DELETE /identity/v3/users/1426d68f936e43ec8857d1d9bd88af89 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:23.715426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:23.717232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:23.790013 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4e5b4-a212-44a5-9850-785119a01d98 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:23.848839 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e2e78-5ea3-4cb1-a82e-af9f1d51a77d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:23.858605 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2800a-fd45-46a0-be8e-658659fd57af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:23.859200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2800a-fd45-46a0-be8e-658659fd57af admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:23.859568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2800a-fd45-46a0-be8e-658659fd57af admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:23.859910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2800a-fd45-46a0-be8e-658659fd57af admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:23.860912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2800a-fd45-46a0-be8e-658659fd57af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:23.863193 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2800a-fd45-46a0-be8e-658659fd57af admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:23.910309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:23.911462 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:23.911970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:23.912536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] PATH_INFO: `/v3/projects/85534645c64443d4bde0d2642f4a9cc2` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:23.915133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85534645c64443d4bde0d2642f4a9cc2)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:23.932464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:24.013640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1141/2300] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:23 2022] POST /identity/v3/users => generated 295 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:24.015903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a4b12-21ed-438d-8b9e-3dc0c8c2850b None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:24.016266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a4b12-21ed-438d-8b9e-3dc0c8c2850b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:24.016700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a4b12-21ed-438d-8b9e-3dc0c8c2850b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:24.039042 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-025a4b12-21ed-438d-8b9e-3dc0c8c2850b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:24.040371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-025a4b12-21ed-438d-8b9e-3dc0c8c2850b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:24.061538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1142/2301] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:24.061538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a4b12-21ed-438d-8b9e-3dc0c8c2850b None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:24.061538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-025a4b12-21ed-438d-8b9e-3dc0c8c2850b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:24.075025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a4b12-21ed-438d-8b9e-3dc0c8c2850b None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:24.082313 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:24.083658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:24.084999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:24.085599 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] PATH_INFO: `/v3/projects/d544520f30a14679b9effde392687c1c` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:24.087842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d544520f30a14679b9effde392687c1c)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:24.091818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:24.157698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85534645c64443d4bde0d2642f4a9cc2', 'request_id': 'req-2f0921fc-f8db-4a16-875e-f3b1595d8e42'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.278360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85534645c64443d4bde0d2642f4a9cc2', 'request_id': 'req-2f0921fc-f8db-4a16-875e-f3b1595d8e42'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.290879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85534645c64443d4bde0d2642f4a9cc2', 'request_id': 'req-2f0921fc-f8db-4a16-875e-f3b1595d8e42'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.309533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] The token cache is being invalidate because project 85534645c64443d4bde0d2642f4a9cc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:24.309813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd544520f30a14679b9effde392687c1c', 'request_id': 'req-bd516348-9325-4a94-a916-113a393369a7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.310023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.310964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.313231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1160/2302] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:23 2022] DELETE /identity/v3/projects/85534645c64443d4bde0d2642f4a9cc2 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:24.317977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:24.317977 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:24.321546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd544520f30a14679b9effde392687c1c', 'request_id': 'req-bd516348-9325-4a94-a916-113a393369a7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.395152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0921fc-f8db-4a16-875e-f3b1595d8e42 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:24.470830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:24.471578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:24.471759 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:24.472033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] PATH_INFO: `/v3/projects/075c9b8febed440abc1df698f1406650` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:24.473302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=075c9b8febed440abc1df698f1406650)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:24.476161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:24.577415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd544520f30a14679b9effde392687c1c', 'request_id': 'req-bd516348-9325-4a94-a916-113a393369a7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.591780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] The token cache is being invalidate because project d544520f30a14679b9effde392687c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:24.592076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.592788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.594425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1143/2303] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:24 2022] DELETE /identity/v3/projects/d544520f30a14679b9effde392687c1c => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:24.595188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:24.596554 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:24.611042 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd516348-9325-4a94-a916-113a393369a7 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:24.616849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46ad62-7de9-4037-a115-a64ae5acbd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:24.617846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46ad62-7de9-4037-a115-a64ae5acbd13 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:24.617846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46ad62-7de9-4037-a115-a64ae5acbd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:24.618042 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46ad62-7de9-4037-a115-a64ae5acbd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:24.618803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46ad62-7de9-4037-a115-a64ae5acbd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:24.620428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46ad62-7de9-4037-a115-a64ae5acbd13 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:24.632109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1144/2304] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:24.633028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46ad62-7de9-4037-a115-a64ae5acbd13 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:24.634785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6e46ad62-7de9-4037-a115-a64ae5acbd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:24.674680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075c9b8febed440abc1df698f1406650', 'request_id': 'req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.703683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46ad62-7de9-4037-a115-a64ae5acbd13 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:24.763915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cbf25-3a3a-423f-85d9-3a4426a754c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:24.764558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cbf25-3a3a-423f-85d9-3a4426a754c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:24.765640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cbf25-3a3a-423f-85d9-3a4426a754c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:24.765640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4cbf25-3a3a-423f-85d9-3a4426a754c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:24.767194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9c4cbf25-3a3a-423f-85d9-3a4426a754c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:24.813288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075c9b8febed440abc1df698f1406650', 'request_id': 'req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.813288 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075c9b8febed440abc1df698f1406650', 'request_id': 'req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.838461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] The token cache is being invalidate because project 075c9b8febed440abc1df698f1406650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:24.838787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.839526 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:24.841159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1161/2305] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:24 2022] DELETE /identity/v3/projects/075c9b8febed440abc1df698f1406650 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:24.842178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:24.843703 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:24.858991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cbf25-3a3a-423f-85d9-3a4426a754c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:24.860499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4cbf25-3a3a-423f-85d9-3a4426a754c0 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:24.872668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1145/2306] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:24.873618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cbf25-3a3a-423f-85d9-3a4426a754c0 service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:24.875086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9c4cbf25-3a3a-423f-85d9-3a4426a754c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:24.889749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4cbf25-3a3a-423f-85d9-3a4426a754c0 service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:24.901138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:24.901957 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:24.902259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:24.902992 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] PATH_INFO: `/v3/users/f0f9a2e218b14daea9a4c74fbc0c7302` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:24.903912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f9a2e218b14daea9a4c74fbc0c7302)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:24.906061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:24.937570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd897e-edb1-496e-9e06-b71b9c32e3f8 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:24.942611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc5919-f29f-4bf6-8f63-24c729cfe8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:24.943309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc5919-f29f-4bf6-8f63-24c729cfe8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:24.943596 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc5919-f29f-4bf6-8f63-24c729cfe8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:24.943885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc5919-f29f-4bf6-8f63-24c729cfe8b3 admin admin] PATH_INFO: `/v3/users/6969325e44d742e2a3b3ac7ca8629fad` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:24.945293 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc5919-f29f-4bf6-8f63-24c729cfe8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6969325e44d742e2a3b3ac7ca8629fad)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:24.949156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc5919-f29f-4bf6-8f63-24c729cfe8b3 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:25.219098 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-20fc5919-f29f-4bf6-8f63-24c729cfe8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6969325e44d742e2a3b3ac7ca8629fad'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:25.231422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f9a2e218b14daea9a4c74fbc0c7302'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:25.247392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f9a2e218b14daea9a4c74fbc0c7302'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:25.259109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-20fc5919-f29f-4bf6-8f63-24c729cfe8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6969325e44d742e2a3b3ac7ca8629fad'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:25.273936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-20fc5919-f29f-4bf6-8f63-24c729cfe8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6969325e44d742e2a3b3ac7ca8629fad'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:25.363299 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f9a2e218b14daea9a4c74fbc0c7302'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:25.364415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f9a2e218b14daea9a4c74fbc0c7302'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:25.366740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f9a2e218b14daea9a4c74fbc0c7302'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:25.401300 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1146/2307] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:24 2022] DELETE /identity/v3/users/f0f9a2e218b14daea9a4c74fbc0c7302 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:25.402842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:25.407052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:25.508247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ed325-9650-41fd-a27d-b30c97ea74eb admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:25.520712 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f361dd-9514-4a80-8fd8-25b4e1baebcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:25.522294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f361dd-9514-4a80-8fd8-25b4e1baebcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:25.522294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f361dd-9514-4a80-8fd8-25b4e1baebcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:25.522294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f361dd-9514-4a80-8fd8-25b4e1baebcd admin admin] PATH_INFO: `/v3/projects/7a5013100ae245a9a79edba26f56c54f/users/b608f0bf2eec4ce5b668706d078ddba6/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:25.536250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-20fc5919-f29f-4bf6-8f63-24c729cfe8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6969325e44d742e2a3b3ac7ca8629fad'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:25.548262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-20fc5919-f29f-4bf6-8f63-24c729cfe8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6969325e44d742e2a3b3ac7ca8629fad'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:25.548655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f361dd-9514-4a80-8fd8-25b4e1baebcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a5013100ae245a9a79edba26f56c54f, user_id=b608f0bf2eec4ce5b668706d078ddba6, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:25.550725 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f361dd-9514-4a80-8fd8-25b4e1baebcd admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:25.554742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1162/2308] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:24 2022] DELETE /identity/v3/users/6969325e44d742e2a3b3ac7ca8629fad => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:25.554981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a543c1-136d-49de-a2d2-45e3fabcbfef None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:25.555325 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a543c1-136d-49de-a2d2-45e3fabcbfef None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:25.555673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a543c1-136d-49de-a2d2-45e3fabcbfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:25.605489 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:25.617738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-75a543c1-136d-49de-a2d2-45e3fabcbfef None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:25.621150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-75a543c1-136d-49de-a2d2-45e3fabcbfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:25.686592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1147/2309] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:25 2022] PUT /identity/v3/projects/7a5013100ae245a9a79edba26f56c54f/users/b608f0bf2eec4ce5b668706d078ddba6/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:25.686592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f361dd-9514-4a80-8fd8-25b4e1baebcd admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:25.690195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-55f361dd-9514-4a80-8fd8-25b4e1baebcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:25.777683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1163/2310] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:25.780502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a543c1-136d-49de-a2d2-45e3fabcbfef None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:25.784304 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-75a543c1-136d-49de-a2d2-45e3fabcbfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:25.803232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f361dd-9514-4a80-8fd8-25b4e1baebcd admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:25.810771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:25.810771 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:25.811419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:25.811419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] PATH_INFO: `/v3/projects/8b31ccbc87c24b638452b1bbc63c12b1` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:25.812881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b31ccbc87c24b638452b1bbc63c12b1)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:25.815441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:25.841778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a543c1-136d-49de-a2d2-45e3fabcbfef None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:25.846234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:25.859022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28faae-97df-4cf5-8749-318c8fa9eab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:25.860423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28faae-97df-4cf5-8749-318c8fa9eab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:25.860595 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28faae-97df-4cf5-8749-318c8fa9eab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:25.860967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28faae-97df-4cf5-8749-318c8fa9eab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:25.862244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28faae-97df-4cf5-8749-318c8fa9eab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:25.865888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28faae-97df-4cf5-8749-318c8fa9eab4 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:25.890610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1164/2311] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:25.895105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed17680-d526-47bc-8509-70237e964ae8 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:25.895899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed17680-d526-47bc-8509-70237e964ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:25.897241 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed17680-d526-47bc-8509-70237e964ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:25.935586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-6ed17680-d526-47bc-8509-70237e964ae8 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:25.937856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6ed17680-d526-47bc-8509-70237e964ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:25.951469 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1165/2312] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:25.956652 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed17680-d526-47bc-8509-70237e964ae8 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:25.982043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed17680-d526-47bc-8509-70237e964ae8 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:25.992022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd2ec6-eca4-498d-85e5-081e86fa099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:25.993413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd2ec6-eca4-498d-85e5-081e86fa099a admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:25.994521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd2ec6-eca4-498d-85e5-081e86fa099a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:25.995351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd2ec6-eca4-498d-85e5-081e86fa099a admin admin] PATH_INFO: `/v3/projects/7a5013100ae245a9a79edba26f56c54f/users/b608f0bf2eec4ce5b668706d078ddba6/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:25.998909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd2ec6-eca4-498d-85e5-081e86fa099a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a5013100ae245a9a79edba26f56c54f, user_id=b608f0bf2eec4ce5b668706d078ddba6, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:26.003357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd2ec6-eca4-498d-85e5-081e86fa099a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:26.017610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1166/2313] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:25 2022] PUT /identity/v3/projects/7a5013100ae245a9a79edba26f56c54f/users/b608f0bf2eec4ce5b668706d078ddba6/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:26.031825 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd2ec6-eca4-498d-85e5-081e86fa099a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:26.108672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b31ccbc87c24b638452b1bbc63c12b1', 'request_id': 'req-965a8438-21fb-4de4-9076-0a9d8389e130'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:26.123654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b31ccbc87c24b638452b1bbc63c12b1', 'request_id': 'req-965a8438-21fb-4de4-9076-0a9d8389e130'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:26.200500 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd2ec6-eca4-498d-85e5-081e86fa099a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:26.293972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c55101-3b71-4ff5-9e6e-45aa950f2be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:26.294600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55101-3b71-4ff5-9e6e-45aa950f2be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:26.294883 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55101-3b71-4ff5-9e6e-45aa950f2be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:26.295159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c55101-3b71-4ff5-9e6e-45aa950f2be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:26.295876 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c55101-3b71-4ff5-9e6e-45aa950f2be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:26.296183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c55101-3b71-4ff5-9e6e-45aa950f2be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:26.297848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c55101-3b71-4ff5-9e6e-45aa950f2be1 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:26.314433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1167/2314] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:26.314433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8895ca1-83f4-48f9-8e0f-e03eb7d6504f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:26.314433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8895ca1-83f4-48f9-8e0f-e03eb7d6504f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:26.314433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8895ca1-83f4-48f9-8e0f-e03eb7d6504f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:26.342605 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b31ccbc87c24b638452b1bbc63c12b1', 'request_id': 'req-965a8438-21fb-4de4-9076-0a9d8389e130'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:26.346864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-b8895ca1-83f4-48f9-8e0f-e03eb7d6504f None None] MFA Rules not processed for user `b608f0bf2eec4ce5b668706d078ddba6`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:26.348119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b8895ca1-83f4-48f9-8e0f-e03eb7d6504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:26.355893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] The token cache is being invalidate because project 8b31ccbc87c24b638452b1bbc63c12b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:26.356191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:26.356889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:26.358501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1148/2315] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:25 2022] DELETE /identity/v3/projects/8b31ccbc87c24b638452b1bbc63c12b1 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:26.361598 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:26.361598 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:26.375050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a8438-21fb-4de4-9076-0a9d8389e130 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:26.379943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96676b-2183-4448-b142-4d6053c6c157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:26.382263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96676b-2183-4448-b142-4d6053c6c157 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:26.382263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96676b-2183-4448-b142-4d6053c6c157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:26.382263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96676b-2183-4448-b142-4d6053c6c157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:26.382622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96676b-2183-4448-b142-4d6053c6c157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:26.384518 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96676b-2183-4448-b142-4d6053c6c157 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:26.445685 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1168/2316] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:26.446681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8895ca1-83f4-48f9-8e0f-e03eb7d6504f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:26.447903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b8895ca1-83f4-48f9-8e0f-e03eb7d6504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:26.464588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8895ca1-83f4-48f9-8e0f-e03eb7d6504f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:26.472870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:26.473815 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:26.474095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:26.475373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] PATH_INFO: `/v3/users/0ea0fd18158d46aa8d34008ec64ac832` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:26.476777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea0fd18158d46aa8d34008ec64ac832)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:26.478997 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:26.565940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1149/2317] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:26 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:26.579253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96676b-2183-4448-b142-4d6053c6c157 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:26.579253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1a96676b-2183-4448-b142-4d6053c6c157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:26.664698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96676b-2183-4448-b142-4d6053c6c157 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:26.664698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:26.664698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:26.664698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:26.665398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] PATH_INFO: `/v3/projects/80e13004e5b34e55a92e9ecd51ee7f9c` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:26.665398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e13004e5b34e55a92e9ecd51ee7f9c)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:26.665398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:26.995221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea0fd18158d46aa8d34008ec64ac832'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.003003 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e13004e5b34e55a92e9ecd51ee7f9c', 'request_id': 'req-2d37bc52-9420-4297-b85e-abec052d25d1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.015735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e13004e5b34e55a92e9ecd51ee7f9c', 'request_id': 'req-2d37bc52-9420-4297-b85e-abec052d25d1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.019785 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea0fd18158d46aa8d34008ec64ac832'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.030489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea0fd18158d46aa8d34008ec64ac832'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.209919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e13004e5b34e55a92e9ecd51ee7f9c', 'request_id': 'req-2d37bc52-9420-4297-b85e-abec052d25d1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.223101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] The token cache is being invalidate because project 80e13004e5b34e55a92e9ecd51ee7f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:27.223399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.226525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.231080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1150/2318] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:26 2022] DELETE /identity/v3/projects/80e13004e5b34e55a92e9ecd51ee7f9c => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:27.232065 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:27.234552 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:27.319813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37bc52-9420-4297-b85e-abec052d25d1 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:27.329693 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30502d69-852a-4d4d-9c12-a3f062252784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:27.330596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30502d69-852a-4d4d-9c12-a3f062252784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:27.330968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30502d69-852a-4d4d-9c12-a3f062252784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:27.331367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30502d69-852a-4d4d-9c12-a3f062252784 admin admin] PATH_INFO: `/v3/projects/f17ba7393e8546b7a9538c032b2b62d2` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:27.333020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30502d69-852a-4d4d-9c12-a3f062252784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17ba7393e8546b7a9538c032b2b62d2)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:27.343246 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30502d69-852a-4d4d-9c12-a3f062252784 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:27.354474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea0fd18158d46aa8d34008ec64ac832'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.355835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea0fd18158d46aa8d34008ec64ac832'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.366501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1169/2319] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:26 2022] DELETE /identity/v3/users/0ea0fd18158d46aa8d34008ec64ac832 => generated 0 bytes in 920 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:27.371598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:27.371598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:27.477341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a375f-64bb-43a1-928b-cc63edad1af7 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:27.482007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7cac4-d643-4052-85aa-4aef664f1ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:27.482820 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7cac4-d643-4052-85aa-4aef664f1ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:27.483244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7cac4-d643-4052-85aa-4aef664f1ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:27.483604 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7cac4-d643-4052-85aa-4aef664f1ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:27.486285 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5ee7cac4-d643-4052-85aa-4aef664f1ef0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:27.576753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7cac4-d643-4052-85aa-4aef664f1ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:27.578267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7cac4-d643-4052-85aa-4aef664f1ef0 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:27.590267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1170/2320] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:27.591379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7cac4-d643-4052-85aa-4aef664f1ef0 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:27.599439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5ee7cac4-d643-4052-85aa-4aef664f1ef0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:27.629625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-30502d69-852a-4d4d-9c12-a3f062252784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17ba7393e8546b7a9538c032b2b62d2', 'request_id': 'req-30502d69-852a-4d4d-9c12-a3f062252784'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.656698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-30502d69-852a-4d4d-9c12-a3f062252784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17ba7393e8546b7a9538c032b2b62d2', 'request_id': 'req-30502d69-852a-4d4d-9c12-a3f062252784'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.729560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7cac4-d643-4052-85aa-4aef664f1ef0 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:27.762117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-30502d69-852a-4d4d-9c12-a3f062252784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17ba7393e8546b7a9538c032b2b62d2', 'request_id': 'req-30502d69-852a-4d4d-9c12-a3f062252784'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.794208 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-30502d69-852a-4d4d-9c12-a3f062252784 admin admin] The token cache is being invalidate because project f17ba7393e8546b7a9538c032b2b62d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:27.794692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-30502d69-852a-4d4d-9c12-a3f062252784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.795904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-30502d69-852a-4d4d-9c12-a3f062252784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:27.801020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1151/2321] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:27 2022] DELETE /identity/v3/projects/f17ba7393e8546b7a9538c032b2b62d2 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:27.804284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b46bef-2935-486d-9486-4aee108f044c None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:27.804808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b46bef-2935-486d-9486-4aee108f044c None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:27.805505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b46bef-2935-486d-9486-4aee108f044c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:27.846566 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-c6b46bef-2935-486d-9486-4aee108f044c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:27.849296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c6b46bef-2935-486d-9486-4aee108f044c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:27.877158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2000a4-420b-44f5-94ce-e7bd0aedd142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:27.877961 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2000a4-420b-44f5-94ce-e7bd0aedd142 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:27.878294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2000a4-420b-44f5-94ce-e7bd0aedd142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:27.878613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2000a4-420b-44f5-94ce-e7bd0aedd142 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:27.879653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2000a4-420b-44f5-94ce-e7bd0aedd142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:27.881827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2000a4-420b-44f5-94ce-e7bd0aedd142 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:27.961789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1152/2322] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:27.963401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d156c-0494-4557-99ae-af13763c4376 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:27.963861 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d156c-0494-4557-99ae-af13763c4376 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:27.964327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d156c-0494-4557-99ae-af13763c4376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:27.997925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-bd2d156c-0494-4557-99ae-af13763c4376 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:28.000093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bd2d156c-0494-4557-99ae-af13763c4376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:28.013792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:28.026731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1171/2323] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:27 2022] POST /identity/v3/users => generated 288 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:28.032077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1153/2324] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:28.033659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d156c-0494-4557-99ae-af13763c4376 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:28.033986 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf622a-a371-4a81-9891-324ae84f4324 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:28.034359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf622a-a371-4a81-9891-324ae84f4324 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:28.034734 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf622a-a371-4a81-9891-324ae84f4324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:28.041093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bd2d156c-0494-4557-99ae-af13763c4376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:28.060389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d156c-0494-4557-99ae-af13763c4376 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:28.077289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5ebf622a-a371-4a81-9891-324ae84f4324 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:28.078565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f375f01-e9ad-42b0-8e65-2679710fecf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:28.079720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f375f01-e9ad-42b0-8e65-2679710fecf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:28.080251 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5ebf622a-a371-4a81-9891-324ae84f4324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:28.080521 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f375f01-e9ad-42b0-8e65-2679710fecf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:28.080776 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f375f01-e9ad-42b0-8e65-2679710fecf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:28.082557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f375f01-e9ad-42b0-8e65-2679710fecf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:28.087545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f375f01-e9ad-42b0-8e65-2679710fecf3 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:28.101089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1172/2325] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:28.104135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65771fb5-1a57-4060-a98d-4ab0ac5d4f7b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:28.104787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65771fb5-1a57-4060-a98d-4ab0ac5d4f7b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:28.105696 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65771fb5-1a57-4060-a98d-4ab0ac5d4f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:28.121888 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1154/2326] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:28.123587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f375f01-e9ad-42b0-8e65-2679710fecf3 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:28.131312 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9f375f01-e9ad-42b0-8e65-2679710fecf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:28.158765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-65771fb5-1a57-4060-a98d-4ab0ac5d4f7b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:28.161239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-65771fb5-1a57-4060-a98d-4ab0ac5d4f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:28.168725 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f375f01-e9ad-42b0-8e65-2679710fecf3 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:28.176754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:28.178100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:28.179246 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:28.179246 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] PATH_INFO: `/v3/projects/02a050aa230943dea8def94ab5dd074d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:28.183680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a050aa230943dea8def94ab5dd074d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:28.187142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:28.191861 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1173/2327] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:28.195534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65771fb5-1a57-4060-a98d-4ab0ac5d4f7b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:28.216404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65771fb5-1a57-4060-a98d-4ab0ac5d4f7b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:28.237669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3de9c0-98d0-4b39-b634-1e77e174fe69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:28.238125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3de9c0-98d0-4b39-b634-1e77e174fe69 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:28.238473 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3de9c0-98d0-4b39-b634-1e77e174fe69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:28.238797 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3de9c0-98d0-4b39-b634-1e77e174fe69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:28.239636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3de9c0-98d0-4b39-b634-1e77e174fe69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:28.240917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3de9c0-98d0-4b39-b634-1e77e174fe69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:28.244925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3de9c0-98d0-4b39-b634-1e77e174fe69 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:28.269741 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1174/2328] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:28.272042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3de9c0-98d0-4b39-b634-1e77e174fe69 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:28.288243 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3de9c0-98d0-4b39-b634-1e77e174fe69 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:28.295869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144bda5-9b98-41bf-8029-53022a67a1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:28.296830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144bda5-9b98-41bf-8029-53022a67a1ea admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:28.297309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144bda5-9b98-41bf-8029-53022a67a1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:28.297863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144bda5-9b98-41bf-8029-53022a67a1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:28.298974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144bda5-9b98-41bf-8029-53022a67a1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:28.301115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144bda5-9b98-41bf-8029-53022a67a1ea admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:28.315988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1175/2329] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:28.317516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144bda5-9b98-41bf-8029-53022a67a1ea admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:28.335475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:28.342618 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144bda5-9b98-41bf-8029-53022a67a1ea admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:28.350239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1e55e-b788-4f6d-971d-d53c89bcc506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:28.351328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1e55e-b788-4f6d-971d-d53c89bcc506 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:28.351836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1e55e-b788-4f6d-971d-d53c89bcc506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:28.352337 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1e55e-b788-4f6d-971d-d53c89bcc506 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:28.353489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1e55e-b788-4f6d-971d-d53c89bcc506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:28.353941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1e55e-b788-4f6d-971d-d53c89bcc506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:28.356042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1e55e-b788-4f6d-971d-d53c89bcc506 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:28.373524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1176/2330] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:28.375110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1e55e-b788-4f6d-971d-d53c89bcc506 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:28.397057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1e55e-b788-4f6d-971d-d53c89bcc506 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:28.415371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a050aa230943dea8def94ab5dd074d', 'request_id': 'req-705861e1-92d7-4dbe-babf-b1fb09d41554'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:28.424812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a050aa230943dea8def94ab5dd074d', 'request_id': 'req-705861e1-92d7-4dbe-babf-b1fb09d41554'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:28.487878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9087c-a5e4-4d08-8507-29c0fe44a160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:28.488538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9087c-a5e4-4d08-8507-29c0fe44a160 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:28.488818 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9087c-a5e4-4d08-8507-29c0fe44a160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:28.489254 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9087c-a5e4-4d08-8507-29c0fe44a160 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:28.490156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9087c-a5e4-4d08-8507-29c0fe44a160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:28.492689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9087c-a5e4-4d08-8507-29c0fe44a160 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:28.549195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a050aa230943dea8def94ab5dd074d', 'request_id': 'req-705861e1-92d7-4dbe-babf-b1fb09d41554'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:28.563450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] The token cache is being invalidate because project 02a050aa230943dea8def94ab5dd074d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:28.563763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:28.564491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:28.571431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1155/2331] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:28 2022] DELETE /identity/v3/projects/02a050aa230943dea8def94ab5dd074d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:28.571431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:28.571431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:28.588202 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705861e1-92d7-4dbe-babf-b1fb09d41554 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:28.594009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc5366-03cb-4055-bf8f-beba6a5c2a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:28.598821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc5366-03cb-4055-bf8f-beba6a5c2a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:28.598821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc5366-03cb-4055-bf8f-beba6a5c2a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:28.598821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc5366-03cb-4055-bf8f-beba6a5c2a15 admin admin] PATH_INFO: `/v3/projects/d4f0deda842b4628b7338940197b89d7/users/989c7dac3dd5478a93d7e11702662eea/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:28.615220 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc5366-03cb-4055-bf8f-beba6a5c2a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f0deda842b4628b7338940197b89d7, user_id=989c7dac3dd5478a93d7e11702662eea, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:28.618170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc5366-03cb-4055-bf8f-beba6a5c2a15 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:28.700770 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1177/2332] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:28 2022] POST /identity/v3/projects => generated 365 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:28.701837 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9087c-a5e4-4d08-8507-29c0fe44a160 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:28.707525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f7e9087c-a5e4-4d08-8507-29c0fe44a160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:28.801524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1156/2333] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:28 2022] PUT /identity/v3/projects/d4f0deda842b4628b7338940197b89d7/users/989c7dac3dd5478a93d7e11702662eea/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:28.801524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884aef1a-fb47-497c-a77c-9c5ab90a37bd None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:28.801524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884aef1a-fb47-497c-a77c-9c5ab90a37bd None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:28.801524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884aef1a-fb47-497c-a77c-9c5ab90a37bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:28.814589 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-884aef1a-fb47-497c-a77c-9c5ab90a37bd None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:28.815544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-884aef1a-fb47-497c-a77c-9c5ab90a37bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:28.823109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9087c-a5e4-4d08-8507-29c0fe44a160 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:28.908427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac2eb7-3bc3-46e7-8b8c-8078e9364b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:28.909050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2eb7-3bc3-46e7-8b8c-8078e9364b3e admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:28.909331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2eb7-3bc3-46e7-8b8c-8078e9364b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:28.909637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2eb7-3bc3-46e7-8b8c-8078e9364b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:28.910286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac2eb7-3bc3-46e7-8b8c-8078e9364b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:28.912546 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac2eb7-3bc3-46e7-8b8c-8078e9364b3e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:28.925971 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1157/2334] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:28.928062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884aef1a-fb47-497c-a77c-9c5ab90a37bd None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:28.930669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-884aef1a-fb47-497c-a77c-9c5ab90a37bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:28.953236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884aef1a-fb47-497c-a77c-9c5ab90a37bd None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:28.961874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef854134-5597-4b81-a1e4-ea27f4d50a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:28.962507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef854134-5597-4b81-a1e4-ea27f4d50a8a admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:28.962791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef854134-5597-4b81-a1e4-ea27f4d50a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:28.963073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef854134-5597-4b81-a1e4-ea27f4d50a8a admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:28.963827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef854134-5597-4b81-a1e4-ea27f4d50a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:28.965840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef854134-5597-4b81-a1e4-ea27f4d50a8a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:29.087239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1178/2335] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:28 2022] POST /identity/v3/projects => generated 379 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:29.087239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8fb55-14bc-4a67-87c5-82b1808fdba7 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:29.087239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8fb55-14bc-4a67-87c5-82b1808fdba7 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:29.087239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8fb55-14bc-4a67-87c5-82b1808fdba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:29.123105 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-00a8fb55-14bc-4a67-87c5-82b1808fdba7 None None] MFA Rules not processed for user `989c7dac3dd5478a93d7e11702662eea`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:29.126772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-00a8fb55-14bc-4a67-87c5-82b1808fdba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:29.129234 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1158/2336] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:28 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:29.131271 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907b4e0-ebfb-442f-875d-7629386a320d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:29.131564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907b4e0-ebfb-442f-875d-7629386a320d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:29.131838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907b4e0-ebfb-442f-875d-7629386a320d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:29.154252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b907b4e0-ebfb-442f-875d-7629386a320d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:29.155586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b907b4e0-ebfb-442f-875d-7629386a320d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:29.217544 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1179/2337] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:29.224127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8fb55-14bc-4a67-87c5-82b1808fdba7 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:29.236321 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1159/2338] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:29.238493 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907b4e0-ebfb-442f-875d-7629386a320d None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:29.254501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907b4e0-ebfb-442f-875d-7629386a320d None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:29.263106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f87270-aff5-4247-bd71-d064a7396778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:29.264644 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f87270-aff5-4247-bd71-d064a7396778 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:29.265428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f87270-aff5-4247-bd71-d064a7396778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:29.265946 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f87270-aff5-4247-bd71-d064a7396778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:29.267450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f87270-aff5-4247-bd71-d064a7396778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:29.272234 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f87270-aff5-4247-bd71-d064a7396778 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:29.289494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1160/2339] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:29.291203 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f87270-aff5-4247-bd71-d064a7396778 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:29.294688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-15f87270-aff5-4247-bd71-d064a7396778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:29.346308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8fb55-14bc-4a67-87c5-82b1808fdba7 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:29.358179 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3bfcc-f878-49f2-8ad3-a09195c1d140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:29.360705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3bfcc-f878-49f2-8ad3-a09195c1d140 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:29.361518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3bfcc-f878-49f2-8ad3-a09195c1d140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:29.362236 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3bfcc-f878-49f2-8ad3-a09195c1d140 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:29.364033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3bfcc-f878-49f2-8ad3-a09195c1d140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:29.368711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3bfcc-f878-49f2-8ad3-a09195c1d140 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:29.423204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f87270-aff5-4247-bd71-d064a7396778 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:29.429568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa83bc-d437-488b-942e-b59193293ba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:29.430595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa83bc-d437-488b-942e-b59193293ba1 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:29.431106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa83bc-d437-488b-942e-b59193293ba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:29.431588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa83bc-d437-488b-942e-b59193293ba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:29.446448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa83bc-d437-488b-942e-b59193293ba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:29.447984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa83bc-d437-488b-942e-b59193293ba1 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:29.459404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1161/2340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:29.460585 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa83bc-d437-488b-942e-b59193293ba1 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:29.471996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa83bc-d437-488b-942e-b59193293ba1 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:29.477326 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac791bf-6a3f-4c5d-afdf-f2a8dcb97d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:29.478087 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac791bf-6a3f-4c5d-afdf-f2a8dcb97d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:29.478373 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac791bf-6a3f-4c5d-afdf-f2a8dcb97d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:29.478656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac791bf-6a3f-4c5d-afdf-f2a8dcb97d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:29.479318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac791bf-6a3f-4c5d-afdf-f2a8dcb97d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:29.479623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac791bf-6a3f-4c5d-afdf-f2a8dcb97d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:29.481416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac791bf-6a3f-4c5d-afdf-f2a8dcb97d3e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:29.495231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1162/2341] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:29.496280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac791bf-6a3f-4c5d-afdf-f2a8dcb97d3e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:29.507641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac791bf-6a3f-4c5d-afdf-f2a8dcb97d3e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:29.512699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1d772-dde1-4afc-99a2-e81e3b269801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:29.513301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1d772-dde1-4afc-99a2-e81e3b269801 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:29.513617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1d772-dde1-4afc-99a2-e81e3b269801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:29.513900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1d772-dde1-4afc-99a2-e81e3b269801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:29.514555 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1d772-dde1-4afc-99a2-e81e3b269801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:29.516162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1d772-dde1-4afc-99a2-e81e3b269801 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:29.528399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1163/2342] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:29.529278 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1d772-dde1-4afc-99a2-e81e3b269801 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:29.531352 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-acc1d772-dde1-4afc-99a2-e81e3b269801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:29.543953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1d772-dde1-4afc-99a2-e81e3b269801 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:29.547675 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f64ee-6fc1-409a-8e6d-a4312ce870e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:29.548283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f64ee-6fc1-409a-8e6d-a4312ce870e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:29.548568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f64ee-6fc1-409a-8e6d-a4312ce870e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:29.548837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f64ee-6fc1-409a-8e6d-a4312ce870e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:29.550654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e86f64ee-6fc1-409a-8e6d-a4312ce870e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:29.589141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1180/2343] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:29 2022] POST /identity/v3/users => generated 290 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:29.589141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3bfcc-f878-49f2-8ad3-a09195c1d140 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:29.589513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3bfcc-f878-49f2-8ad3-a09195c1d140 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:29.594189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a730ad4-251e-49ac-9043-ad31e3c4b5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:29.594897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a730ad4-251e-49ac-9043-ad31e3c4b5ed admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:29.595246 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a730ad4-251e-49ac-9043-ad31e3c4b5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:29.595587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a730ad4-251e-49ac-9043-ad31e3c4b5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:29.596298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a730ad4-251e-49ac-9043-ad31e3c4b5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:29.598808 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a730ad4-251e-49ac-9043-ad31e3c4b5ed admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:29.626442 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f64ee-6fc1-409a-8e6d-a4312ce870e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:29.627985 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f64ee-6fc1-409a-8e6d-a4312ce870e6 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:29.638689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1164/2344] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:29.639469 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f64ee-6fc1-409a-8e6d-a4312ce870e6 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:29.650158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f64ee-6fc1-409a-8e6d-a4312ce870e6 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:29.655574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1992ecf-27b6-4794-a9c4-03aa2b159c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:29.656449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1992ecf-27b6-4794-a9c4-03aa2b159c4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:29.656851 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1992ecf-27b6-4794-a9c4-03aa2b159c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:29.657135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1992ecf-27b6-4794-a9c4-03aa2b159c4e admin admin] PATH_INFO: `/v3/projects/59addc4e6d4c4de6b7f7dec961256b71/users/8c9db80ccc5a4687b8d23516635c68df/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:29.686580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1992ecf-27b6-4794-a9c4-03aa2b159c4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59addc4e6d4c4de6b7f7dec961256b71, user_id=8c9db80ccc5a4687b8d23516635c68df, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:29.686580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1992ecf-27b6-4794-a9c4-03aa2b159c4e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:29.742115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1181/2345] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:29 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:29.742115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a730ad4-251e-49ac-9043-ad31e3c4b5ed admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:29.834009 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a730ad4-251e-49ac-9043-ad31e3c4b5ed admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:29.839012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc401522-5886-4ac2-9fee-dc3962cdcf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:29.839700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc401522-5886-4ac2-9fee-dc3962cdcf06 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:29.839920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc401522-5886-4ac2-9fee-dc3962cdcf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:29.840195 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc401522-5886-4ac2-9fee-dc3962cdcf06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:29.840862 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc401522-5886-4ac2-9fee-dc3962cdcf06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:29.842585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc401522-5886-4ac2-9fee-dc3962cdcf06 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:29.854590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1182/2346] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:29.855497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc401522-5886-4ac2-9fee-dc3962cdcf06 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:29.857326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-dc401522-5886-4ac2-9fee-dc3962cdcf06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:29.872127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc401522-5886-4ac2-9fee-dc3962cdcf06 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:29.876986 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:29.877668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:29.877950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:29.878229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] PATH_INFO: `/v3/users/78e7f0a4eaee428f8510f1b358d6d3c5` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:29.879420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e7f0a4eaee428f8510f1b358d6d3c5)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:29.882238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:29.898165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1165/2347] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:29 2022] PUT /identity/v3/projects/59addc4e6d4c4de6b7f7dec961256b71/users/8c9db80ccc5a4687b8d23516635c68df/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:29.899702 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1992ecf-27b6-4794-a9c4-03aa2b159c4e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:29.995090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1992ecf-27b6-4794-a9c4-03aa2b159c4e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:30.000002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a41c7-b10d-45cb-958d-67c20b11fa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:30.000717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a41c7-b10d-45cb-958d-67c20b11fa2d admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:30.001040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a41c7-b10d-45cb-958d-67c20b11fa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:30.001490 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a41c7-b10d-45cb-958d-67c20b11fa2d admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:30.002275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a41c7-b10d-45cb-958d-67c20b11fa2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:30.004367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a41c7-b10d-45cb-958d-67c20b11fa2d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:30.221408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1166/2348] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:29 2022] POST /identity/v3/users => generated 291 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:30.222561 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a41c7-b10d-45cb-958d-67c20b11fa2d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:30.242202 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a41c7-b10d-45cb-958d-67c20b11fa2d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:30.250424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5f728-c738-4c2a-bd05-d910bad0ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:30.251560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5f728-c738-4c2a-bd05-d910bad0ce4c admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:30.252046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5f728-c738-4c2a-bd05-d910bad0ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:30.252542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5f728-c738-4c2a-bd05-d910bad0ce4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:30.253824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5f728-c738-4c2a-bd05-d910bad0ce4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:30.258318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5f728-c738-4c2a-bd05-d910bad0ce4c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:30.273737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1167/2349] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:30.275786 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4847234-8574-4876-8d71-bde0c498dcb7 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:30.276177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4847234-8574-4876-8d71-bde0c498dcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:30.276622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4847234-8574-4876-8d71-bde0c498dcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:30.283459 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:30.295300 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e7f0a4eaee428f8510f1b358d6d3c5'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:30.310848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e7f0a4eaee428f8510f1b358d6d3c5'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:30.320374 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-f4847234-8574-4876-8d71-bde0c498dcb7 None None] MFA Rules not processed for user `8c9db80ccc5a4687b8d23516635c68df`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:30.321817 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f4847234-8574-4876-8d71-bde0c498dcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:30.322417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e7f0a4eaee428f8510f1b358d6d3c5'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:30.402763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1168/2350] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:30.403639 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4847234-8574-4876-8d71-bde0c498dcb7 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:30.416878 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4847234-8574-4876-8d71-bde0c498dcb7 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:30.421717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9ca18-650e-4cc7-8ec6-44c40fa3d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:30.422340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9ca18-650e-4cc7-8ec6-44c40fa3d89a admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:30.422623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9ca18-650e-4cc7-8ec6-44c40fa3d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:30.422908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9ca18-650e-4cc7-8ec6-44c40fa3d89a admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:30.423584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9ca18-650e-4cc7-8ec6-44c40fa3d89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:30.425219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9ca18-650e-4cc7-8ec6-44c40fa3d89a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:30.436882 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1169/2351] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:30.437774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9ca18-650e-4cc7-8ec6-44c40fa3d89a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:30.442547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e7f0a4eaee428f8510f1b358d6d3c5'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:30.443467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e7f0a4eaee428f8510f1b358d6d3c5'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:30.456620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9ca18-650e-4cc7-8ec6-44c40fa3d89a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:30.456918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1183/2352] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:29 2022] DELETE /identity/v3/users/78e7f0a4eaee428f8510f1b358d6d3c5 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:30.456918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:30.456918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:30.547462 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c0091-9c07-4236-a83e-70908b651dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:30.548905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c0091-9c07-4236-a83e-70908b651dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:30.549426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c0091-9c07-4236-a83e-70908b651dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:30.550056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c0091-9c07-4236-a83e-70908b651dca admin admin] PATH_INFO: `/v3/projects/3ec5133575a440a2baec54f6d2771885/users/d32597fa7ca540e3abff57c82886dd1f/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:30.575951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:30.589146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63a6dd-3530-450e-a5a7-9845174d857a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:30.590832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c0091-9c07-4236-a83e-70908b651dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec5133575a440a2baec54f6d2771885, user_id=d32597fa7ca540e3abff57c82886dd1f, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:30.595330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c0091-9c07-4236-a83e-70908b651dca admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:30.599438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c20f9-9ac1-4631-9646-4e371d725b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:30.601874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c20f9-9ac1-4631-9646-4e371d725b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:30.602313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c20f9-9ac1-4631-9646-4e371d725b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:30.602720 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c20f9-9ac1-4631-9646-4e371d725b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:30.603966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c20f9-9ac1-4631-9646-4e371d725b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:30.607335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c20f9-9ac1-4631-9646-4e371d725b74 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:30.628963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1184/2353] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:30.633650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd66e2-5cf8-466c-8f1e-e30e8e79097a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:30.634130 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd66e2-5cf8-466c-8f1e-e30e8e79097a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:30.634700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd66e2-5cf8-466c-8f1e-e30e8e79097a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:30.665070 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c7bd66e2-5cf8-466c-8f1e-e30e8e79097a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:30.665070 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c7bd66e2-5cf8-466c-8f1e-e30e8e79097a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:30.671941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1185/2354] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:30.672872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd66e2-5cf8-466c-8f1e-e30e8e79097a None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:30.687680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd66e2-5cf8-466c-8f1e-e30e8e79097a None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:30.693176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a682bc-4a10-4ad9-a3e0-a5941fd9b69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:30.694347 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a682bc-4a10-4ad9-a3e0-a5941fd9b69e admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:30.694639 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a682bc-4a10-4ad9-a3e0-a5941fd9b69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:30.694919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a682bc-4a10-4ad9-a3e0-a5941fd9b69e admin admin] PATH_INFO: `/v3/projects/a5116ba5a11542a584b6d5f240b5ef69/users/1125d3a31e3d46ef895aafe6120870bf/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:30.714193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a682bc-4a10-4ad9-a3e0-a5941fd9b69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5116ba5a11542a584b6d5f240b5ef69, user_id=1125d3a31e3d46ef895aafe6120870bf, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:30.716963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a682bc-4a10-4ad9-a3e0-a5941fd9b69e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:30.738833 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1170/2355] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:30 2022] PUT /identity/v3/projects/3ec5133575a440a2baec54f6d2771885/users/d32597fa7ca540e3abff57c82886dd1f/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:30.752389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c0091-9c07-4236-a83e-70908b651dca admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:30.752389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fb3c0091-9c07-4236-a83e-70908b651dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:30.820008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1186/2356] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:30 2022] PUT /identity/v3/projects/a5116ba5a11542a584b6d5f240b5ef69/users/1125d3a31e3d46ef895aafe6120870bf/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:30.821624 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a682bc-4a10-4ad9-a3e0-a5941fd9b69e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:30.824329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b7a682bc-4a10-4ad9-a3e0-a5941fd9b69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:30.861307 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c0091-9c07-4236-a83e-70908b651dca admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:30.922459 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a682bc-4a10-4ad9-a3e0-a5941fd9b69e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:30.926702 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90f6bd-94ff-4951-bafd-37e791d8fae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:30.927351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f6bd-94ff-4951-bafd-37e791d8fae0 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:30.928163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f6bd-94ff-4951-bafd-37e791d8fae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:30.928994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90f6bd-94ff-4951-bafd-37e791d8fae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:30.940222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886614cf-beea-4556-a710-c3da0aa7cb45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:30.941244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886614cf-beea-4556-a710-c3da0aa7cb45 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:30.941654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886614cf-beea-4556-a710-c3da0aa7cb45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:30.942063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886614cf-beea-4556-a710-c3da0aa7cb45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:30.944701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-886614cf-beea-4556-a710-c3da0aa7cb45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:31.019448 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90f6bd-94ff-4951-bafd-37e791d8fae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:31.021747 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca90f6bd-94ff-4951-bafd-37e791d8fae0 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:31.033897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1187/2357] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:31.035354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaf9d8-2765-41e7-b498-7cc58cb9290a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:31.035694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaf9d8-2765-41e7-b498-7cc58cb9290a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:31.036110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaf9d8-2765-41e7-b498-7cc58cb9290a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:31.047388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886614cf-beea-4556-a710-c3da0aa7cb45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:31.048893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886614cf-beea-4556-a710-c3da0aa7cb45 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:31.067387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1171/2358] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:31.069739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11bca3-382b-414f-87cb-f415806d95c7 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:31.070161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11bca3-382b-414f-87cb-f415806d95c7 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:31.070610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11bca3-382b-414f-87cb-f415806d95c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:31.079099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-8fbaf9d8-2765-41e7-b498-7cc58cb9290a None None] MFA Rules not processed for user `d32597fa7ca540e3abff57c82886dd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:31.082021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8fbaf9d8-2765-41e7-b498-7cc58cb9290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:31.127517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ae11bca3-382b-414f-87cb-f415806d95c7 None None] MFA Rules not processed for user `1125d3a31e3d46ef895aafe6120870bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:31.129654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ae11bca3-382b-414f-87cb-f415806d95c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:31.226389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1188/2359] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:31.235657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaf9d8-2765-41e7-b498-7cc58cb9290a None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:31.237144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8fbaf9d8-2765-41e7-b498-7cc58cb9290a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:31.253335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaf9d8-2765-41e7-b498-7cc58cb9290a None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:31.260182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e44ae-4c69-4f52-97a5-d0b9c6179374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:31.260906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e44ae-4c69-4f52-97a5-d0b9c6179374 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:31.261219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e44ae-4c69-4f52-97a5-d0b9c6179374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:31.261538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e44ae-4c69-4f52-97a5-d0b9c6179374 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:31.262190 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e44ae-4c69-4f52-97a5-d0b9c6179374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:31.264155 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e44ae-4c69-4f52-97a5-d0b9c6179374 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:31.283260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1172/2360] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:31.289307 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11bca3-382b-414f-87cb-f415806d95c7 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:31.300583 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11bca3-382b-414f-87cb-f415806d95c7 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:31.306724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f61ef1-fdb4-45ff-90ec-2141d4d91398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:31.307360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f61ef1-fdb4-45ff-90ec-2141d4d91398 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:31.307669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f61ef1-fdb4-45ff-90ec-2141d4d91398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:31.307952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f61ef1-fdb4-45ff-90ec-2141d4d91398 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:31.308577 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f61ef1-fdb4-45ff-90ec-2141d4d91398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:31.310585 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f61ef1-fdb4-45ff-90ec-2141d4d91398 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:31.398925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1189/2361] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:31 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:31.406575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e44ae-4c69-4f52-97a5-d0b9c6179374 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:31.470480 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1173/2362] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:31 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:31.476042 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f61ef1-fdb4-45ff-90ec-2141d4d91398 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:31.566002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e44ae-4c69-4f52-97a5-d0b9c6179374 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:31.626819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f61ef1-fdb4-45ff-90ec-2141d4d91398 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:31.643155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a260161-d89b-4366-be89-93868141b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:31.643155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a260161-d89b-4366-be89-93868141b2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:31.643155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a260161-d89b-4366-be89-93868141b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:31.643155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a260161-d89b-4366-be89-93868141b2b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:31.643979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a260161-d89b-4366-be89-93868141b2b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:31.647438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a260161-d89b-4366-be89-93868141b2b0 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:31.696964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808eff5-0b02-4a5a-a732-e2e6060ea03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:31.697947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808eff5-0b02-4a5a-a732-e2e6060ea03b admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:31.698435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808eff5-0b02-4a5a-a732-e2e6060ea03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:31.699889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808eff5-0b02-4a5a-a732-e2e6060ea03b admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:31.701084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808eff5-0b02-4a5a-a732-e2e6060ea03b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:31.705068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808eff5-0b02-4a5a-a732-e2e6060ea03b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:31.826895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1174/2363] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:31 2022] POST /identity/v3/users => generated 297 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:31.826895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a260161-d89b-4366-be89-93868141b2b0 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:31.829143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2a260161-d89b-4366-be89-93868141b2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:31.873356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1190/2364] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:31 2022] POST /identity/v3/users => generated 290 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:31.874791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808eff5-0b02-4a5a-a732-e2e6060ea03b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:31.904023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808eff5-0b02-4a5a-a732-e2e6060ea03b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:31.912332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f218d20-fabe-4144-aa0d-2b3c64f555db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:31.913902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f218d20-fabe-4144-aa0d-2b3c64f555db admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:31.914420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f218d20-fabe-4144-aa0d-2b3c64f555db admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:31.914869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f218d20-fabe-4144-aa0d-2b3c64f555db admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:31.916330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f218d20-fabe-4144-aa0d-2b3c64f555db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:31.919638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f218d20-fabe-4144-aa0d-2b3c64f555db admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:31.935464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1191/2365] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:31.937453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f218d20-fabe-4144-aa0d-2b3c64f555db admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:31.941258 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3f218d20-fabe-4144-aa0d-2b3c64f555db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:31.955967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f218d20-fabe-4144-aa0d-2b3c64f555db admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:31.959250 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a260161-d89b-4366-be89-93868141b2b0 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:31.962090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:31.962749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:31.963035 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:31.963313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] PATH_INFO: `/v3/projects/2c554e5f7ba8459d87ff5ecb7fa5d72d` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:31.964490 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c554e5f7ba8459d87ff5ecb7fa5d72d)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:31.966530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:31.967369 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dede63-1300-4653-8c88-3702cf6366d0 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c70e50820e3477fbcbfa4bee20eae9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '372e95cb5e3e4152969b10a26a466835', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:31.970578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dede63-1300-4653-8c88-3702cf6366d0 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:31.970578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dede63-1300-4653-8c88-3702cf6366d0 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:31.970578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dede63-1300-4653-8c88-3702cf6366d0 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:31.970578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dede63-1300-4653-8c88-3702cf6366d0 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:31.971756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dede63-1300-4653-8c88-3702cf6366d0 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:31.974843 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dede63-1300-4653-8c88-3702cf6366d0 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:31.993613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1175/2366] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:31.994793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dede63-1300-4653-8c88-3702cf6366d0 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:32.009133 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dede63-1300-4653-8c88-3702cf6366d0 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:32.017072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e9a42-7db3-441a-9f4e-64598b181cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:32.017767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9a42-7db3-441a-9f4e-64598b181cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:32.018105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9a42-7db3-441a-9f4e-64598b181cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:32.018436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e9a42-7db3-441a-9f4e-64598b181cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:32.019219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e9a42-7db3-441a-9f4e-64598b181cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:32.021961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e9a42-7db3-441a-9f4e-64598b181cf3 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:32.040266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1176/2367] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:32.045433 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e9a42-7db3-441a-9f4e-64598b181cf3 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:32.063474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e9a42-7db3-441a-9f4e-64598b181cf3 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:32.071711 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e68c96-493f-44e3-bbcc-52112562a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:32.072431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e68c96-493f-44e3-bbcc-52112562a1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:32.072713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e68c96-493f-44e3-bbcc-52112562a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:32.074235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e68c96-493f-44e3-bbcc-52112562a1a9 admin admin] PATH_INFO: `/v3/projects/9463148f963b4253953d4b2655722e21/users/23596e57a58e478599739e62c9d31523/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:32.110466 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e68c96-493f-44e3-bbcc-52112562a1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9463148f963b4253953d4b2655722e21, user_id=23596e57a58e478599739e62c9d31523, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:32.115257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e68c96-493f-44e3-bbcc-52112562a1a9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:32.134597 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c554e5f7ba8459d87ff5ecb7fa5d72d', 'request_id': 'req-88007757-2f32-4d63-a906-15cea01df38e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:32.345499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1177/2368] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:32 2022] PUT /identity/v3/projects/9463148f963b4253953d4b2655722e21/users/23596e57a58e478599739e62c9d31523/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:32.346551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e68c96-493f-44e3-bbcc-52112562a1a9 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:32.364252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c554e5f7ba8459d87ff5ecb7fa5d72d', 'request_id': 'req-88007757-2f32-4d63-a906-15cea01df38e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:32.376936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c554e5f7ba8459d87ff5ecb7fa5d72d', 'request_id': 'req-88007757-2f32-4d63-a906-15cea01df38e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:32.403470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] The token cache is being invalidate because project 2c554e5f7ba8459d87ff5ecb7fa5d72d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:32.403470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:32.405057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:32.410182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1192/2369] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:31 2022] DELETE /identity/v3/projects/2c554e5f7ba8459d87ff5ecb7fa5d72d => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:32.415163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:32.417664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:32.467268 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e68c96-493f-44e3-bbcc-52112562a1a9 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:32.476198 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08167b-f632-4108-9e5b-9481d729e44d tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c70e50820e3477fbcbfa4bee20eae9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '372e95cb5e3e4152969b10a26a466835', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:32.477322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08167b-f632-4108-9e5b-9481d729e44d tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:32.477681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08167b-f632-4108-9e5b-9481d729e44d tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:32.478161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08167b-f632-4108-9e5b-9481d729e44d tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:32.479375 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08167b-f632-4108-9e5b-9481d729e44d tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:32.483243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08167b-f632-4108-9e5b-9481d729e44d tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:32.561721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88007757-2f32-4d63-a906-15cea01df38e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:32.652518 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1178/2370] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:32 2022] POST /identity/v3/projects => generated 354 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:32.652518 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08167b-f632-4108-9e5b-9481d729e44d tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:32.652518 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6c08167b-f632-4108-9e5b-9481d729e44d tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:32.656552 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0334fe2-ae7e-427f-a6a4-9d45c9be946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:32.657645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0334fe2-ae7e-427f-a6a4-9d45c9be946d admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:32.658157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0334fe2-ae7e-427f-a6a4-9d45c9be946d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:32.658640 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0334fe2-ae7e-427f-a6a4-9d45c9be946d admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:32.659916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0334fe2-ae7e-427f-a6a4-9d45c9be946d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:32.663194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0334fe2-ae7e-427f-a6a4-9d45c9be946d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:32.676896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1193/2371] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:32.678694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0334fe2-ae7e-427f-a6a4-9d45c9be946d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:32.683034 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b0334fe2-ae7e-427f-a6a4-9d45c9be946d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:32.707174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0334fe2-ae7e-427f-a6a4-9d45c9be946d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:32.754096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08167b-f632-4108-9e5b-9481d729e44d tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:32.759845 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37191ab7-e5f4-4fb9-9aaf-0a9a0a4ef8db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:32.760476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37191ab7-e5f4-4fb9-9aaf-0a9a0a4ef8db service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:32.762118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37191ab7-e5f4-4fb9-9aaf-0a9a0a4ef8db service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:32.762118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37191ab7-e5f4-4fb9-9aaf-0a9a0a4ef8db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:32.763912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-37191ab7-e5f4-4fb9-9aaf-0a9a0a4ef8db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:32.802944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b165c-b763-4017-b706-7b7873c7872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:32.803870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b165c-b763-4017-b706-7b7873c7872e admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:32.804157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b165c-b763-4017-b706-7b7873c7872e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:32.804437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b165c-b763-4017-b706-7b7873c7872e admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:32.805141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b165c-b763-4017-b706-7b7873c7872e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:32.806888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b165c-b763-4017-b706-7b7873c7872e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:32.818343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1194/2372] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:32.819918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b165c-b763-4017-b706-7b7873c7872e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:32.824943 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-578b165c-b763-4017-b706-7b7873c7872e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:32.839354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b165c-b763-4017-b706-7b7873c7872e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:32.845049 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:32.845958 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:32.850139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:32.850139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] PATH_INFO: `/v3/users/b703ab1c497f439c9c4f89fda5506eca` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:32.850139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b703ab1c497f439c9c4f89fda5506eca)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:32.850589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:32.882684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37191ab7-e5f4-4fb9-9aaf-0a9a0a4ef8db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:32.884150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37191ab7-e5f4-4fb9-9aaf-0a9a0a4ef8db service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:32.896449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1179/2373] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:32.898051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37191ab7-e5f4-4fb9-9aaf-0a9a0a4ef8db service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:32.899644 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-37191ab7-e5f4-4fb9-9aaf-0a9a0a4ef8db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:32.915415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37191ab7-e5f4-4fb9-9aaf-0a9a0a4ef8db service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:32.921425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:32.922073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:32.922354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:32.922630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] PATH_INFO: `/v3/users/a75bd1c3326c4c7c8d64d2ce52a466d8` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:32.923985 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75bd1c3326c4c7c8d64d2ce52a466d8)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:32.926099 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:33.187144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75bd1c3326c4c7c8d64d2ce52a466d8'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:33.190919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b703ab1c497f439c9c4f89fda5506eca'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:33.197607 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75bd1c3326c4c7c8d64d2ce52a466d8'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:33.208348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b703ab1c497f439c9c4f89fda5506eca'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:33.217989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b703ab1c497f439c9c4f89fda5506eca'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:33.280467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:33.308579 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75bd1c3326c4c7c8d64d2ce52a466d8'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:33.310190 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75bd1c3326c4c7c8d64d2ce52a466d8'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:33.312162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75bd1c3326c4c7c8d64d2ce52a466d8'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:33.345487 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1180/2374] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:32 2022] DELETE /identity/v3/users/a75bd1c3326c4c7c8d64d2ce52a466d8 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:33.346660 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:33.348431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:33.422653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b703ab1c497f439c9c4f89fda5506eca'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:33.423603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b703ab1c497f439c9c4f89fda5506eca'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:33.432610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1195/2375] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:32 2022] DELETE /identity/v3/users/b703ab1c497f439c9c4f89fda5506eca => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:33.434086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:33.436542 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:33.466231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a52ff5-0e9c-4f25-8df8-c14ccdd2202d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:33.559798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110c8e7-80a8-47d3-8bed-11418a0d37bc admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:33.565194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edfc58-776c-4c36-9d61-e2cedf9efac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:33.566689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edfc58-776c-4c36-9d61-e2cedf9efac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:33.566689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edfc58-776c-4c36-9d61-e2cedf9efac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:33.566689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edfc58-776c-4c36-9d61-e2cedf9efac5 admin admin] PATH_INFO: `/v3/projects/96572f1fb8dc41e992fea169faa8b76e/users/dcf7475ca52a4bd4b71065d717210ee7/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:33.589211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edfc58-776c-4c36-9d61-e2cedf9efac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96572f1fb8dc41e992fea169faa8b76e, user_id=dcf7475ca52a4bd4b71065d717210ee7, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:33.594700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5aaf1-1c8a-4b92-9f79-72461b36d58b tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c70e50820e3477fbcbfa4bee20eae9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '372e95cb5e3e4152969b10a26a466835', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:33.595286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edfc58-776c-4c36-9d61-e2cedf9efac5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:33.595382 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5aaf1-1c8a-4b92-9f79-72461b36d58b tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:33.595619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5aaf1-1c8a-4b92-9f79-72461b36d58b tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:33.595895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5aaf1-1c8a-4b92-9f79-72461b36d58b tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:33.596590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5aaf1-1c8a-4b92-9f79-72461b36d58b tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:33.596890 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5aaf1-1c8a-4b92-9f79-72461b36d58b tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:33.599964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5aaf1-1c8a-4b92-9f79-72461b36d58b tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:33.619158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1181/2376] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:33.619158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5aaf1-1c8a-4b92-9f79-72461b36d58b tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:33.621720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d4c5aaf1-1c8a-4b92-9f79-72461b36d58b tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:33.636930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5aaf1-1c8a-4b92-9f79-72461b36d58b tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:33.642550 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34d646-107a-41ce-ae25-3b86fc827fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:33.643393 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34d646-107a-41ce-ae25-3b86fc827fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:33.643769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34d646-107a-41ce-ae25-3b86fc827fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:33.644142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34d646-107a-41ce-ae25-3b86fc827fa8 admin admin] PATH_INFO: `/v3/projects/9463148f963b4253953d4b2655722e21/users/23596e57a58e478599739e62c9d31523/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:33.646977 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34d646-107a-41ce-ae25-3b86fc827fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9463148f963b4253953d4b2655722e21, user_id=23596e57a58e478599739e62c9d31523, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:33.650084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34d646-107a-41ce-ae25-3b86fc827fa8 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:33.671762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1182/2377] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:33 2022] PUT /identity/v3/projects/9463148f963b4253953d4b2655722e21/users/23596e57a58e478599739e62c9d31523/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:33.671762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bcea9-8ef5-45ef-90f5-d653e958a023 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:33.671762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bcea9-8ef5-45ef-90f5-d653e958a023 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:33.671762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bcea9-8ef5-45ef-90f5-d653e958a023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:33.698164 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-130bcea9-8ef5-45ef-90f5-d653e958a023 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:33.699573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-130bcea9-8ef5-45ef-90f5-d653e958a023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:33.747010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1196/2378] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:33 2022] PUT /identity/v3/projects/96572f1fb8dc41e992fea169faa8b76e/users/dcf7475ca52a4bd4b71065d717210ee7/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:33.752089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c76644-4106-4e3d-9db6-d9cf93cd9374 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:33.752089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c76644-4106-4e3d-9db6-d9cf93cd9374 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:33.752089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c76644-4106-4e3d-9db6-d9cf93cd9374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:33.794316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-a1c76644-4106-4e3d-9db6-d9cf93cd9374 None None] MFA Rules not processed for user `23596e57a58e478599739e62c9d31523`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:33.797544 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a1c76644-4106-4e3d-9db6-d9cf93cd9374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:33.828516 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1183/2379] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:33.831205 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dc3e2-8a1d-486e-aba3-7a56a0705e5e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:33.831403 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dc3e2-8a1d-486e-aba3-7a56a0705e5e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:33.831707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dc3e2-8a1d-486e-aba3-7a56a0705e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:33.901448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a68dc3e2-8a1d-486e-aba3-7a56a0705e5e None None] MFA Rules not processed for user `dcf7475ca52a4bd4b71065d717210ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:33.902731 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a68dc3e2-8a1d-486e-aba3-7a56a0705e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:33.957560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1197/2380] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:33.957560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c76644-4106-4e3d-9db6-d9cf93cd9374 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:33.959719 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a1c76644-4106-4e3d-9db6-d9cf93cd9374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:34.064485 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1184/2381] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:34.066588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68dc3e2-8a1d-486e-aba3-7a56a0705e5e None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:34.068790 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a68dc3e2-8a1d-486e-aba3-7a56a0705e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:34.100058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c76644-4106-4e3d-9db6-d9cf93cd9374 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:34.107708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c70e50820e3477fbcbfa4bee20eae9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '372e95cb5e3e4152969b10a26a466835', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:34.108742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:34.109206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:34.109686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] PATH_INFO: `/v3/projects/51dce9a947344d95ac8071b0e9d75b97` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:34.111707 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: Authorizing `identity:delete_project(project_id=51dce9a947344d95ac8071b0e9d75b97)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:34.116033 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:34.152720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:34.179416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68dc3e2-8a1d-486e-aba3-7a56a0705e5e None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:34.183933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94422712-08f0-4d16-bb81-5f5caf3f977f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:34.192830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94422712-08f0-4d16-bb81-5f5caf3f977f service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:34.192830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94422712-08f0-4d16-bb81-5f5caf3f977f service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:34.192830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94422712-08f0-4d16-bb81-5f5caf3f977f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:34.277585 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94422712-08f0-4d16-bb81-5f5caf3f977f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:34.280252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94422712-08f0-4d16-bb81-5f5caf3f977f service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:34.297958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1185/2382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:34.299544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94422712-08f0-4d16-bb81-5f5caf3f977f service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:34.301621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-94422712-08f0-4d16-bb81-5f5caf3f977f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:34.378686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51dce9a947344d95ac8071b0e9d75b97', 'request_id': 'req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:34.408329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94422712-08f0-4d16-bb81-5f5caf3f977f service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:34.470663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24f426-495d-4637-b4fd-dbb96724dec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:34.471420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24f426-495d-4637-b4fd-dbb96724dec3 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:34.471705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24f426-495d-4637-b4fd-dbb96724dec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:34.471976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24f426-495d-4637-b4fd-dbb96724dec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:34.514299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51dce9a947344d95ac8071b0e9d75b97', 'request_id': 'req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:34.527326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51dce9a947344d95ac8071b0e9d75b97', 'request_id': 'req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:34.564308 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24f426-495d-4637-b4fd-dbb96724dec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:34.566207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] The token cache is being invalidate because project 51dce9a947344d95ac8071b0e9d75b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:34.566689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:34.567062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24f426-495d-4637-b4fd-dbb96724dec3 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:34.568518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:34.570582 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1198/2383] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:33 2022] DELETE /identity/v3/projects/51dce9a947344d95ac8071b0e9d75b97 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:34.572378 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:34.574514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:34.587349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1186/2384] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:34.589336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24f426-495d-4637-b4fd-dbb96724dec3 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:34.594680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4e24f426-495d-4637-b4fd-dbb96724dec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:34.706813 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa21546-4d5d-4d1b-b36b-b2bddf836a52 tempest-VolumeQuotaClassesTest-1810369869 tempest-VolumeQuotaClassesTest-1810369869-project-admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:34.714269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ceb406-f39b-4bff-bb89-a349beb59fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:34.715147 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ceb406-f39b-4bff-bb89-a349beb59fcb admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:34.715412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ceb406-f39b-4bff-bb89-a349beb59fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:34.715761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ceb406-f39b-4bff-bb89-a349beb59fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:34.716500 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ceb406-f39b-4bff-bb89-a349beb59fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:34.718107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24f426-495d-4637-b4fd-dbb96724dec3 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:34.722391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ceb406-f39b-4bff-bb89-a349beb59fcb admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:34.728351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:34.729366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:34.729870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:34.730328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] PATH_INFO: `/v3/projects/caa227816987426b8bd51cadc9a0970f` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:34.732729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caa227816987426b8bd51cadc9a0970f)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:34.736995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:34.934517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1199/2385] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:34 2022] POST /identity/v3/projects => generated 377 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:34.936458 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ceb406-f39b-4bff-bb89-a349beb59fcb admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:34.968829 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caa227816987426b8bd51cadc9a0970f', 'request_id': 'req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:34.986135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caa227816987426b8bd51cadc9a0970f', 'request_id': 'req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.046724 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ceb406-f39b-4bff-bb89-a349beb59fcb admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:35.051735 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44980fd4-336d-42f1-86a9-4a4efbc5acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:35.052903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44980fd4-336d-42f1-86a9-4a4efbc5acf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:35.053175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44980fd4-336d-42f1-86a9-4a4efbc5acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:35.053471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44980fd4-336d-42f1-86a9-4a4efbc5acf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:35.054126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44980fd4-336d-42f1-86a9-4a4efbc5acf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:35.056120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44980fd4-336d-42f1-86a9-4a4efbc5acf5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:35.195859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caa227816987426b8bd51cadc9a0970f', 'request_id': 'req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.220219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] The token cache is being invalidate because project caa227816987426b8bd51cadc9a0970f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:35.220950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.222380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.229097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1187/2386] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:34 2022] DELETE /identity/v3/projects/caa227816987426b8bd51cadc9a0970f => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:35.229097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:35.230251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:35.242593 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1200/2387] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:34 2022] POST /identity/v3/users => generated 295 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:35.243539 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44980fd4-336d-42f1-86a9-4a4efbc5acf5 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:35.246450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-44980fd4-336d-42f1-86a9-4a4efbc5acf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:35.262573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44980fd4-336d-42f1-86a9-4a4efbc5acf5 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:35.268471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:35.269176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:35.269629 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:35.269935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] PATH_INFO: `/v3/users/5103bcbe6721403a8eb3b5ecde60cc87` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:35.272054 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5103bcbe6721403a8eb3b5ecde60cc87)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:35.274276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:35.344316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c312acc-f0bd-4633-9f90-09bfd1cfaea9 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:35.352331 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:35.353464 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:35.353963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:35.354458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] PATH_INFO: `/v3/projects/92b6b0497a8a4b2b91ddb9d0661c07cc` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:35.356476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92b6b0497a8a4b2b91ddb9d0661c07cc)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:35.360414 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:35.561023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:35.582958 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5103bcbe6721403a8eb3b5ecde60cc87'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.585800 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92b6b0497a8a4b2b91ddb9d0661c07cc', 'request_id': 'req-db5a19f2-bd57-490a-af8f-fb791a336635'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.601697 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92b6b0497a8a4b2b91ddb9d0661c07cc', 'request_id': 'req-db5a19f2-bd57-490a-af8f-fb791a336635'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.610674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5103bcbe6721403a8eb3b5ecde60cc87'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.623562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5103bcbe6721403a8eb3b5ecde60cc87'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.731774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92b6b0497a8a4b2b91ddb9d0661c07cc', 'request_id': 'req-db5a19f2-bd57-490a-af8f-fb791a336635'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.757716 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] The token cache is being invalidate because project 92b6b0497a8a4b2b91ddb9d0661c07cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:35.758336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.759474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.762290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1188/2388] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:35 2022] DELETE /identity/v3/projects/92b6b0497a8a4b2b91ddb9d0661c07cc => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:35.763443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:35.766127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:35.866592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5103bcbe6721403a8eb3b5ecde60cc87'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.868160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5103bcbe6721403a8eb3b5ecde60cc87'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:35.883615 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1201/2389] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:35 2022] DELETE /identity/v3/users/5103bcbe6721403a8eb3b5ecde60cc87 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:35.888556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:35.897706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a19f2-bd57-490a-af8f-fb791a336635 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:35.897994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:36.052533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e474ab8-5066-4609-a010-749e20353054 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:36.063254 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:36.064585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:36.065089 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:36.065615 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] PATH_INFO: `/v3/users/3ec0447fe9d74375aa3e1b373916978a` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:36.066114 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c599aa-b79b-445e-a62a-1799ce7d00bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:36.067247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c599aa-b79b-445e-a62a-1799ce7d00bb admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:36.068411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c599aa-b79b-445e-a62a-1799ce7d00bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:36.068952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec0447fe9d74375aa3e1b373916978a)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:36.069867 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c599aa-b79b-445e-a62a-1799ce7d00bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:36.071110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c599aa-b79b-445e-a62a-1799ce7d00bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:36.074267 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c599aa-b79b-445e-a62a-1799ce7d00bb admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:36.074673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:36.105700 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1189/2390] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:36.107191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c599aa-b79b-445e-a62a-1799ce7d00bb admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:36.111258 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-34c599aa-b79b-445e-a62a-1799ce7d00bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:36.183741 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c599aa-b79b-445e-a62a-1799ce7d00bb admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:36.188162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab087c-f2be-463d-ab20-4d8b43b655a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:36.188806 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab087c-f2be-463d-ab20-4d8b43b655a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:36.189126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab087c-f2be-463d-ab20-4d8b43b655a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:36.189492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab087c-f2be-463d-ab20-4d8b43b655a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:36.191532 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6eab087c-f2be-463d-ab20-4d8b43b655a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:36.303229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab087c-f2be-463d-ab20-4d8b43b655a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:36.306079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab087c-f2be-463d-ab20-4d8b43b655a9 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:36.322858 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1190/2391] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:36.324282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab087c-f2be-463d-ab20-4d8b43b655a9 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:36.327235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6eab087c-f2be-463d-ab20-4d8b43b655a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:36.345240 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:36.355252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab087c-f2be-463d-ab20-4d8b43b655a9 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:36.364661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d01e2-19be-4691-b473-c530336c399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:36.365329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d01e2-19be-4691-b473-c530336c399b admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:36.366028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d01e2-19be-4691-b473-c530336c399b admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:36.366824 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4d01e2-19be-4691-b473-c530336c399b admin admin] PATH_INFO: `/v3/projects/db8189ea6b464647ab0d28f2cb1ea3b2/users/1e02c6e9aa7c4088b4bb4213f2831677/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:36.398408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d01e2-19be-4691-b473-c530336c399b admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8189ea6b464647ab0d28f2cb1ea3b2, user_id=1e02c6e9aa7c4088b4bb4213f2831677, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:36.400306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4d01e2-19be-4691-b473-c530336c399b admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:36.416812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec0447fe9d74375aa3e1b373916978a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:36.441211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec0447fe9d74375aa3e1b373916978a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:36.454680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec0447fe9d74375aa3e1b373916978a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:36.533685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1191/2392] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:36 2022] PUT /identity/v3/projects/db8189ea6b464647ab0d28f2cb1ea3b2/users/1e02c6e9aa7c4088b4bb4213f2831677/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:36.540178 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d01e2-19be-4691-b473-c530336c399b admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:36.605332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec0447fe9d74375aa3e1b373916978a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:36.606177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec0447fe9d74375aa3e1b373916978a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:36.617267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1202/2393] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:35 2022] DELETE /identity/v3/users/3ec0447fe9d74375aa3e1b373916978a => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:36.631968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4d01e2-19be-4691-b473-c530336c399b admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:36.659613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:36.662429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:36.769576 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0adcb-b78b-4260-9f5a-91ebd8f6d334 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:36.780010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365b812-9ad7-4f2d-8bc7-a6afd3d6abc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:36.780010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365b812-9ad7-4f2d-8bc7-a6afd3d6abc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:36.780010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365b812-9ad7-4f2d-8bc7-a6afd3d6abc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:36.780010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365b812-9ad7-4f2d-8bc7-a6afd3d6abc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:36.780974 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365b812-9ad7-4f2d-8bc7-a6afd3d6abc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:36.781110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:36.781110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:36.781110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:36.781591 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365b812-9ad7-4f2d-8bc7-a6afd3d6abc1 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:36.781754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] PATH_INFO: `/v3/projects/e8b2424924e64900a03a6924c6883aee` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:36.782739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b2424924e64900a03a6924c6883aee)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:36.785719 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:36.803105 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1192/2394] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:44:36.809560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365b812-9ad7-4f2d-8bc7-a6afd3d6abc1 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:36.812410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f365b812-9ad7-4f2d-8bc7-a6afd3d6abc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:36.862380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365b812-9ad7-4f2d-8bc7-a6afd3d6abc1 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:36.869834 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b3182-a9a9-4b00-8c8f-bf3ac0679844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:36.870506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b3182-a9a9-4b00-8c8f-bf3ac0679844 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:36.870919 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b3182-a9a9-4b00-8c8f-bf3ac0679844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:36.871387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b3182-a9a9-4b00-8c8f-bf3ac0679844 admin admin] PATH_INFO: `/v3/projects/db8189ea6b464647ab0d28f2cb1ea3b2/users/1e02c6e9aa7c4088b4bb4213f2831677/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:36.873969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b3182-a9a9-4b00-8c8f-bf3ac0679844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8189ea6b464647ab0d28f2cb1ea3b2, user_id=1e02c6e9aa7c4088b4bb4213f2831677, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:36.876789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b3182-a9a9-4b00-8c8f-bf3ac0679844 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:36.892904 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1193/2395] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:36 2022] PUT /identity/v3/projects/db8189ea6b464647ab0d28f2cb1ea3b2/users/1e02c6e9aa7c4088b4bb4213f2831677/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:44:36.911285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2445c7-2d7a-4fa1-9484-af7d8d8cc78d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:36.912378 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2445c7-2d7a-4fa1-9484-af7d8d8cc78d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:36.912837 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2445c7-2d7a-4fa1-9484-af7d8d8cc78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:36.960121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ab2445c7-2d7a-4fa1-9484-af7d8d8cc78d None None] MFA Rules not processed for user `1e02c6e9aa7c4088b4bb4213f2831677`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:36.961975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ab2445c7-2d7a-4fa1-9484-af7d8d8cc78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:37.110845 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b2424924e64900a03a6924c6883aee', 'request_id': 'req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.116392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1194/2396] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:44:37.158949 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2445c7-2d7a-4fa1-9484-af7d8d8cc78d None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:37.158949 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ab2445c7-2d7a-4fa1-9484-af7d8d8cc78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:37.252448 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2445c7-2d7a-4fa1-9484-af7d8d8cc78d None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:37.307880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b2424924e64900a03a6924c6883aee', 'request_id': 'req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.309170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc63cfc-aaba-4ca0-a780-9ae7c2905b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:37.310263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc63cfc-aaba-4ca0-a780-9ae7c2905b12 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:37.310769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc63cfc-aaba-4ca0-a780-9ae7c2905b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:37.311264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc63cfc-aaba-4ca0-a780-9ae7c2905b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:37.314939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2dc63cfc-aaba-4ca0-a780-9ae7c2905b12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:37.320050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b2424924e64900a03a6924c6883aee', 'request_id': 'req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.342873 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] The token cache is being invalidate because project e8b2424924e64900a03a6924c6883aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:37.343343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.344048 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.345682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1203/2397] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:36 2022] DELETE /identity/v3/projects/e8b2424924e64900a03a6924c6883aee => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:37.352324 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:37.354144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:37.418789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc63cfc-aaba-4ca0-a780-9ae7c2905b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:37.422009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc63cfc-aaba-4ca0-a780-9ae7c2905b12 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:37.449690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1195/2398] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:37.452152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c73c6-317b-49ce-8880-d696ff56ce4d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:37.452684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c73c6-317b-49ce-8880-d696ff56ce4d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:37.453322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c73c6-317b-49ce-8880-d696ff56ce4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:37.466814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f854-5b8a-4e21-9c2d-fcd793d13c10 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:37.477628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:37.490508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:37.490508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:37.490508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] PATH_INFO: `/v3/users/989c7dac3dd5478a93d7e11702662eea` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:37.490508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] RBAC: Authorizing `identity:delete_user(user_id=989c7dac3dd5478a93d7e11702662eea)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:37.490508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:37.503425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-bd1c73c6-317b-49ce-8880-d696ff56ce4d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:37.505720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bd1c73c6-317b-49ce-8880-d696ff56ce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:37.519843 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1196/2399] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:37.522102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c73c6-317b-49ce-8880-d696ff56ce4d None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:37.524785 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bd1c73c6-317b-49ce-8880-d696ff56ce4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:37.546566 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c73c6-317b-49ce-8880-d696ff56ce4d None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:37.552266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e8179-2ab2-4a27-9e71-91ebddf4b6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:37.554052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e8179-2ab2-4a27-9e71-91ebddf4b6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:37.554396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e8179-2ab2-4a27-9e71-91ebddf4b6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:37.554750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e8179-2ab2-4a27-9e71-91ebddf4b6af admin admin] PATH_INFO: `/v3/projects/2075a12a1b0849fbb34a1ea96bcccfeb` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:37.556326 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e8179-2ab2-4a27-9e71-91ebddf4b6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=2075a12a1b0849fbb34a1ea96bcccfeb)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:37.558606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e8179-2ab2-4a27-9e71-91ebddf4b6af admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:37.804538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-380e8179-2ab2-4a27-9e71-91ebddf4b6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2075a12a1b0849fbb34a1ea96bcccfeb', 'request_id': 'req-380e8179-2ab2-4a27-9e71-91ebddf4b6af'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.817237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-380e8179-2ab2-4a27-9e71-91ebddf4b6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2075a12a1b0849fbb34a1ea96bcccfeb', 'request_id': 'req-380e8179-2ab2-4a27-9e71-91ebddf4b6af'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.825963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989c7dac3dd5478a93d7e11702662eea'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.829937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:37.850869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989c7dac3dd5478a93d7e11702662eea'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.863001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989c7dac3dd5478a93d7e11702662eea'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.949963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-380e8179-2ab2-4a27-9e71-91ebddf4b6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2075a12a1b0849fbb34a1ea96bcccfeb', 'request_id': 'req-380e8179-2ab2-4a27-9e71-91ebddf4b6af'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.968019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-380e8179-2ab2-4a27-9e71-91ebddf4b6af admin admin] The token cache is being invalidate because project 2075a12a1b0849fbb34a1ea96bcccfeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:37.968553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-380e8179-2ab2-4a27-9e71-91ebddf4b6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.969616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-380e8179-2ab2-4a27-9e71-91ebddf4b6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:37.971989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1197/2400] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:37 2022] DELETE /identity/v3/projects/2075a12a1b0849fbb34a1ea96bcccfeb => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:37.976784 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bc76f-4eca-4f6b-b4e1-26d68535cd90 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:37.976784 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bc76f-4eca-4f6b-b4e1-26d68535cd90 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:37.976784 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075bc76f-4eca-4f6b-b4e1-26d68535cd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:38.013495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-075bc76f-4eca-4f6b-b4e1-26d68535cd90 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:38.015718 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-075bc76f-4eca-4f6b-b4e1-26d68535cd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:38.093956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1198/2401] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:38.095066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bc76f-4eca-4f6b-b4e1-26d68535cd90 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:38.096612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-075bc76f-4eca-4f6b-b4e1-26d68535cd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:38.111222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075bc76f-4eca-4f6b-b4e1-26d68535cd90 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:38.116209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:38.116853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:38.117121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:38.117451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] PATH_INFO: `/v3/users/b26ac4d59cd447cfba9a84360da90136` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:38.119119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b26ac4d59cd447cfba9a84360da90136)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:38.121279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:38.132782 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989c7dac3dd5478a93d7e11702662eea'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:38.133899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989c7dac3dd5478a93d7e11702662eea'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:38.151766 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1204/2402] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:37 2022] DELETE /identity/v3/users/989c7dac3dd5478a93d7e11702662eea => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:38.153861 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:38.156319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:38.225125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a81d0-0716-4949-8c68-e8c3bf2d888a admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:38.229211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4279a-6870-4dee-88e6-3436bbee83da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:38.229867 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4279a-6870-4dee-88e6-3436bbee83da service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:38.230155 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4279a-6870-4dee-88e6-3436bbee83da service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:38.230418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4279a-6870-4dee-88e6-3436bbee83da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:38.232250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-47e4279a-6870-4dee-88e6-3436bbee83da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:38.306847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4279a-6870-4dee-88e6-3436bbee83da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:38.308310 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4279a-6870-4dee-88e6-3436bbee83da service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:38.319021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1205/2403] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:38.321479 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be4698-b8e5-4efb-a1da-f287c790e6fd None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:38.321944 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be4698-b8e5-4efb-a1da-f287c790e6fd None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:38.322385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be4698-b8e5-4efb-a1da-f287c790e6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:38.354637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-35be4698-b8e5-4efb-a1da-f287c790e6fd None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:38.356002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-35be4698-b8e5-4efb-a1da-f287c790e6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:38.422292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1206/2404] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:38.423174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be4698-b8e5-4efb-a1da-f287c790e6fd None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:38.424903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-35be4698-b8e5-4efb-a1da-f287c790e6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:38.439420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be4698-b8e5-4efb-a1da-f287c790e6fd None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:38.445397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132178b-d71a-459e-a3b1-e76cdc8e1997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:38.446099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132178b-d71a-459e-a3b1-e76cdc8e1997 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:38.446433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132178b-d71a-459e-a3b1-e76cdc8e1997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:38.446864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132178b-d71a-459e-a3b1-e76cdc8e1997 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:38.447882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132178b-d71a-459e-a3b1-e76cdc8e1997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:38.448357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132178b-d71a-459e-a3b1-e76cdc8e1997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:38.452200 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132178b-d71a-459e-a3b1-e76cdc8e1997 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:38.466514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1207/2405] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:38.468939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb33842-3e2e-49e9-8bce-0ab4f01056ba None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:38.469638 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb33842-3e2e-49e9-8bce-0ab4f01056ba None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:38.470205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb33842-3e2e-49e9-8bce-0ab4f01056ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:38.508365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b26ac4d59cd447cfba9a84360da90136'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:38.508540 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-bdb33842-3e2e-49e9-8bce-0ab4f01056ba None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:38.508540 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-bdb33842-3e2e-49e9-8bce-0ab4f01056ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:38.510930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b26ac4d59cd447cfba9a84360da90136'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:38.520018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1208/2406] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:38.520018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be1b5-9ce2-460f-af40-1fc0b1c903f7 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:38.520018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be1b5-9ce2-460f-af40-1fc0b1c903f7 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:38.520018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618be1b5-9ce2-460f-af40-1fc0b1c903f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:38.545036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-618be1b5-9ce2-460f-af40-1fc0b1c903f7 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:38.546315 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-618be1b5-9ce2-460f-af40-1fc0b1c903f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:38.555333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1209/2407] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:38.556388 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be1b5-9ce2-460f-af40-1fc0b1c903f7 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:38.561451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:38.567788 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618be1b5-9ce2-460f-af40-1fc0b1c903f7 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:38.574449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181c125-56d7-4b1d-947a-e12609027819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:38.575077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181c125-56d7-4b1d-947a-e12609027819 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:38.575357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181c125-56d7-4b1d-947a-e12609027819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:38.575635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181c125-56d7-4b1d-947a-e12609027819 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:38.576277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181c125-56d7-4b1d-947a-e12609027819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:38.578255 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181c125-56d7-4b1d-947a-e12609027819 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:38.717760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b26ac4d59cd447cfba9a84360da90136'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:38.718558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b26ac4d59cd447cfba9a84360da90136'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:38.719222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b26ac4d59cd447cfba9a84360da90136'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:38.741868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1199/2408] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:38 2022] DELETE /identity/v3/users/b26ac4d59cd447cfba9a84360da90136 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:38.742751 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:38.744155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:38.824658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a7f2-6f67-4432-8f91-9c16bf511f5a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:38.831376 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf422cb-db48-4639-ad39-79c7f0a01c8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:38.832440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf422cb-db48-4639-ad39-79c7f0a01c8f service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:38.834358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf422cb-db48-4639-ad39-79c7f0a01c8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:38.835077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf422cb-db48-4639-ad39-79c7f0a01c8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:38.837299 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:38.838493 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ddf422cb-db48-4639-ad39-79c7f0a01c8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:38.840890 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1210/2409] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:38 2022] POST /identity/v3/projects => generated 393 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:38.842585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181c125-56d7-4b1d-947a-e12609027819 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:38.845815 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3181c125-56d7-4b1d-947a-e12609027819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:38.963953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf422cb-db48-4639-ad39-79c7f0a01c8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:38.966110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf422cb-db48-4639-ad39-79c7f0a01c8f service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:38.972328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181c125-56d7-4b1d-947a-e12609027819 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:38.979321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4dc25-297d-4c57-8b67-f60a33c4c508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:38.980362 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4dc25-297d-4c57-8b67-f60a33c4c508 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:38.980823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4dc25-297d-4c57-8b67-f60a33c4c508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:38.981270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4dc25-297d-4c57-8b67-f60a33c4c508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:38.982675 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1200/2410] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:38.984153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf422cb-db48-4639-ad39-79c7f0a01c8f service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:38.984345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e7a4dc25-297d-4c57-8b67-f60a33c4c508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:38.986222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ddf422cb-db48-4639-ad39-79c7f0a01c8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:39.101515 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4dc25-297d-4c57-8b67-f60a33c4c508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:39.103022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4dc25-297d-4c57-8b67-f60a33c4c508 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:39.114689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1211/2411] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:39.116439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dab109-9b86-44bf-bc95-7731fa100d9e None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:39.116729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dab109-9b86-44bf-bc95-7731fa100d9e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:39.116995 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dab109-9b86-44bf-bc95-7731fa100d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:39.133006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf422cb-db48-4639-ad39-79c7f0a01c8f service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:39.138804 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922938e-cbf4-4006-8b13-d2052a4b6c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:39.139450 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922938e-cbf4-4006-8b13-d2052a4b6c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:39.139781 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922938e-cbf4-4006-8b13-d2052a4b6c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:39.140020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922938e-cbf4-4006-8b13-d2052a4b6c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:39.140178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-94dab109-9b86-44bf-bc95-7731fa100d9e None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:39.141034 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922938e-cbf4-4006-8b13-d2052a4b6c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:39.141325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922938e-cbf4-4006-8b13-d2052a4b6c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:39.141729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-94dab109-9b86-44bf-bc95-7731fa100d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:39.143650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922938e-cbf4-4006-8b13-d2052a4b6c0b admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:39.151005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1212/2412] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:39.151887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dab109-9b86-44bf-bc95-7731fa100d9e None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:39.153365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-94dab109-9b86-44bf-bc95-7731fa100d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:39.170761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1201/2413] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:39.170761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922938e-cbf4-4006-8b13-d2052a4b6c0b admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:39.173483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e922938e-cbf4-4006-8b13-d2052a4b6c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:39.175964 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dab109-9b86-44bf-bc95-7731fa100d9e None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:39.188465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8344d8-0aff-4457-ac6a-10cec4efe635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:39.189104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8344d8-0aff-4457-ac6a-10cec4efe635 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:39.189417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8344d8-0aff-4457-ac6a-10cec4efe635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:39.189687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8344d8-0aff-4457-ac6a-10cec4efe635 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:39.190350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8344d8-0aff-4457-ac6a-10cec4efe635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:39.198359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8344d8-0aff-4457-ac6a-10cec4efe635 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:39.199711 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922938e-cbf4-4006-8b13-d2052a4b6c0b admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:39.222051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873353bb-3f44-485b-bd1d-7dfc6e7878fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:39.223204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873353bb-3f44-485b-bd1d-7dfc6e7878fa service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:39.224869 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873353bb-3f44-485b-bd1d-7dfc6e7878fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:39.225323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873353bb-3f44-485b-bd1d-7dfc6e7878fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:39.244023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873353bb-3f44-485b-bd1d-7dfc6e7878fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:39.246236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873353bb-3f44-485b-bd1d-7dfc6e7878fa service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:39.262176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1202/2414] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:39.263709 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873353bb-3f44-485b-bd1d-7dfc6e7878fa service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:39.284166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873353bb-3f44-485b-bd1d-7dfc6e7878fa service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:39.294528 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf898b9-06ef-47bb-9091-95fda0f25658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:39.295697 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf898b9-06ef-47bb-9091-95fda0f25658 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:39.302037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf898b9-06ef-47bb-9091-95fda0f25658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:39.302037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf898b9-06ef-47bb-9091-95fda0f25658 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:39.302037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf898b9-06ef-47bb-9091-95fda0f25658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:39.302523 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf898b9-06ef-47bb-9091-95fda0f25658 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:39.413690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1213/2415] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:39 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:39.417929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8344d8-0aff-4457-ac6a-10cec4efe635 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:39.437318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8344d8-0aff-4457-ac6a-10cec4efe635 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:39.446064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0743fb-c8a1-48f3-85d7-9c49513f0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:39.447055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0743fb-c8a1-48f3-85d7-9c49513f0f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:39.447536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0743fb-c8a1-48f3-85d7-9c49513f0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:39.448032 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0743fb-c8a1-48f3-85d7-9c49513f0f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:39.449162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0743fb-c8a1-48f3-85d7-9c49513f0f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:39.452142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0743fb-c8a1-48f3-85d7-9c49513f0f07 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:39.469577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1214/2416] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:39.474527 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0743fb-c8a1-48f3-85d7-9c49513f0f07 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:39.493132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0743fb-c8a1-48f3-85d7-9c49513f0f07 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:39.501198 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb26f44-ebc7-4314-9d6d-c1ed575bce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:39.502225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb26f44-ebc7-4314-9d6d-c1ed575bce87 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:39.502737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb26f44-ebc7-4314-9d6d-c1ed575bce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:39.503225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb26f44-ebc7-4314-9d6d-c1ed575bce87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:39.504404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb26f44-ebc7-4314-9d6d-c1ed575bce87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:39.507655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb26f44-ebc7-4314-9d6d-c1ed575bce87 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:39.528505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1215/2417] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:44:39.533104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb26f44-ebc7-4314-9d6d-c1ed575bce87 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:39.545116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb26f44-ebc7-4314-9d6d-c1ed575bce87 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:39.550339 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ab313-4548-4ce0-9738-92d11e2c8388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:39.551016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ab313-4548-4ce0-9738-92d11e2c8388 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:39.551298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ab313-4548-4ce0-9738-92d11e2c8388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:39.551751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ab313-4548-4ce0-9738-92d11e2c8388 admin admin] PATH_INFO: `/v3/projects/251d81631e7b480180a3a6462c5160c2/users/de71969d631948b3bf1710d86c00b57c/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:39.568831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1203/2418] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:39 2022] POST /identity/v3/projects => generated 385 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:39.573498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ab313-4548-4ce0-9738-92d11e2c8388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=251d81631e7b480180a3a6462c5160c2, user_id=de71969d631948b3bf1710d86c00b57c, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:39.576205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ab313-4548-4ce0-9738-92d11e2c8388 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:39.580529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf898b9-06ef-47bb-9091-95fda0f25658 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:39.682653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf898b9-06ef-47bb-9091-95fda0f25658 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:39.688529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1216/2419] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:39 2022] PUT /identity/v3/projects/251d81631e7b480180a3a6462c5160c2/users/de71969d631948b3bf1710d86c00b57c/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:44:39.712595 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4380e9-29ea-4dd8-aa23-d2a52b720f73 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:39.713088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4380e9-29ea-4dd8-aa23-d2a52b720f73 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:39.713628 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4380e9-29ea-4dd8-aa23-d2a52b720f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:39.758816 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a035a27-a6b9-4da1-865e-c92cac31784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:39.759452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a035a27-a6b9-4da1-865e-c92cac31784c admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:39.759784 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a035a27-a6b9-4da1-865e-c92cac31784c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:39.760161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a035a27-a6b9-4da1-865e-c92cac31784c admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:39.760959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a035a27-a6b9-4da1-865e-c92cac31784c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:39.763358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a035a27-a6b9-4da1-865e-c92cac31784c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:39.768152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-1b4380e9-29ea-4dd8-aa23-d2a52b720f73 None None] MFA Rules not processed for user `de71969d631948b3bf1710d86c00b57c`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:39.770344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1b4380e9-29ea-4dd8-aa23-d2a52b720f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:39.898341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1217/2420] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:39.906705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4380e9-29ea-4dd8-aa23-d2a52b720f73 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:39.931229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4380e9-29ea-4dd8-aa23-d2a52b720f73 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:39.941545 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cd189-3e4b-4eab-baa2-a1d948c851ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:39.943689 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cd189-3e4b-4eab-baa2-a1d948c851ad admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:39.944325 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cd189-3e4b-4eab-baa2-a1d948c851ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:39.944893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cd189-3e4b-4eab-baa2-a1d948c851ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:39.946245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cd189-3e4b-4eab-baa2-a1d948c851ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:39.950957 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cd189-3e4b-4eab-baa2-a1d948c851ad admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:39.971136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1204/2421] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:39 2022] POST /identity/v3/users => generated 293 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:39.972931 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a035a27-a6b9-4da1-865e-c92cac31784c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:39.996651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a035a27-a6b9-4da1-865e-c92cac31784c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:40.006479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b90ea-7f34-441c-a4d0-fd4689300834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:40.007500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b90ea-7f34-441c-a4d0-fd4689300834 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:40.008111 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b90ea-7f34-441c-a4d0-fd4689300834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:40.008733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b90ea-7f34-441c-a4d0-fd4689300834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:40.010168 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b90ea-7f34-441c-a4d0-fd4689300834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:40.014797 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b90ea-7f34-441c-a4d0-fd4689300834 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:40.044994 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1205/2422] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:40.046888 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b90ea-7f34-441c-a4d0-fd4689300834 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:40.081274 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b90ea-7f34-441c-a4d0-fd4689300834 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:40.090094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a3f98-5616-420e-a213-bb2716bf10b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:40.091523 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3f98-5616-420e-a213-bb2716bf10b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:40.092330 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3f98-5616-420e-a213-bb2716bf10b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:40.092902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3f98-5616-420e-a213-bb2716bf10b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:40.094790 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a3f98-5616-420e-a213-bb2716bf10b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:40.097556 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a3f98-5616-420e-a213-bb2716bf10b8 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:40.128722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1206/2423] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:40.131215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a3f98-5616-420e-a213-bb2716bf10b8 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:40.139344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1218/2424] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:39 2022] POST /identity/v3/projects => generated 393 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:40.157873 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cd189-3e4b-4eab-baa2-a1d948c851ad admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:40.178420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a3f98-5616-420e-a213-bb2716bf10b8 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:40.309754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ac4c0-0011-4132-8c8c-f69f289722cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:40.310458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ac4c0-0011-4132-8c8c-f69f289722cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:40.310826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ac4c0-0011-4132-8c8c-f69f289722cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:40.311269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ac4c0-0011-4132-8c8c-f69f289722cf admin admin] PATH_INFO: `/v3/projects/12e386fac2eb41639a52e188727236b8/users/ff6b10b91c5f41069f74865aa5883089/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:40.324702 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cd189-3e4b-4eab-baa2-a1d948c851ad admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:40.330168 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb2480-71c3-44f6-8e24-629e30f1654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:40.330911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb2480-71c3-44f6-8e24-629e30f1654d admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:40.331290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb2480-71c3-44f6-8e24-629e30f1654d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:40.331664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb2480-71c3-44f6-8e24-629e30f1654d admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:40.332408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb2480-71c3-44f6-8e24-629e30f1654d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:40.335831 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb2480-71c3-44f6-8e24-629e30f1654d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:40.353360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ac4c0-0011-4132-8c8c-f69f289722cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=12e386fac2eb41639a52e188727236b8, user_id=ff6b10b91c5f41069f74865aa5883089, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:40.356238 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ac4c0-0011-4132-8c8c-f69f289722cf admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:40.559456 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1207/2426] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:40 2022] PUT /identity/v3/projects/12e386fac2eb41639a52e188727236b8/users/ff6b10b91c5f41069f74865aa5883089/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:40.559723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1219/2426] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:40 2022] POST /identity/v3/users => generated 303 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:44:40.561288 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ac4c0-0011-4132-8c8c-f69f289722cf admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:40.561876 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb2480-71c3-44f6-8e24-629e30f1654d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:40.572937 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-935ac4c0-0011-4132-8c8c-f69f289722cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:40.576987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7cbb2480-71c3-44f6-8e24-629e30f1654d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:40.603875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb2480-71c3-44f6-8e24-629e30f1654d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:40.679248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ac4c0-0011-4132-8c8c-f69f289722cf admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:40.682959 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:40.683929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:40.684394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:40.684797 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0 admin admin] PATH_INFO: `/v3/projects/d4f0deda842b4628b7338940197b89d7` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:40.684947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:40.685480 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:40.685774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:40.686040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] PATH_INFO: `/v3/projects/6b85a88f96aa42daa97f39cb07d89220` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:40.686765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f0deda842b4628b7338940197b89d7)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:40.687315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b85a88f96aa42daa97f39cb07d89220)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:40.689312 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:40.690307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:40.891800 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b85a88f96aa42daa97f39cb07d89220', 'request_id': 'req-438ad04e-a774-48b0-9796-25442bcf81ea'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:40.905271 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b85a88f96aa42daa97f39cb07d89220', 'request_id': 'req-438ad04e-a774-48b0-9796-25442bcf81ea'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:40.940005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f0deda842b4628b7338940197b89d7', 'request_id': 'req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.103120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b85a88f96aa42daa97f39cb07d89220', 'request_id': 'req-438ad04e-a774-48b0-9796-25442bcf81ea'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.124913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] The token cache is being invalidate because project 6b85a88f96aa42daa97f39cb07d89220 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:41.125537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.126740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.129423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1208/2427] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:40 2022] DELETE /identity/v3/projects/6b85a88f96aa42daa97f39cb07d89220 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:41.133062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:41.133793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:41.195042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f0deda842b4628b7338940197b89d7', 'request_id': 'req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.221283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f0deda842b4628b7338940197b89d7', 'request_id': 'req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.253087 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0 admin admin] The token cache is being invalidate because project d4f0deda842b4628b7338940197b89d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:41.253709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.254711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-51018e1a-3f64-44c5-bd9f-bc463a6c27b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.257668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1220/2428] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:40 2022] DELETE /identity/v3/projects/d4f0deda842b4628b7338940197b89d7 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:41.259583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e791703-e801-4852-81a8-83c8bfac1827 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:41.260012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e791703-e801-4852-81a8-83c8bfac1827 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:41.260408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e791703-e801-4852-81a8-83c8bfac1827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:41.267998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ad04e-a774-48b0-9796-25442bcf81ea admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:41.308365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5e791703-e801-4852-81a8-83c8bfac1827 None None] MFA Rules not processed for user `ff6b10b91c5f41069f74865aa5883089`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:41.310059 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5e791703-e801-4852-81a8-83c8bfac1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:41.386928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbed4e-9f93-4466-bc04-f84c0ba4613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:41.388085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbed4e-9f93-4466-bc04-f84c0ba4613a admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:41.388367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbed4e-9f93-4466-bc04-f84c0ba4613a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:41.388769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbed4e-9f93-4466-bc04-f84c0ba4613a admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:41.389848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbed4e-9f93-4466-bc04-f84c0ba4613a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:41.392633 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbed4e-9f93-4466-bc04-f84c0ba4613a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:41.412572 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1209/2429] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:41.414178 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbed4e-9f93-4466-bc04-f84c0ba4613a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:41.417031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-94cbed4e-9f93-4466-bc04-f84c0ba4613a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:41.419824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1221/2430] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:41.423218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ebe4-7dac-4792-8777-508fb70843ef None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:41.423218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ebe4-7dac-4792-8777-508fb70843ef None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:41.423218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6ebe4-7dac-4792-8777-508fb70843ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:41.444199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbed4e-9f93-4466-bc04-f84c0ba4613a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:41.452310 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:41.452654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-16d6ebe4-7dac-4792-8777-508fb70843ef None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:41.453212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:41.453690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:41.453955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-16d6ebe4-7dac-4792-8777-508fb70843ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:41.454127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] PATH_INFO: `/v3/users/3c70e50820e3477fbcbfa4bee20eae9e` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:41.455988 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c70e50820e3477fbcbfa4bee20eae9e)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:41.460446 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:41.463514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1222/2431] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:41.464451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ebe4-7dac-4792-8777-508fb70843ef None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:41.467103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-16d6ebe4-7dac-4792-8777-508fb70843ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:41.482319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6ebe4-7dac-4792-8777-508fb70843ef None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:41.486959 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7289d-5034-4a22-ad42-180e34c57a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:41.487648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7289d-5034-4a22-ad42-180e34c57a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:41.487930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7289d-5034-4a22-ad42-180e34c57a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:41.488227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7289d-5034-4a22-ad42-180e34c57a4f admin admin] PATH_INFO: `/v3/projects/65d0d83e9fa545108092a1cd51ef965a/users/9d98f21dffbb45d2a6dc2f67d18dfced/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:41.513721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7289d-5034-4a22-ad42-180e34c57a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d0d83e9fa545108092a1cd51ef965a, user_id=9d98f21dffbb45d2a6dc2f67d18dfced, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:41.517188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7289d-5034-4a22-ad42-180e34c57a4f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:41.657650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1223/2432] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:41 2022] PUT /identity/v3/projects/65d0d83e9fa545108092a1cd51ef965a/users/9d98f21dffbb45d2a6dc2f67d18dfced/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:41.660731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7289d-5034-4a22-ad42-180e34c57a4f admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:41.663754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-dbc7289d-5034-4a22-ad42-180e34c57a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:41.766034 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7289d-5034-4a22-ad42-180e34c57a4f admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:41.771352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a15ab-452f-4f1e-9692-f6ebdb2a845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:41.771352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a15ab-452f-4f1e-9692-f6ebdb2a845b admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:41.772191 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a15ab-452f-4f1e-9692-f6ebdb2a845b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:41.772390 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a15ab-452f-4f1e-9692-f6ebdb2a845b admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:41.773039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a15ab-452f-4f1e-9692-f6ebdb2a845b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:41.775127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a15ab-452f-4f1e-9692-f6ebdb2a845b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:41.813200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c70e50820e3477fbcbfa4bee20eae9e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.830265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c70e50820e3477fbcbfa4bee20eae9e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.908512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:41.961424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c70e50820e3477fbcbfa4bee20eae9e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.962108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c70e50820e3477fbcbfa4bee20eae9e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.963237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c70e50820e3477fbcbfa4bee20eae9e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:41.976936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1224/2433] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:41 2022] POST /identity/v3/projects => generated 385 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:41.976936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebea04-47aa-4c88-9c42-835d12d3058d None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:41.976936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebea04-47aa-4c88-9c42-835d12d3058d None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:41.977931 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebea04-47aa-4c88-9c42-835d12d3058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:41.996811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1210/2434] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:41 2022] DELETE /identity/v3/users/3c70e50820e3477fbcbfa4bee20eae9e => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:41.998353 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:42.001253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:42.018340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-45ebea04-47aa-4c88-9c42-835d12d3058d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:42.020548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-45ebea04-47aa-4c88-9c42-835d12d3058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:42.055708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:42.112762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c64b7a-4eee-43e8-8900-411ceab6e225 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:42.124839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1225/2435] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:42.124839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebea04-47aa-4c88-9c42-835d12d3058d None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:42.124839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-45ebea04-47aa-4c88-9c42-835d12d3058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:42.127540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0b220-71e9-4981-847d-4fe11a4cc39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:42.128233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b220-71e9-4981-847d-4fe11a4cc39a admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:42.140507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b220-71e9-4981-847d-4fe11a4cc39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:42.140507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0b220-71e9-4981-847d-4fe11a4cc39a admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:42.140507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0b220-71e9-4981-847d-4fe11a4cc39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:42.140507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0b220-71e9-4981-847d-4fe11a4cc39a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:42.142757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebea04-47aa-4c88-9c42-835d12d3058d None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:42.150001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4845b00-f8d5-4159-b1fc-015de8930f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:42.150898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4845b00-f8d5-4159-b1fc-015de8930f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:42.151385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4845b00-f8d5-4159-b1fc-015de8930f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:42.151811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4845b00-f8d5-4159-b1fc-015de8930f18 admin admin] PATH_INFO: `/v3/users/1125d3a31e3d46ef895aafe6120870bf` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:42.152747 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1211/2436] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:42.154341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0b220-71e9-4981-847d-4fe11a4cc39a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:42.157342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9bc0b220-71e9-4981-847d-4fe11a4cc39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:42.158729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4845b00-f8d5-4159-b1fc-015de8930f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1125d3a31e3d46ef895aafe6120870bf)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:42.162551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4845b00-f8d5-4159-b1fc-015de8930f18 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:42.180586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0b220-71e9-4981-847d-4fe11a4cc39a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:42.185881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfce16-1a93-462e-8a7d-b9e75317d349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:42.186512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfce16-1a93-462e-8a7d-b9e75317d349 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:42.186794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfce16-1a93-462e-8a7d-b9e75317d349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:42.187075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfce16-1a93-462e-8a7d-b9e75317d349 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:42.187752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfce16-1a93-462e-8a7d-b9e75317d349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:42.189927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfce16-1a93-462e-8a7d-b9e75317d349 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:42.409519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1212/2437] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:42 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:42.410289 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfce16-1a93-462e-8a7d-b9e75317d349 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:42.428416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfce16-1a93-462e-8a7d-b9e75317d349 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:42.437159 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9d072-6af3-4586-b297-79f17d4b9047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:42.438213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d072-6af3-4586-b297-79f17d4b9047 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:42.438814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d072-6af3-4586-b297-79f17d4b9047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:42.448969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d072-6af3-4586-b297-79f17d4b9047 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:42.448969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9d072-6af3-4586-b297-79f17d4b9047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:42.448969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9d072-6af3-4586-b297-79f17d4b9047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:42.448969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9d072-6af3-4586-b297-79f17d4b9047 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:42.472172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1213/2438] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:42.474019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9d072-6af3-4586-b297-79f17d4b9047 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:42.494756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9d072-6af3-4586-b297-79f17d4b9047 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:42.503751 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1238ef4-22b8-4952-8d9b-ded97d520f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:42.505011 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1238ef4-22b8-4952-8d9b-ded97d520f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:42.506160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1238ef4-22b8-4952-8d9b-ded97d520f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:42.506813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1238ef4-22b8-4952-8d9b-ded97d520f4e admin admin] PATH_INFO: `/v3/projects/65d0d83e9fa545108092a1cd51ef965a/users/9d98f21dffbb45d2a6dc2f67d18dfced/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:42.510154 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1238ef4-22b8-4952-8d9b-ded97d520f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65d0d83e9fa545108092a1cd51ef965a, user_id=9d98f21dffbb45d2a6dc2f67d18dfced, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:42.515307 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1238ef4-22b8-4952-8d9b-ded97d520f4e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:42.537707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1214/2439] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:42 2022] PUT /identity/v3/projects/65d0d83e9fa545108092a1cd51ef965a/users/9d98f21dffbb45d2a6dc2f67d18dfced/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:42.550109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1238ef4-22b8-4952-8d9b-ded97d520f4e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:42.550282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d4845b00-f8d5-4159-b1fc-015de8930f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1125d3a31e3d46ef895aafe6120870bf'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:42.576090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d4845b00-f8d5-4159-b1fc-015de8930f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1125d3a31e3d46ef895aafe6120870bf'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:42.592764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d4845b00-f8d5-4159-b1fc-015de8930f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1125d3a31e3d46ef895aafe6120870bf'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:42.654435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1238ef4-22b8-4952-8d9b-ded97d520f4e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:42.666749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2fd56-3916-4b35-bea3-4fc4a4a7d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:42.667386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2fd56-3916-4b35-bea3-4fc4a4a7d78b admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:42.667668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2fd56-3916-4b35-bea3-4fc4a4a7d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:42.667943 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2fd56-3916-4b35-bea3-4fc4a4a7d78b admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:42.668602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2fd56-3916-4b35-bea3-4fc4a4a7d78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:42.670635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2fd56-3916-4b35-bea3-4fc4a4a7d78b admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:42.682338 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1215/2440] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:42.683404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2fd56-3916-4b35-bea3-4fc4a4a7d78b admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:42.694984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2fd56-3916-4b35-bea3-4fc4a4a7d78b admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:42.700066 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cc13c-6f8c-4158-84a5-3973f7d26117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:42.700695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cc13c-6f8c-4158-84a5-3973f7d26117 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:42.700975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cc13c-6f8c-4158-84a5-3973f7d26117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:42.701249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2cc13c-6f8c-4158-84a5-3973f7d26117 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:42.701972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cc13c-6f8c-4158-84a5-3973f7d26117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:42.703923 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2cc13c-6f8c-4158-84a5-3973f7d26117 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:42.760573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d4845b00-f8d5-4159-b1fc-015de8930f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1125d3a31e3d46ef895aafe6120870bf'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:42.773730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d4845b00-f8d5-4159-b1fc-015de8930f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1125d3a31e3d46ef895aafe6120870bf'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:42.792901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1226/2441] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:42 2022] DELETE /identity/v3/users/1125d3a31e3d46ef895aafe6120870bf => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:42.796508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034005-0daa-41f8-adb8-245694304b2d None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:42.796989 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034005-0daa-41f8-adb8-245694304b2d None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:42.797426 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00034005-0daa-41f8-adb8-245694304b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:42.875230 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-00034005-0daa-41f8-adb8-245694304b2d None None] MFA Rules not processed for user `9d98f21dffbb45d2a6dc2f67d18dfced`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:42.877407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-00034005-0daa-41f8-adb8-245694304b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:42.911539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1216/2442] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:42 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:42.913068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cc13c-6f8c-4158-84a5-3973f7d26117 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:42.914841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7d2cc13c-6f8c-4158-84a5-3973f7d26117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:42.997439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1227/2443] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:42.999116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00034005-0daa-41f8-adb8-245694304b2d None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:43.000753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-00034005-0daa-41f8-adb8-245694304b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:43.009724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2cc13c-6f8c-4158-84a5-3973f7d26117 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:43.019000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703ae72-7d11-4646-a1d3-073bdd1814be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:43.019721 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703ae72-7d11-4646-a1d3-073bdd1814be admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:43.020008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703ae72-7d11-4646-a1d3-073bdd1814be admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:43.020327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703ae72-7d11-4646-a1d3-073bdd1814be admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:43.021694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703ae72-7d11-4646-a1d3-073bdd1814be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:43.023681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703ae72-7d11-4646-a1d3-073bdd1814be admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:43.040971 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1217/2444] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:43.042728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a25d5-2293-4927-aebb-26760fa1cec9 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:43.043032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a25d5-2293-4927-aebb-26760fa1cec9 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:43.043305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a25d5-2293-4927-aebb-26760fa1cec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:43.065958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ab9a25d5-2293-4927-aebb-26760fa1cec9 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:43.067238 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ab9a25d5-2293-4927-aebb-26760fa1cec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:43.076727 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1218/2445] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:43.081187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a25d5-2293-4927-aebb-26760fa1cec9 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:43.081187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ab9a25d5-2293-4927-aebb-26760fa1cec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:43.101603 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a25d5-2293-4927-aebb-26760fa1cec9 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:43.106713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0270ac-7989-453c-9be8-b13228de719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:43.107494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0270ac-7989-453c-9be8-b13228de719f admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:43.107773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0270ac-7989-453c-9be8-b13228de719f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:43.108043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0270ac-7989-453c-9be8-b13228de719f admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:43.108707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0270ac-7989-453c-9be8-b13228de719f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:43.111242 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00034005-0daa-41f8-adb8-245694304b2d None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:43.111507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0270ac-7989-453c-9be8-b13228de719f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:43.117185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:43.117887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:43.118284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:43.118566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] PATH_INFO: `/v3/projects/372e95cb5e3e4152969b10a26a466835` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:43.120450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] RBAC: Authorizing `identity:delete_project(project_id=372e95cb5e3e4152969b10a26a466835)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:43.124498 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:43.909822 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1219/2446] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:43 2022] POST /identity/v3/users => generated 292 bytes in 831 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:43.912468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0270ac-7989-453c-9be8-b13228de719f admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:43.930314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372e95cb5e3e4152969b10a26a466835', 'request_id': 'req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:43.945131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0270ac-7989-453c-9be8-b13228de719f admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:44.018576 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4440073-9978-41c0-a987-c09bcae35a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:44.019535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4440073-9978-41c0-a987-c09bcae35a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:44.020065 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4440073-9978-41c0-a987-c09bcae35a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:44.020475 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4440073-9978-41c0-a987-c09bcae35a55 admin admin] PATH_INFO: `/v3/projects/c43116a3ec444465907144b72879ef56/users/c20aa522fc4f4f839e93f6231f78ac4a/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:44.040900 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4440073-9978-41c0-a987-c09bcae35a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c43116a3ec444465907144b72879ef56, user_id=c20aa522fc4f4f839e93f6231f78ac4a, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:44.043869 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4440073-9978-41c0-a987-c09bcae35a55 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:44.079152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372e95cb5e3e4152969b10a26a466835', 'request_id': 'req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:44.087972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372e95cb5e3e4152969b10a26a466835', 'request_id': 'req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:44.101754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] The token cache is being invalidate because project 372e95cb5e3e4152969b10a26a466835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:44.102088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:44.103327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:44.104737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1228/2447] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:42 2022] DELETE /identity/v3/projects/372e95cb5e3e4152969b10a26a466835 => generated 0 bytes in 1106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:44.105333 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:44.107039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:44.154437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1220/2448] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:43 2022] PUT /identity/v3/projects/c43116a3ec444465907144b72879ef56/users/c20aa522fc4f4f839e93f6231f78ac4a/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:44.165036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4440073-9978-41c0-a987-c09bcae35a55 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:44.167324 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e4440073-9978-41c0-a987-c09bcae35a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:44.204334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8ef8c-97bc-4ee6-95f7-762c7b9d083f admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:44.257196 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4440073-9978-41c0-a987-c09bcae35a55 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:44.266394 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52eaa4-358d-4bfc-ac7b-29668fed4ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:44.267177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52eaa4-358d-4bfc-ac7b-29668fed4ccb service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:44.267340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52eaa4-358d-4bfc-ac7b-29668fed4ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:44.267691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52eaa4-358d-4bfc-ac7b-29668fed4ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:44.269736 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0e52eaa4-358d-4bfc-ac7b-29668fed4ccb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:44.277856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c182cc-ac4c-4fd8-9658-6785b1374052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:44.278941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c182cc-ac4c-4fd8-9658-6785b1374052 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:44.279439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c182cc-ac4c-4fd8-9658-6785b1374052 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:44.279939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c182cc-ac4c-4fd8-9658-6785b1374052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:44.283240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-04c182cc-ac4c-4fd8-9658-6785b1374052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:44.347973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52eaa4-358d-4bfc-ac7b-29668fed4ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:44.350372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52eaa4-358d-4bfc-ac7b-29668fed4ccb service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:44.361365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1221/2449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:44.362413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52eaa4-358d-4bfc-ac7b-29668fed4ccb service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:44.364093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0e52eaa4-358d-4bfc-ac7b-29668fed4ccb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:44.390853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:44.398639 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c182cc-ac4c-4fd8-9658-6785b1374052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:44.401401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c182cc-ac4c-4fd8-9658-6785b1374052 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:44.411972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1229/2450] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:44.413268 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dd340-502e-4bc2-9916-906e45e0f96a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:44.413687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dd340-502e-4bc2-9916-906e45e0f96a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:44.414056 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dd340-502e-4bc2-9916-906e45e0f96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:44.464653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-968dd340-502e-4bc2-9916-906e45e0f96a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:44.475717 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-968dd340-502e-4bc2-9916-906e45e0f96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:44.511318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1230/2451] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:44.515596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52eaa4-358d-4bfc-ac7b-29668fed4ccb service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:44.522512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66300d1-e534-499b-97f2-219954c7e3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:44.523244 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66300d1-e534-499b-97f2-219954c7e3af admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:44.523602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66300d1-e534-499b-97f2-219954c7e3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:44.523960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66300d1-e534-499b-97f2-219954c7e3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:44.525071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66300d1-e534-499b-97f2-219954c7e3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:44.525588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c0b96-dbf5-4803-b9a6-3b7014e4fca2 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:44.525945 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c0b96-dbf5-4803-b9a6-3b7014e4fca2 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:44.526600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c0b96-dbf5-4803-b9a6-3b7014e4fca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:44.528134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66300d1-e534-499b-97f2-219954c7e3af admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:44.545767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1222/2452] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:44.546669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66300d1-e534-499b-97f2-219954c7e3af admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:44.558558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66300d1-e534-499b-97f2-219954c7e3af admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:44.569672 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a3004-0cf3-4ba8-b96a-04aee2f08e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:44.570324 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a3004-0cf3-4ba8-b96a-04aee2f08e32 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:44.570662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a3004-0cf3-4ba8-b96a-04aee2f08e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:44.570950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a3004-0cf3-4ba8-b96a-04aee2f08e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:44.575730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4c5a3004-0cf3-4ba8-b96a-04aee2f08e32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:44.585259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-4d6c0b96-dbf5-4803-b9a6-3b7014e4fca2 None None] MFA Rules not processed for user `c20aa522fc4f4f839e93f6231f78ac4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:44.587605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-4d6c0b96-dbf5-4803-b9a6-3b7014e4fca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:44.687398 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a3004-0cf3-4ba8-b96a-04aee2f08e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:44.688420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a3004-0cf3-4ba8-b96a-04aee2f08e32 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:44.701311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1223/2453] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:44 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:44.709645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2f112-a1e3-46d9-a5ce-b3dd93f8ed1a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:44.709645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2f112-a1e3-46d9-a5ce-b3dd93f8ed1a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:44.709645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2f112-a1e3-46d9-a5ce-b3dd93f8ed1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:44.730311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1231/2454] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:44.731476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c0b96-dbf5-4803-b9a6-3b7014e4fca2 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:44.738462 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-58f2f112-a1e3-46d9-a5ce-b3dd93f8ed1a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:44.740635 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-58f2f112-a1e3-46d9-a5ce-b3dd93f8ed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:44.745733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c0b96-dbf5-4803-b9a6-3b7014e4fca2 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:44.749917 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1224/2455] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:44.750767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2f112-a1e3-46d9-a5ce-b3dd93f8ed1a None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:44.752112 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-58f2f112-a1e3-46d9-a5ce-b3dd93f8ed1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:44.754356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef42ff-3e82-4742-8d46-d9a970793276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:44.755097 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef42ff-3e82-4742-8d46-d9a970793276 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:44.755680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef42ff-3e82-4742-8d46-d9a970793276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:44.756146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef42ff-3e82-4742-8d46-d9a970793276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:44.757180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef42ff-3e82-4742-8d46-d9a970793276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:44.759407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bef42ff-3e82-4742-8d46-d9a970793276 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:44.767201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2f112-a1e3-46d9-a5ce-b3dd93f8ed1a None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:44.772416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1232/2456] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:44.773399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef42ff-3e82-4742-8d46-d9a970793276 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:44.779131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598a565-6d98-4f32-8758-2e245957beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:44.779131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598a565-6d98-4f32-8758-2e245957beec admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:44.779131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598a565-6d98-4f32-8758-2e245957beec admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:44.779131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598a565-6d98-4f32-8758-2e245957beec admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:44.779675 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598a565-6d98-4f32-8758-2e245957beec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:44.779984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598a565-6d98-4f32-8758-2e245957beec admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:44.787044 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef42ff-3e82-4742-8d46-d9a970793276 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:44.794828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd8828-a7cc-4130-81ee-5f40b7977aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:44.795591 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd8828-a7cc-4130-81ee-5f40b7977aab admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:44.796007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd8828-a7cc-4130-81ee-5f40b7977aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:44.796371 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dd8828-a7cc-4130-81ee-5f40b7977aab admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:44.797131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd8828-a7cc-4130-81ee-5f40b7977aab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:44.798547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd8828-a7cc-4130-81ee-5f40b7977aab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:44.799454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dd8828-a7cc-4130-81ee-5f40b7977aab admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:44.819412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1233/2457] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:44.820500 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd8828-a7cc-4130-81ee-5f40b7977aab admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:44.831670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dd8828-a7cc-4130-81ee-5f40b7977aab admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:44.836923 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf27a2a-69a5-4376-9adf-f04b3e9777e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:44.837634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf27a2a-69a5-4376-9adf-f04b3e9777e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:44.837918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf27a2a-69a5-4376-9adf-f04b3e9777e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:44.838193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf27a2a-69a5-4376-9adf-f04b3e9777e4 admin admin] PATH_INFO: `/v3/projects/36c2ceeffe0049a4994f1b41a96c6cda/users/eecc57219a924e98aef06849d85d44e5/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:44.855607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf27a2a-69a5-4376-9adf-f04b3e9777e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c2ceeffe0049a4994f1b41a96c6cda, user_id=eecc57219a924e98aef06849d85d44e5, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:44.858292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf27a2a-69a5-4376-9adf-f04b3e9777e4 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:44.938898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1225/2458] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:44 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:44.946667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598a565-6d98-4f32-8758-2e245957beec admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:44.967359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1234/2459] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:44 2022] PUT /identity/v3/projects/36c2ceeffe0049a4994f1b41a96c6cda/users/eecc57219a924e98aef06849d85d44e5/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:44.968777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf27a2a-69a5-4376-9adf-f04b3e9777e4 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:45.044760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598a565-6d98-4f32-8758-2e245957beec admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:45.104123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf27a2a-69a5-4376-9adf-f04b3e9777e4 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:45.113936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6c3b7-8792-415e-9426-ce8814295745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:45.115823 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6c3b7-8792-415e-9426-ce8814295745 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:45.116330 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6c3b7-8792-415e-9426-ce8814295745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:45.116834 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6c3b7-8792-415e-9426-ce8814295745 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:45.118170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6c3b7-8792-415e-9426-ce8814295745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:45.122776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6c3b7-8792-415e-9426-ce8814295745 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:45.138206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646463c9-1790-4d11-b0f1-6355b22ea8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:45.141328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646463c9-1790-4d11-b0f1-6355b22ea8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:45.142569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646463c9-1790-4d11-b0f1-6355b22ea8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:45.143918 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646463c9-1790-4d11-b0f1-6355b22ea8b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:45.146546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646463c9-1790-4d11-b0f1-6355b22ea8b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:45.151206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646463c9-1790-4d11-b0f1-6355b22ea8b0 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:45.356365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1235/2460] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:44 2022] POST /identity/v3/users => generated 299 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:45.359057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098da7c4-ed5c-4223-aad4-1ef92326a027 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:45.359536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098da7c4-ed5c-4223-aad4-1ef92326a027 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:45.360017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098da7c4-ed5c-4223-aad4-1ef92326a027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:45.372819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1226/2461] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:44 2022] POST /identity/v3/projects => generated 385 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:45.372819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646463c9-1790-4d11-b0f1-6355b22ea8b0 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:45.372819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-646463c9-1790-4d11-b0f1-6355b22ea8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:45.403842 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-098da7c4-ed5c-4223-aad4-1ef92326a027 None None] MFA Rules not processed for user `eecc57219a924e98aef06849d85d44e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:45.406042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-098da7c4-ed5c-4223-aad4-1ef92326a027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:45.459985 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646463c9-1790-4d11-b0f1-6355b22ea8b0 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:45.465578 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:45.466243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:45.466533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:45.466809 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] PATH_INFO: `/v3/projects/a5116ba5a11542a584b6d5f240b5ef69` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:45.469126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5116ba5a11542a584b6d5f240b5ef69)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:45.470266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:45.531881 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1236/2462] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:45.534590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098da7c4-ed5c-4223-aad4-1ef92326a027 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:45.549237 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098da7c4-ed5c-4223-aad4-1ef92326a027 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:45.555995 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb0e3c-f616-4477-8817-9016975bedc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:45.556677 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb0e3c-f616-4477-8817-9016975bedc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:45.557040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb0e3c-f616-4477-8817-9016975bedc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:45.557398 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb0e3c-f616-4477-8817-9016975bedc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:45.558137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb0e3c-f616-4477-8817-9016975bedc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:45.560011 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb0e3c-f616-4477-8817-9016975bedc2 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:45.572551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1237/2463] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:45.573612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb0e3c-f616-4477-8817-9016975bedc2 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:45.587504 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb0e3c-f616-4477-8817-9016975bedc2 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:45.593919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64871417-8e93-4d22-8c1f-596debe53bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:45.594615 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64871417-8e93-4d22-8c1f-596debe53bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:45.594961 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64871417-8e93-4d22-8c1f-596debe53bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:45.595303 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64871417-8e93-4d22-8c1f-596debe53bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:45.596145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64871417-8e93-4d22-8c1f-596debe53bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:45.598331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64871417-8e93-4d22-8c1f-596debe53bd8 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:45.605342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:45.695910 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5116ba5a11542a584b6d5f240b5ef69', 'request_id': 'req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:45.703277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5116ba5a11542a584b6d5f240b5ef69', 'request_id': 'req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:45.735014 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1238/2464] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:45 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:45.735014 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64871417-8e93-4d22-8c1f-596debe53bd8 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:45.748820 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64871417-8e93-4d22-8c1f-596debe53bd8 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:45.835113 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab98a2-87d4-4d0f-9117-8f055d774fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:45.835814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab98a2-87d4-4d0f-9117-8f055d774fdd admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:45.836363 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab98a2-87d4-4d0f-9117-8f055d774fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:45.836646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab98a2-87d4-4d0f-9117-8f055d774fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:45.837351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab98a2-87d4-4d0f-9117-8f055d774fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:45.851225 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5116ba5a11542a584b6d5f240b5ef69', 'request_id': 'req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:45.851914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab98a2-87d4-4d0f-9117-8f055d774fdd admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:45.867797 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] The token cache is being invalidate because project a5116ba5a11542a584b6d5f240b5ef69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:45.868246 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:45.869073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:45.872546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1227/2465] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:45 2022] DELETE /identity/v3/projects/a5116ba5a11542a584b6d5f240b5ef69 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:45.873907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:45.875960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:45.896585 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc55e4-c4ed-4632-bef4-4e7246d578fe admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:45.897585 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951994f4-177b-4c4e-97d1-64e501199b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:45.897585 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951994f4-177b-4c4e-97d1-64e501199b49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:45.897889 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951994f4-177b-4c4e-97d1-64e501199b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:45.898043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951994f4-177b-4c4e-97d1-64e501199b49 admin admin] PATH_INFO: `/v3/projects/d2bb1cb78c4d4714b33e3a5424c5b31d/users/e562f246791f46848269da72a38a07a4/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:45.915650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951994f4-177b-4c4e-97d1-64e501199b49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bb1cb78c4d4714b33e3a5424c5b31d, user_id=e562f246791f46848269da72a38a07a4, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:45.918514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951994f4-177b-4c4e-97d1-64e501199b49 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:46.003176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1239/2466] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:45 2022] POST /identity/v3/projects => generated 383 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:46.003465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab98a2-87d4-4d0f-9117-8f055d774fdd admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:46.009528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-81ab98a2-87d4-4d0f-9117-8f055d774fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:46.094694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab98a2-87d4-4d0f-9117-8f055d774fdd admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:46.100574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e97eb-8fbf-4355-848a-e13edb233080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:46.101009 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e97eb-8fbf-4355-848a-e13edb233080 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:46.101229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e97eb-8fbf-4355-848a-e13edb233080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:46.101503 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e97eb-8fbf-4355-848a-e13edb233080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:46.102176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e97eb-8fbf-4355-848a-e13edb233080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:46.103859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e97eb-8fbf-4355-848a-e13edb233080 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:46.110644 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1228/2467] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:45 2022] PUT /identity/v3/projects/d2bb1cb78c4d4714b33e3a5424c5b31d/users/e562f246791f46848269da72a38a07a4/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:46.112393 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951994f4-177b-4c4e-97d1-64e501199b49 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:46.116676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1240/2468] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:46.125915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-951994f4-177b-4c4e-97d1-64e501199b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:46.126152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e97eb-8fbf-4355-848a-e13edb233080 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:46.126152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c14e97eb-8fbf-4355-848a-e13edb233080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:46.135568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e97eb-8fbf-4355-848a-e13edb233080 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:46.185143 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:46.204528 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951994f4-177b-4c4e-97d1-64e501199b49 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:46.211455 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:46.212082 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:46.212372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:46.212653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] PATH_INFO: `/v3/users/23596e57a58e478599739e62c9d31523` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:46.214094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] RBAC: Authorizing `identity:delete_user(user_id=23596e57a58e478599739e62c9d31523)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:46.216188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:46.248473 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daae9f6-cb3e-45ab-8dd2-d3577394ed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:46.249517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daae9f6-cb3e-45ab-8dd2-d3577394ed16 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:46.249996 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daae9f6-cb3e-45ab-8dd2-d3577394ed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:46.250451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daae9f6-cb3e-45ab-8dd2-d3577394ed16 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:46.251541 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daae9f6-cb3e-45ab-8dd2-d3577394ed16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:46.254658 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daae9f6-cb3e-45ab-8dd2-d3577394ed16 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:46.426334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1241/2469] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:46 2022] POST /identity/v3/users => generated 292 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:46.434209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daae9f6-cb3e-45ab-8dd2-d3577394ed16 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:46.442225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daae9f6-cb3e-45ab-8dd2-d3577394ed16 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:46.447856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9667d-f1ce-433a-9545-3a7920ccd168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:46.448475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9667d-f1ce-433a-9545-3a7920ccd168 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:46.448903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9667d-f1ce-433a-9545-3a7920ccd168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:46.449186 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9667d-f1ce-433a-9545-3a7920ccd168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:46.449887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9667d-f1ce-433a-9545-3a7920ccd168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:46.451512 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9667d-f1ce-433a-9545-3a7920ccd168 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:46.462975 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1242/2470] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:46.463551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9667d-f1ce-433a-9545-3a7920ccd168 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:46.480579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9667d-f1ce-433a-9545-3a7920ccd168 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:46.489933 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9435fd-41ca-4e3d-b79a-0b4f8eb1b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:46.491538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9435fd-41ca-4e3d-b79a-0b4f8eb1b972 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:46.492064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9435fd-41ca-4e3d-b79a-0b4f8eb1b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:46.492551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9435fd-41ca-4e3d-b79a-0b4f8eb1b972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:46.497006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9435fd-41ca-4e3d-b79a-0b4f8eb1b972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:46.497006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9435fd-41ca-4e3d-b79a-0b4f8eb1b972 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:46.516777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1243/2471] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:46.516777 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9435fd-41ca-4e3d-b79a-0b4f8eb1b972 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:46.534804 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9435fd-41ca-4e3d-b79a-0b4f8eb1b972 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:46.540625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253bf8d-614d-4b3d-977b-995c01880e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:46.541250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253bf8d-614d-4b3d-977b-995c01880e2e admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:46.541601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253bf8d-614d-4b3d-977b-995c01880e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:46.541878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253bf8d-614d-4b3d-977b-995c01880e2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:46.542618 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253bf8d-614d-4b3d-977b-995c01880e2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:46.544348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253bf8d-614d-4b3d-977b-995c01880e2e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:46.555910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1244/2472] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:46.556853 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253bf8d-614d-4b3d-977b-995c01880e2e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:46.568154 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253bf8d-614d-4b3d-977b-995c01880e2e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:46.571055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23596e57a58e478599739e62c9d31523'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:46.573644 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b92271-5a09-415e-a928-79038c5e681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:46.574319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b92271-5a09-415e-a928-79038c5e681e admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:46.574607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b92271-5a09-415e-a928-79038c5e681e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:46.574881 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b92271-5a09-415e-a928-79038c5e681e admin admin] PATH_INFO: `/v3/projects/d2bb1cb78c4d4714b33e3a5424c5b31d/users/e562f246791f46848269da72a38a07a4/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:46.576913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b92271-5a09-415e-a928-79038c5e681e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bb1cb78c4d4714b33e3a5424c5b31d, user_id=e562f246791f46848269da72a38a07a4, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:46.579673 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b92271-5a09-415e-a928-79038c5e681e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:46.584142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23596e57a58e478599739e62c9d31523'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:46.597164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1245/2473] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:46 2022] PUT /identity/v3/projects/d2bb1cb78c4d4714b33e3a5424c5b31d/users/e562f246791f46848269da72a38a07a4/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:46.599252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b92271-5a09-415e-a928-79038c5e681e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:46.695060 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b92271-5a09-415e-a928-79038c5e681e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:46.704073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276bedc-b48a-44e8-96be-2c5e721b8135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:46.704842 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276bedc-b48a-44e8-96be-2c5e721b8135 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:46.705171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276bedc-b48a-44e8-96be-2c5e721b8135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:46.705627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276bedc-b48a-44e8-96be-2c5e721b8135 admin admin] PATH_INFO: `/v3/projects/801670dcaf6841e297160b080fd7952a/users/7eec3233b63943828435bd92c820fac1/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:46.710502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23596e57a58e478599739e62c9d31523'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:46.711703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23596e57a58e478599739e62c9d31523'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:46.712751 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23596e57a58e478599739e62c9d31523'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:46.729811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276bedc-b48a-44e8-96be-2c5e721b8135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801670dcaf6841e297160b080fd7952a, user_id=7eec3233b63943828435bd92c820fac1, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:46.737799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1229/2474] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:46 2022] DELETE /identity/v3/users/23596e57a58e478599739e62c9d31523 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:46.738737 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:46.738975 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276bedc-b48a-44e8-96be-2c5e721b8135 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:46.740414 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:46.839253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85c9ca-acfd-4ee6-badb-d1460c7c029d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:46.844911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7ae26-4b79-487d-8c81-e3fd8991b62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:46.845669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7ae26-4b79-487d-8c81-e3fd8991b62e admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:46.845965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7ae26-4b79-487d-8c81-e3fd8991b62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:46.846233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7ae26-4b79-487d-8c81-e3fd8991b62e admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:46.847270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7ae26-4b79-487d-8c81-e3fd8991b62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:46.849429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7ae26-4b79-487d-8c81-e3fd8991b62e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:46.865645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1230/2475] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:46.865645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d83593-2f19-433c-a4e1-377ecdf3728e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:46.865645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d83593-2f19-433c-a4e1-377ecdf3728e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:46.865645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d83593-2f19-433c-a4e1-377ecdf3728e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:46.907849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a6d83593-2f19-433c-a4e1-377ecdf3728e None None] MFA Rules not processed for user `e562f246791f46848269da72a38a07a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:46.909158 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a6d83593-2f19-433c-a4e1-377ecdf3728e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:47.010245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1246/2476] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:46 2022] PUT /identity/v3/projects/801670dcaf6841e297160b080fd7952a/users/7eec3233b63943828435bd92c820fac1/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:47.012043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276bedc-b48a-44e8-96be-2c5e721b8135 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:47.031177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1231/2477] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:47.037355 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d83593-2f19-433c-a4e1-377ecdf3728e None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:47.042655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a6d83593-2f19-433c-a4e1-377ecdf3728e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:47.062718 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d83593-2f19-433c-a4e1-377ecdf3728e None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:47.149446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276bedc-b48a-44e8-96be-2c5e721b8135 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:47.166715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d471e02-2b41-41b0-9ace-20ff53b2f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:47.167846 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d471e02-2b41-41b0-9ace-20ff53b2f9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:47.168235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d471e02-2b41-41b0-9ace-20ff53b2f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:47.168739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d471e02-2b41-41b0-9ace-20ff53b2f9d4 admin admin] PATH_INFO: `/v3/projects/4eb82ee091194b569ec389a0117c3e35/users/a93afe70f22f458591968dca92688745/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:47.198947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d471e02-2b41-41b0-9ace-20ff53b2f9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb82ee091194b569ec389a0117c3e35, user_id=a93afe70f22f458591968dca92688745, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:47.204668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d471e02-2b41-41b0-9ace-20ff53b2f9d4 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:47.206714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:47.209494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:47.210126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:47.210615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] PATH_INFO: `/v3/users/142e7ad7c59c46efb62f934a7058fc02` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:47.212569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=142e7ad7c59c46efb62f934a7058fc02)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:47.215846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:47.383694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1247/2478] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:47 2022] PUT /identity/v3/projects/4eb82ee091194b569ec389a0117c3e35/users/a93afe70f22f458591968dca92688745/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:47.385215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34cdf9-561d-4ab0-a020-f0740df79c6b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:47.385561 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34cdf9-561d-4ab0-a020-f0740df79c6b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:47.385790 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34cdf9-561d-4ab0-a020-f0740df79c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:47.418636 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-4e34cdf9-561d-4ab0-a020-f0740df79c6b None None] MFA Rules not processed for user `7eec3233b63943828435bd92c820fac1`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:47.421730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-4e34cdf9-561d-4ab0-a020-f0740df79c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:47.530346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1248/2479] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:47.531607 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34cdf9-561d-4ab0-a020-f0740df79c6b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:47.532780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-4e34cdf9-561d-4ab0-a020-f0740df79c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:47.579230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142e7ad7c59c46efb62f934a7058fc02'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:47.587226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142e7ad7c59c46efb62f934a7058fc02'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:47.604418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34cdf9-561d-4ab0-a020-f0740df79c6b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:47.610727 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148299b-e9eb-43e8-8443-29d45abb979d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:47.611776 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148299b-e9eb-43e8-8443-29d45abb979d service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:47.612290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148299b-e9eb-43e8-8443-29d45abb979d service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:47.612796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148299b-e9eb-43e8-8443-29d45abb979d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:47.616627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2148299b-e9eb-43e8-8443-29d45abb979d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:47.704524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148299b-e9eb-43e8-8443-29d45abb979d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:47.707321 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148299b-e9eb-43e8-8443-29d45abb979d service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:47.719563 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1249/2480] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:47.721618 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6273b-9021-4af5-b1d4-3e536977bdaa None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:47.722104 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6273b-9021-4af5-b1d4-3e536977bdaa None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:47.722512 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6273b-9021-4af5-b1d4-3e536977bdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:47.755901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-e3e6273b-9021-4af5-b1d4-3e536977bdaa None None] MFA Rules not processed for user `a93afe70f22f458591968dca92688745`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:47.757622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e3e6273b-9021-4af5-b1d4-3e536977bdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:47.770990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142e7ad7c59c46efb62f934a7058fc02'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:47.775159 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142e7ad7c59c46efb62f934a7058fc02'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:47.776060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142e7ad7c59c46efb62f934a7058fc02'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:47.807677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1232/2481] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:47 2022] DELETE /identity/v3/users/142e7ad7c59c46efb62f934a7058fc02 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:47.808965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:47.811705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:47.859657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1250/2482] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:47.860523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6273b-9021-4af5-b1d4-3e536977bdaa None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:47.862674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e3e6273b-9021-4af5-b1d4-3e536977bdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:47.904641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae38174-0d4d-4731-9862-a90a405eab46 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:47.910928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:47.912645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:47.912857 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:47.913107 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] PATH_INFO: `/v3/projects/9463148f963b4253953d4b2655722e21` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:47.914336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9463148f963b4253953d4b2655722e21)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:47.916325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:47.944796 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6273b-9021-4af5-b1d4-3e536977bdaa None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:47.950348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332cb8f-266f-47ae-8e96-2d89a9967157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:47.950937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332cb8f-266f-47ae-8e96-2d89a9967157 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:47.951217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332cb8f-266f-47ae-8e96-2d89a9967157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:47.951493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332cb8f-266f-47ae-8e96-2d89a9967157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:47.952269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332cb8f-266f-47ae-8e96-2d89a9967157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:47.954132 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332cb8f-266f-47ae-8e96-2d89a9967157 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:48.086414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1251/2483] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:47 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:48.087723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41402ae3-3562-46dd-965f-c15111dd59fa None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:48.088016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41402ae3-3562-46dd-965f-c15111dd59fa None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:48.088294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41402ae3-3562-46dd-965f-c15111dd59fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:48.101426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9463148f963b4253953d4b2655722e21', 'request_id': 'req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:48.109511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9463148f963b4253953d4b2655722e21', 'request_id': 'req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:48.121860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-41402ae3-3562-46dd-965f-c15111dd59fa None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:48.123350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-41402ae3-3562-46dd-965f-c15111dd59fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:48.201619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1252/2484] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:48.202420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41402ae3-3562-46dd-965f-c15111dd59fa None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:48.203548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-41402ae3-3562-46dd-965f-c15111dd59fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:48.217528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41402ae3-3562-46dd-965f-c15111dd59fa None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:48.222363 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c9d3a-d5e2-42fc-b794-de8d8ee72d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:48.222987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9d3a-d5e2-42fc-b794-de8d8ee72d31 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:48.223305 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9d3a-d5e2-42fc-b794-de8d8ee72d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:48.224194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9d3a-d5e2-42fc-b794-de8d8ee72d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:48.224997 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c9d3a-d5e2-42fc-b794-de8d8ee72d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:48.227022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c9d3a-d5e2-42fc-b794-de8d8ee72d31 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:48.232831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9463148f963b4253953d4b2655722e21', 'request_id': 'req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:48.252187 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] The token cache is being invalidate because project 9463148f963b4253953d4b2655722e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:48.252742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:48.253216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:48.255395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1233/2485] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:47 2022] DELETE /identity/v3/projects/9463148f963b4253953d4b2655722e21 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:48.258243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:48.263495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:48.339359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ff8ac-dfb3-49b8-b84c-f61f0997e47a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:48.344888 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075304e-e00e-487f-813f-2d4b96a027f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:48.345699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075304e-e00e-487f-813f-2d4b96a027f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:48.345951 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075304e-e00e-487f-813f-2d4b96a027f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:48.346199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075304e-e00e-487f-813f-2d4b96a027f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:48.346763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075304e-e00e-487f-813f-2d4b96a027f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:48.349686 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075304e-e00e-487f-813f-2d4b96a027f4 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:48.390838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:48.398528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1253/2486] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:48 2022] POST /identity/v3/projects => generated 379 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:48.399416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c9d3a-d5e2-42fc-b794-de8d8ee72d31 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:48.401348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7b7c9d3a-d5e2-42fc-b794-de8d8ee72d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:48.476296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c9d3a-d5e2-42fc-b794-de8d8ee72d31 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:48.480173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4dbb8-09cf-4bbc-8b04-f509a012462a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:48.480794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4dbb8-09cf-4bbc-8b04-f509a012462a service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:48.481081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4dbb8-09cf-4bbc-8b04-f509a012462a service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:48.481344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4dbb8-09cf-4bbc-8b04-f509a012462a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:48.483156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e0a4dbb8-09cf-4bbc-8b04-f509a012462a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:48.498905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1234/2487] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:48 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:48.501412 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15d3fd-cb1d-4306-ba0d-6e879fd1fd2b None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:48.502656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15d3fd-cb1d-4306-ba0d-6e879fd1fd2b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:48.503408 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15d3fd-cb1d-4306-ba0d-6e879fd1fd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:48.531136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-2b15d3fd-cb1d-4306-ba0d-6e879fd1fd2b None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:48.532654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2b15d3fd-cb1d-4306-ba0d-6e879fd1fd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:48.560087 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4dbb8-09cf-4bbc-8b04-f509a012462a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:48.563032 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4dbb8-09cf-4bbc-8b04-f509a012462a service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:48.574091 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1254/2488] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:48.574996 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4dbb8-09cf-4bbc-8b04-f509a012462a service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:48.576413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e0a4dbb8-09cf-4bbc-8b04-f509a012462a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:48.598358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4dbb8-09cf-4bbc-8b04-f509a012462a service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:48.604655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005e1c2-c10a-4e08-9b39-2e5d135ecf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:48.605616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005e1c2-c10a-4e08-9b39-2e5d135ecf45 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:48.606058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005e1c2-c10a-4e08-9b39-2e5d135ecf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:48.606390 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005e1c2-c10a-4e08-9b39-2e5d135ecf45 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:48.607354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005e1c2-c10a-4e08-9b39-2e5d135ecf45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:48.617514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005e1c2-c10a-4e08-9b39-2e5d135ecf45 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:48.618471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1235/2489] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:48.619413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15d3fd-cb1d-4306-ba0d-6e879fd1fd2b None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:48.635836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15d3fd-cb1d-4306-ba0d-6e879fd1fd2b None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:48.641279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca48996-ed18-4b93-ba7b-7983cd9074b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:48.641956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca48996-ed18-4b93-ba7b-7983cd9074b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:48.642236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca48996-ed18-4b93-ba7b-7983cd9074b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:48.642512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca48996-ed18-4b93-ba7b-7983cd9074b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:48.643209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca48996-ed18-4b93-ba7b-7983cd9074b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:48.645108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca48996-ed18-4b93-ba7b-7983cd9074b7 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:48.658381 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1236/2490] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:48.665555 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb573b-134d-4105-a106-99b17c1d4350 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:48.665555 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb573b-134d-4105-a106-99b17c1d4350 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:48.665555 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb573b-134d-4105-a106-99b17c1d4350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:48.688183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-93bb573b-134d-4105-a106-99b17c1d4350 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:48.690422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-93bb573b-134d-4105-a106-99b17c1d4350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:48.721031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1237/2491] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:48.729099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1255/2492] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:48 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:48.729960 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005e1c2-c10a-4e08-9b39-2e5d135ecf45 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:48.731379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb573b-134d-4105-a106-99b17c1d4350 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:48.749759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb573b-134d-4105-a106-99b17c1d4350 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:48.752726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005e1c2-c10a-4e08-9b39-2e5d135ecf45 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:48.759625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe69a5-13bf-42c7-8a97-300f14e3f23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:48.760594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe69a5-13bf-42c7-8a97-300f14e3f23f admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:48.761047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe69a5-13bf-42c7-8a97-300f14e3f23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:48.761615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe69a5-13bf-42c7-8a97-300f14e3f23f admin admin] PATH_INFO: `/v3/projects/5dc141e99c014b55853b246e74629280/users/284fe9b694c547c79c647636c119bd79/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:48.763653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8bd51-8909-4b89-8ee9-9df5f4d3a0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:48.764355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8bd51-8909-4b89-8ee9-9df5f4d3a0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:48.764637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8bd51-8909-4b89-8ee9-9df5f4d3a0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:48.764914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8bd51-8909-4b89-8ee9-9df5f4d3a0d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:48.765614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8bd51-8909-4b89-8ee9-9df5f4d3a0d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:48.765924 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8bd51-8909-4b89-8ee9-9df5f4d3a0d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:48.767750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8bd51-8909-4b89-8ee9-9df5f4d3a0d4 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:48.785472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1256/2493] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:48.787159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8bd51-8909-4b89-8ee9-9df5f4d3a0d4 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:48.789773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe69a5-13bf-42c7-8a97-300f14e3f23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc141e99c014b55853b246e74629280, user_id=284fe9b694c547c79c647636c119bd79, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:48.792576 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe69a5-13bf-42c7-8a97-300f14e3f23f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:48.799446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8bd51-8909-4b89-8ee9-9df5f4d3a0d4 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:48.807174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ba86-fb11-4c41-b11b-9d20870613eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:48.808100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ba86-fb11-4c41-b11b-9d20870613eb admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:48.808390 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ba86-fb11-4c41-b11b-9d20870613eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:48.808665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ba86-fb11-4c41-b11b-9d20870613eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:48.809617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94ba86-fb11-4c41-b11b-9d20870613eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:48.811657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94ba86-fb11-4c41-b11b-9d20870613eb admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:48.830388 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1257/2494] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:48.831928 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ba86-fb11-4c41-b11b-9d20870613eb admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:48.851975 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ba86-fb11-4c41-b11b-9d20870613eb admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:48.859840 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd1f82-9d61-4901-bfe8-725be460deb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:48.860952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd1f82-9d61-4901-bfe8-725be460deb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:48.861484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd1f82-9d61-4901-bfe8-725be460deb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:48.861981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd1f82-9d61-4901-bfe8-725be460deb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:48.863156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd1f82-9d61-4901-bfe8-725be460deb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:48.867217 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd1f82-9d61-4901-bfe8-725be460deb2 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:48.938458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1238/2495] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:48 2022] PUT /identity/v3/projects/5dc141e99c014b55853b246e74629280/users/284fe9b694c547c79c647636c119bd79/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:48.939432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe69a5-13bf-42c7-8a97-300f14e3f23f admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:49.063376 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe69a5-13bf-42c7-8a97-300f14e3f23f admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:49.070339 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429af09-6d26-485f-a2bd-1640122a84dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:49.071025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429af09-6d26-485f-a2bd-1640122a84dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:49.071305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429af09-6d26-485f-a2bd-1640122a84dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:49.071579 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429af09-6d26-485f-a2bd-1640122a84dc admin admin] PATH_INFO: `/v3/projects/13de28b76d5b45dbbd38a535b5eee13d/users/fdaf4a4749744599a4a2fcb74d8b5c3d/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:49.091999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429af09-6d26-485f-a2bd-1640122a84dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=13de28b76d5b45dbbd38a535b5eee13d, user_id=fdaf4a4749744599a4a2fcb74d8b5c3d, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:49.094989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c429af09-6d26-485f-a2bd-1640122a84dc admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:49.201336 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1258/2496] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:48 2022] POST /identity/v3/projects => generated 385 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:49.202221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd1f82-9d61-4901-bfe8-725be460deb2 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:49.280682 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1239/2497] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:48 2022] PUT /identity/v3/projects/13de28b76d5b45dbbd38a535b5eee13d/users/fdaf4a4749744599a4a2fcb74d8b5c3d/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:49.282058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429af09-6d26-485f-a2bd-1640122a84dc admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:49.284538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c429af09-6d26-485f-a2bd-1640122a84dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:49.295323 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd1f82-9d61-4901-bfe8-725be460deb2 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:49.401227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40657c-e957-467a-bbbe-fb274b15c5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:49.402218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40657c-e957-467a-bbbe-fb274b15c5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:49.402709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40657c-e957-467a-bbbe-fb274b15c5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:49.403051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40657c-e957-467a-bbbe-fb274b15c5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:49.403795 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40657c-e957-467a-bbbe-fb274b15c5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:49.405611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40657c-e957-467a-bbbe-fb274b15c5c9 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:49.427781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1259/2498] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:49.429159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40657c-e957-467a-bbbe-fb274b15c5c9 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:49.435871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429af09-6d26-485f-a2bd-1640122a84dc admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:49.443335 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:49.444111 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:49.444411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:49.444728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] PATH_INFO: `/v3/users/d32597fa7ca540e3abff57c82886dd1f` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:49.446068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32597fa7ca540e3abff57c82886dd1f)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:49.446704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40657c-e957-467a-bbbe-fb274b15c5c9 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:49.448029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:49.455422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e72f68-8ea2-4018-9778-2658a5d138c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:49.456187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e72f68-8ea2-4018-9778-2658a5d138c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:49.456599 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e72f68-8ea2-4018-9778-2658a5d138c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:49.456955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e72f68-8ea2-4018-9778-2658a5d138c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:49.457751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e72f68-8ea2-4018-9778-2658a5d138c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:49.460343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e72f68-8ea2-4018-9778-2658a5d138c8 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:49.534564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:49.655250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1260/2499] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:49 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:49.656141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e72f68-8ea2-4018-9778-2658a5d138c8 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:49.668208 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e72f68-8ea2-4018-9778-2658a5d138c8 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:49.673563 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3145-417b-44c4-a500-d0cd2a81f866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:49.674190 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3145-417b-44c4-a500-d0cd2a81f866 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:49.674476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3145-417b-44c4-a500-d0cd2a81f866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:49.674759 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e3145-417b-44c4-a500-d0cd2a81f866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:49.675412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e3145-417b-44c4-a500-d0cd2a81f866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:49.678468 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e3145-417b-44c4-a500-d0cd2a81f866 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:49.691173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1261/2500] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:49.692076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3145-417b-44c4-a500-d0cd2a81f866 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:49.694610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-080e3145-417b-44c4-a500-d0cd2a81f866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:49.709483 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e3145-417b-44c4-a500-d0cd2a81f866 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:49.715007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:49.715559 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:49.715815 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:49.716098 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] PATH_INFO: `/v3/projects/c78bf29078b448c69749efcaf615912c` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:49.717477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c78bf29078b448c69749efcaf615912c)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:49.719654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:49.852101 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32597fa7ca540e3abff57c82886dd1f'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:49.860665 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32597fa7ca540e3abff57c82886dd1f'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:49.965478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c78bf29078b448c69749efcaf615912c', 'request_id': 'req-bb7f70b8-99a4-4d5f-9626-649acd9ca979'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:50.101200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32597fa7ca540e3abff57c82886dd1f'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:50.101922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32597fa7ca540e3abff57c82886dd1f'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:50.102548 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32597fa7ca540e3abff57c82886dd1f'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:50.122583 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1240/2501] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:49 2022] DELETE /identity/v3/users/d32597fa7ca540e3abff57c82886dd1f => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:50.123587 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:50.125034 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:50.227852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fd1aa-618d-4596-8ece-66978c269933 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:50.233728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e280f2-6c43-4283-852c-674c5aece9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:50.234655 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e280f2-6c43-4283-852c-674c5aece9be admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:50.235333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e280f2-6c43-4283-852c-674c5aece9be admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:50.235420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e280f2-6c43-4283-852c-674c5aece9be admin admin] PATH_INFO: `/v3/projects/5dc141e99c014b55853b246e74629280/users/284fe9b694c547c79c647636c119bd79/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:50.237410 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e280f2-6c43-4283-852c-674c5aece9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc141e99c014b55853b246e74629280, user_id=284fe9b694c547c79c647636c119bd79, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:50.241051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e280f2-6c43-4283-852c-674c5aece9be admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:50.253159 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1241/2502] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:50 2022] PUT /identity/v3/projects/5dc141e99c014b55853b246e74629280/users/284fe9b694c547c79c647636c119bd79/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:50.259042 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e280f2-6c43-4283-852c-674c5aece9be admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:50.263184 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-01e280f2-6c43-4283-852c-674c5aece9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:50.291329 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c78bf29078b448c69749efcaf615912c', 'request_id': 'req-bb7f70b8-99a4-4d5f-9626-649acd9ca979'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:50.299001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c78bf29078b448c69749efcaf615912c', 'request_id': 'req-bb7f70b8-99a4-4d5f-9626-649acd9ca979'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:50.312055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] The token cache is being invalidate because project c78bf29078b448c69749efcaf615912c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:50.312437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:50.313205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:50.318656 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1262/2503] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:49 2022] DELETE /identity/v3/projects/c78bf29078b448c69749efcaf615912c => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:50.318656 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:50.318656 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:50.345667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e280f2-6c43-4283-852c-674c5aece9be admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:50.351064 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9844d48-527b-4221-9703-d8d53ecfb152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:50.351706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9844d48-527b-4221-9703-d8d53ecfb152 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:50.356115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9844d48-527b-4221-9703-d8d53ecfb152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:50.356115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9844d48-527b-4221-9703-d8d53ecfb152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:50.356115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9844d48-527b-4221-9703-d8d53ecfb152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:50.356115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9844d48-527b-4221-9703-d8d53ecfb152 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:50.366379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1242/2504] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:50.369774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af539ed-ffe8-41b7-8533-f4eb7a9a5572 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:50.369774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af539ed-ffe8-41b7-8533-f4eb7a9a5572 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:50.369774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af539ed-ffe8-41b7-8533-f4eb7a9a5572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:50.392086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-4af539ed-ffe8-41b7-8533-f4eb7a9a5572 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:50.393751 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4af539ed-ffe8-41b7-8533-f4eb7a9a5572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:50.397927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f70b8-99a4-4d5f-9626-649acd9ca979 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:50.403319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a713b67-c07e-46be-8ad1-f545c9b74d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:50.403997 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a713b67-c07e-46be-8ad1-f545c9b74d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:50.404246 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a713b67-c07e-46be-8ad1-f545c9b74d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:50.404518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a713b67-c07e-46be-8ad1-f545c9b74d1c admin admin] PATH_INFO: `/v3/projects/13de28b76d5b45dbbd38a535b5eee13d/users/fdaf4a4749744599a4a2fcb74d8b5c3d/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:50.406214 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1243/2505] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:50.406478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a713b67-c07e-46be-8ad1-f545c9b74d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13de28b76d5b45dbbd38a535b5eee13d, user_id=fdaf4a4749744599a4a2fcb74d8b5c3d, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:50.408780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879aafb-3395-4390-8db9-5bae706eacd5 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:50.409284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879aafb-3395-4390-8db9-5bae706eacd5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:50.409419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a713b67-c07e-46be-8ad1-f545c9b74d1c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:50.409812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879aafb-3395-4390-8db9-5bae706eacd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:50.424156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1263/2506] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:50 2022] PUT /identity/v3/projects/13de28b76d5b45dbbd38a535b5eee13d/users/fdaf4a4749744599a4a2fcb74d8b5c3d/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:50.432387 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a713b67-c07e-46be-8ad1-f545c9b74d1c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:50.432387 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-4a713b67-c07e-46be-8ad1-f545c9b74d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:50.462899 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-f879aafb-3395-4390-8db9-5bae706eacd5 None None] MFA Rules not processed for user `284fe9b694c547c79c647636c119bd79`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:50.464129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f879aafb-3395-4390-8db9-5bae706eacd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:50.510657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a713b67-c07e-46be-8ad1-f545c9b74d1c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:50.523341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:50.524086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:50.524478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:50.524767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] PATH_INFO: `/v3/users/b9ad9c41b2094b5589c3aa8e15a8b32e` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:50.526301 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ad9c41b2094b5589c3aa8e15a8b32e)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:50.529361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:50.562929 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1244/2507] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:50.563715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879aafb-3395-4390-8db9-5bae706eacd5 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:50.565033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f879aafb-3395-4390-8db9-5bae706eacd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:50.580211 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879aafb-3395-4390-8db9-5bae706eacd5 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:50.590319 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf58715-f040-4e63-8893-9f20cfd78eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:50.590968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf58715-f040-4e63-8893-9f20cfd78eff admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:50.591242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf58715-f040-4e63-8893-9f20cfd78eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:50.591513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf58715-f040-4e63-8893-9f20cfd78eff admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:50.592176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf58715-f040-4e63-8893-9f20cfd78eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:50.593801 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf58715-f040-4e63-8893-9f20cfd78eff admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:50.606247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1245/2508] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:50.607755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf58715-f040-4e63-8893-9f20cfd78eff admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:50.609148 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bdf58715-f040-4e63-8893-9f20cfd78eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:50.711596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf58715-f040-4e63-8893-9f20cfd78eff admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:50.711596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785ebe7-f9ae-434f-9285-c3af862485c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:50.711596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785ebe7-f9ae-434f-9285-c3af862485c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:50.711596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785ebe7-f9ae-434f-9285-c3af862485c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:50.712182 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785ebe7-f9ae-434f-9285-c3af862485c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:50.721126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785ebe7-f9ae-434f-9285-c3af862485c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:50.723216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785ebe7-f9ae-434f-9285-c3af862485c0 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:50.736011 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1246/2509] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:50.737146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09e33-a7d0-43da-950c-b222d64e4775 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:50.737538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09e33-a7d0-43da-950c-b222d64e4775 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:50.737823 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d09e33-a7d0-43da-950c-b222d64e4775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:50.779239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-57d09e33-a7d0-43da-950c-b222d64e4775 None None] MFA Rules not processed for user `fdaf4a4749744599a4a2fcb74d8b5c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:50.780642 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-57d09e33-a7d0-43da-950c-b222d64e4775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:50.893155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1247/2510] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:50.894116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09e33-a7d0-43da-950c-b222d64e4775 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:50.903068 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ad9c41b2094b5589c3aa8e15a8b32e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:50.910741 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d09e33-a7d0-43da-950c-b222d64e4775 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:50.916870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9669e-4e71-46d7-ba86-48f4882b5dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:50.917738 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9669e-4e71-46d7-ba86-48f4882b5dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:50.918084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9669e-4e71-46d7-ba86-48f4882b5dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:50.918444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9669e-4e71-46d7-ba86-48f4882b5dfb admin admin] PATH_INFO: `/v3/projects/4cb9fa68d3d744b7bcf5d65cbaa3a0e7/users/a053b16d5d87414793a4a25f746363ec/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:50.919569 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ad9c41b2094b5589c3aa8e15a8b32e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:50.930869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ad9c41b2094b5589c3aa8e15a8b32e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:50.944451 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9669e-4e71-46d7-ba86-48f4882b5dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb9fa68d3d744b7bcf5d65cbaa3a0e7, user_id=a053b16d5d87414793a4a25f746363ec, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:50.947219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff9669e-4e71-46d7-ba86-48f4882b5dfb admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:51.113927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ad9c41b2094b5589c3aa8e15a8b32e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:51.115998 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ad9c41b2094b5589c3aa8e15a8b32e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:51.134912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1264/2511] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:50 2022] DELETE /identity/v3/users/b9ad9c41b2094b5589c3aa8e15a8b32e => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:51.134912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:51.134912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:51.172150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1248/2512] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:50 2022] PUT /identity/v3/projects/4cb9fa68d3d744b7bcf5d65cbaa3a0e7/users/a053b16d5d87414793a4a25f746363ec/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:51.188940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0e51-6cbc-4cc0-b7ab-c73393648f81 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:51.189322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0e51-6cbc-4cc0-b7ab-c73393648f81 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:51.190286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0e51-6cbc-4cc0-b7ab-c73393648f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:51.221205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec6bb1-94de-4b32-b4f6-058e2db7fa7c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:51.237662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-257c0e51-6cbc-4cc0-b7ab-c73393648f81 None None] MFA Rules not processed for user `a053b16d5d87414793a4a25f746363ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:51.238965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-257c0e51-6cbc-4cc0-b7ab-c73393648f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:51.299557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d61f96-e58b-4f8b-81d7-a93fb1cb004e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:51.301265 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d61f96-e58b-4f8b-81d7-a93fb1cb004e service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:51.301501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d61f96-e58b-4f8b-81d7-a93fb1cb004e service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:51.301691 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d61f96-e58b-4f8b-81d7-a93fb1cb004e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:51.304144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-78d61f96-e58b-4f8b-81d7-a93fb1cb004e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:51.335108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1249/2513] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:51.382940 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d61f96-e58b-4f8b-81d7-a93fb1cb004e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:51.384407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d61f96-e58b-4f8b-81d7-a93fb1cb004e service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:51.394729 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1265/2514] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:51.496917 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c0e51-6cbc-4cc0-b7ab-c73393648f81 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:51.499311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-257c0e51-6cbc-4cc0-b7ab-c73393648f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:51.546429 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d61f96-e58b-4f8b-81d7-a93fb1cb004e service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:51.556653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d61f96-e58b-4f8b-81d7-a93fb1cb004e service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:51.560938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1a186-d5d1-4c79-ace4-990618fd8906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:51.561600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1a186-d5d1-4c79-ace4-990618fd8906 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:51.562056 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1a186-d5d1-4c79-ace4-990618fd8906 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:51.562488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1a186-d5d1-4c79-ace4-990618fd8906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:51.564992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-78e1a186-d5d1-4c79-ace4-990618fd8906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:51.630323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c0e51-6cbc-4cc0-b7ab-c73393648f81 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:51.635396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:51.635396 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:51.635849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:51.635849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] PATH_INFO: `/v3/projects/3ec5133575a440a2baec54f6d2771885` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:51.637142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec5133575a440a2baec54f6d2771885)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:51.638957 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:51.652413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1a186-d5d1-4c79-ace4-990618fd8906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:51.654269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1a186-d5d1-4c79-ace4-990618fd8906 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:51.665752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1266/2515] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:44:51.773733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1a186-d5d1-4c79-ace4-990618fd8906 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:51.784440 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-78e1a186-d5d1-4c79-ace4-990618fd8906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:51.811741 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1a186-d5d1-4c79-ace4-990618fd8906 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:51.827446 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec5133575a440a2baec54f6d2771885', 'request_id': 'req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:51.836602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec5133575a440a2baec54f6d2771885', 'request_id': 'req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:51.907389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:51.908179 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:51.908535 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:51.908820 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] PATH_INFO: `/v3/projects/5ff8ba193dad416880661db6e9a93125` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:51.910083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ff8ba193dad416880661db6e9a93125)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:51.912742 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:51.947289 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec5133575a440a2baec54f6d2771885', 'request_id': 'req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:51.962687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] The token cache is being invalidate because project 3ec5133575a440a2baec54f6d2771885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:51.963106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:51.976908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:51.976908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1250/2516] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:51 2022] DELETE /identity/v3/projects/3ec5133575a440a2baec54f6d2771885 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:51.976908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:51.976908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:52.039419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ddce3-d855-4932-bdf6-74bb2e3ef2fe admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:52.043941 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c5988-bcf2-4955-81ae-8a2c10b066eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:52.044691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c5988-bcf2-4955-81ae-8a2c10b066eb service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:52.045065 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c5988-bcf2-4955-81ae-8a2c10b066eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:52.045479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c5988-bcf2-4955-81ae-8a2c10b066eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:52.047645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a10c5988-bcf2-4955-81ae-8a2c10b066eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:52.097161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff8ba193dad416880661db6e9a93125', 'request_id': 'req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.115183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c5988-bcf2-4955-81ae-8a2c10b066eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:52.116787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c5988-bcf2-4955-81ae-8a2c10b066eb service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:52.127559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1251/2517] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:52.128896 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c5988-bcf2-4955-81ae-8a2c10b066eb service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:52.130660 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a10c5988-bcf2-4955-81ae-8a2c10b066eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:52.145538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c5988-bcf2-4955-81ae-8a2c10b066eb service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:52.219361 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:52.220010 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:52.220290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:52.220563 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] PATH_INFO: `/v3/users/dcf7475ca52a4bd4b71065d717210ee7` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:52.221783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcf7475ca52a4bd4b71065d717210ee7)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:52.224494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:52.279654 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff8ba193dad416880661db6e9a93125', 'request_id': 'req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.288323 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff8ba193dad416880661db6e9a93125', 'request_id': 'req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.303146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] The token cache is being invalidate because project 5ff8ba193dad416880661db6e9a93125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:52.303866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.304573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.307397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1267/2518] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:51 2022] DELETE /identity/v3/projects/5ff8ba193dad416880661db6e9a93125 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:44:52.312119 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:52.313721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:52.326906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c0920-fea4-41bb-aad1-a4dec9bec7ef admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:52.331651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a05e1-2d0a-40ae-98e6-3df32c29e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:52.332296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a05e1-2d0a-40ae-98e6-3df32c29e808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:52.332564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a05e1-2d0a-40ae-98e6-3df32c29e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:52.333503 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a05e1-2d0a-40ae-98e6-3df32c29e808 admin admin] PATH_INFO: `/v3/users/a053b16d5d87414793a4a25f746363ec` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:52.335055 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a05e1-2d0a-40ae-98e6-3df32c29e808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a053b16d5d87414793a4a25f746363ec)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:52.336996 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a05e1-2d0a-40ae-98e6-3df32c29e808 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:52.491534 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcf7475ca52a4bd4b71065d717210ee7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.499026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcf7475ca52a4bd4b71065d717210ee7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.656595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcf7475ca52a4bd4b71065d717210ee7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.657629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcf7475ca52a4bd4b71065d717210ee7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.658353 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcf7475ca52a4bd4b71065d717210ee7'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.690205 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1252/2519] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:52 2022] DELETE /identity/v3/users/dcf7475ca52a4bd4b71065d717210ee7 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:52.690414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6a0a05e1-2d0a-40ae-98e6-3df32c29e808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a053b16d5d87414793a4a25f746363ec'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.690505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:52.695740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:52.734564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6a0a05e1-2d0a-40ae-98e6-3df32c29e808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a053b16d5d87414793a4a25f746363ec'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.753761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6a0a05e1-2d0a-40ae-98e6-3df32c29e808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a053b16d5d87414793a4a25f746363ec'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:52.812522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ab040-94d4-4013-a8e5-cc35a38c98a2 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:52.821498 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:52.822283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:52.822767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:52.822973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] PATH_INFO: `/v3/users/b608f0bf2eec4ce5b668706d078ddba6` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:52.824365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b608f0bf2eec4ce5b668706d078ddba6)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:52.827035 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:53.304612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6a0a05e1-2d0a-40ae-98e6-3df32c29e808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a053b16d5d87414793a4a25f746363ec'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:53.306491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6a0a05e1-2d0a-40ae-98e6-3df32c29e808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a053b16d5d87414793a4a25f746363ec'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:53.327177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1268/2520] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:52 2022] DELETE /identity/v3/users/a053b16d5d87414793a4a25f746363ec => generated 0 bytes in 1019 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:53.336235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bec74b-1d82-4771-be36-cc4cc46373d9 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:53.337139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bec74b-1d82-4771-be36-cc4cc46373d9 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:53.337730 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bec74b-1d82-4771-be36-cc4cc46373d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:53.372690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-39bec74b-1d82-4771-be36-cc4cc46373d9 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:53.374641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-39bec74b-1d82-4771-be36-cc4cc46373d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:53.470983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1269/2521] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:53.476394 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:53.484065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bec74b-1d82-4771-be36-cc4cc46373d9 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:53.486557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-39bec74b-1d82-4771-be36-cc4cc46373d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:53.573999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bec74b-1d82-4771-be36-cc4cc46373d9 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:53.578090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7cd15-742c-4d04-bc01-0a12dd08cd15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:53.578708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7cd15-742c-4d04-bc01-0a12dd08cd15 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:53.578992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7cd15-742c-4d04-bc01-0a12dd08cd15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:53.585747 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7cd15-742c-4d04-bc01-0a12dd08cd15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:53.589060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b608f0bf2eec4ce5b668706d078ddba6'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:53.589911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7cd15-742c-4d04-bc01-0a12dd08cd15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:53.591853 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7cd15-742c-4d04-bc01-0a12dd08cd15 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:53.597123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b608f0bf2eec4ce5b668706d078ddba6'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:53.603438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1270/2522] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:53.625888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7cd15-742c-4d04-bc01-0a12dd08cd15 service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:53.631225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3ed7cd15-742c-4d04-bc01-0a12dd08cd15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:53.671078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7cd15-742c-4d04-bc01-0a12dd08cd15 service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:53.671078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:53.671078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:53.671078 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:53.671812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] PATH_INFO: `/v3/projects/96572f1fb8dc41e992fea169faa8b76e` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:53.671812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=96572f1fb8dc41e992fea169faa8b76e)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:53.671812 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:53.820428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b608f0bf2eec4ce5b668706d078ddba6'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:53.821170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b608f0bf2eec4ce5b668706d078ddba6'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:53.821831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b608f0bf2eec4ce5b668706d078ddba6'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:53.842568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1253/2523] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:52 2022] DELETE /identity/v3/users/b608f0bf2eec4ce5b668706d078ddba6 => generated 0 bytes in 1154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:53.843684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:53.845070 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:53.913110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a1419-6dcb-4676-81cb-8a6e0d8f5bad admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:53.924236 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96572f1fb8dc41e992fea169faa8b76e', 'request_id': 'req-6dc23b30-60ee-4be1-b592-a526ca48f4bf'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:53.971259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8b919-433a-4909-99ed-aedee50bf3b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:53.971896 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b919-433a-4909-99ed-aedee50bf3b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:53.972188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b919-433a-4909-99ed-aedee50bf3b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:53.972891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8b919-433a-4909-99ed-aedee50bf3b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:53.974957 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-63d8b919-433a-4909-99ed-aedee50bf3b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:54.037065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96572f1fb8dc41e992fea169faa8b76e', 'request_id': 'req-6dc23b30-60ee-4be1-b592-a526ca48f4bf'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.044855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96572f1fb8dc41e992fea169faa8b76e', 'request_id': 'req-6dc23b30-60ee-4be1-b592-a526ca48f4bf'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.057939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8b919-433a-4909-99ed-aedee50bf3b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:54.059176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] The token cache is being invalidate because project 96572f1fb8dc41e992fea169faa8b76e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:54.059476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.060167 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.060656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8b919-433a-4909-99ed-aedee50bf3b1 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:54.062335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1271/2524] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:53 2022] DELETE /identity/v3/projects/96572f1fb8dc41e992fea169faa8b76e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:54.066589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:54.069114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:54.074206 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1254/2525] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:54.155233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc23b30-60ee-4be1-b592-a526ca48f4bf admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:54.160047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:54.160681 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:54.161258 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:54.162080 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] PATH_INFO: `/v3/users/1e02c6e9aa7c4088b4bb4213f2831677` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:54.166066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e02c6e9aa7c4088b4bb4213f2831677)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:54.168386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:54.171134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8b919-433a-4909-99ed-aedee50bf3b1 service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:54.173833 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-63d8b919-433a-4909-99ed-aedee50bf3b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:54.195955 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8b919-433a-4909-99ed-aedee50bf3b1 service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:54.201702 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:54.202353 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:54.202640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:54.202917 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] PATH_INFO: `/v3/users/de71969d631948b3bf1710d86c00b57c` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:54.204125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de71969d631948b3bf1710d86c00b57c)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:54.206316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:54.631487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e02c6e9aa7c4088b4bb4213f2831677'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.633025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:54.645405 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de71969d631948b3bf1710d86c00b57c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.651003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e02c6e9aa7c4088b4bb4213f2831677'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.660567 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e02c6e9aa7c4088b4bb4213f2831677'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.671007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de71969d631948b3bf1710d86c00b57c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.759491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e02c6e9aa7c4088b4bb4213f2831677'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.760226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e02c6e9aa7c4088b4bb4213f2831677'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.767508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1272/2526] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:54 2022] DELETE /identity/v3/users/1e02c6e9aa7c4088b4bb4213f2831677 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:44:54.774587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:54.774587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:54.860715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de71969d631948b3bf1710d86c00b57c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.862636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de71969d631948b3bf1710d86c00b57c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.863525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de71969d631948b3bf1710d86c00b57c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:54.890683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1255/2527] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:54 2022] DELETE /identity/v3/users/de71969d631948b3bf1710d86c00b57c => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:54.891964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:54.893158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b3b06b-a326-454d-9877-85314aafa576 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:54.898718 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:54.965215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:54.965878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:54.966233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:54.966514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a admin admin] PATH_INFO: `/v3/projects/4cb9fa68d3d744b7bcf5d65cbaa3a0e7` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:54.967716 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb9fa68d3d744b7bcf5d65cbaa3a0e7)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:54.969740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:54.975913 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862e9cb-d2f6-4e61-946e-f585430d38c5 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:54.980895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aec2e8-b869-4146-8793-f0a8f225f91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:54.981747 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aec2e8-b869-4146-8793-f0a8f225f91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:54.982029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aec2e8-b869-4146-8793-f0a8f225f91c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:54.982301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aec2e8-b869-4146-8793-f0a8f225f91c admin admin] PATH_INFO: `/v3/projects/7a5013100ae245a9a79edba26f56c54f` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:54.983524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aec2e8-b869-4146-8793-f0a8f225f91c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a5013100ae245a9a79edba26f56c54f)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:54.985511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aec2e8-b869-4146-8793-f0a8f225f91c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:55.163306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb9fa68d3d744b7bcf5d65cbaa3a0e7', 'request_id': 'req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:55.234359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e2aec2e8-b869-4146-8793-f0a8f225f91c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a5013100ae245a9a79edba26f56c54f', 'request_id': 'req-e2aec2e8-b869-4146-8793-f0a8f225f91c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:55.244956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e2aec2e8-b869-4146-8793-f0a8f225f91c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a5013100ae245a9a79edba26f56c54f', 'request_id': 'req-e2aec2e8-b869-4146-8793-f0a8f225f91c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:55.348027 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb9fa68d3d744b7bcf5d65cbaa3a0e7', 'request_id': 'req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:55.355717 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb9fa68d3d744b7bcf5d65cbaa3a0e7', 'request_id': 'req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:55.369503 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a admin admin] The token cache is being invalidate because project 4cb9fa68d3d744b7bcf5d65cbaa3a0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:55.369768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:55.370380 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-fd5ff845-c5e5-48fc-a877-5a3a273c0c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:55.371957 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1273/2528] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:54 2022] DELETE /identity/v3/projects/4cb9fa68d3d744b7bcf5d65cbaa3a0e7 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:55.373195 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3042b-3efd-4912-b2d9-8618744ebfa9 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:55.373510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3042b-3efd-4912-b2d9-8618744ebfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:55.373783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3042b-3efd-4912-b2d9-8618744ebfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:55.403903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-19e3042b-3efd-4912-b2d9-8618744ebfa9 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:55.406179 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-19e3042b-3efd-4912-b2d9-8618744ebfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:55.429071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e2aec2e8-b869-4146-8793-f0a8f225f91c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a5013100ae245a9a79edba26f56c54f', 'request_id': 'req-e2aec2e8-b869-4146-8793-f0a8f225f91c'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:55.444742 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e2aec2e8-b869-4146-8793-f0a8f225f91c admin admin] The token cache is being invalidate because project 7a5013100ae245a9a79edba26f56c54f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:55.445323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e2aec2e8-b869-4146-8793-f0a8f225f91c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:55.447127 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e2aec2e8-b869-4146-8793-f0a8f225f91c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:55.449162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1256/2529] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:54 2022] DELETE /identity/v3/projects/7a5013100ae245a9a79edba26f56c54f => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:55.451122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168cf06-df62-4f45-8055-bb6a1d83c02a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:55.451545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168cf06-df62-4f45-8055-bb6a1d83c02a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:55.451893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168cf06-df62-4f45-8055-bb6a1d83c02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:55.488818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-1168cf06-df62-4f45-8055-bb6a1d83c02a None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:55.489940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1168cf06-df62-4f45-8055-bb6a1d83c02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:55.531574 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1274/2530] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:55.533361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3042b-3efd-4912-b2d9-8618744ebfa9 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:55.536521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-19e3042b-3efd-4912-b2d9-8618744ebfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:55.555705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3042b-3efd-4912-b2d9-8618744ebfa9 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:55.563808 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:55.564965 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:55.565594 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:55.566174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] PATH_INFO: `/v3/projects/db8189ea6b464647ab0d28f2cb1ea3b2` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:55.568651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8189ea6b464647ab0d28f2cb1ea3b2)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:55.572954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:55.596043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1257/2531] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:55.598246 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf91e7-945b-408a-8b62-a1155acd32c0 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:55.600420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf91e7-945b-408a-8b62-a1155acd32c0 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:55.601042 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf91e7-945b-408a-8b62-a1155acd32c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:55.628023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-55cf91e7-945b-408a-8b62-a1155acd32c0 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:55.629834 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-55cf91e7-945b-408a-8b62-a1155acd32c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:55.639517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1258/2532] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:55.640475 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf91e7-945b-408a-8b62-a1155acd32c0 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:55.641930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-55cf91e7-945b-408a-8b62-a1155acd32c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:55.705662 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf91e7-945b-408a-8b62-a1155acd32c0 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:55.709903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4665883-6ac3-45fa-a5fa-d2814a15b148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:55.710523 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4665883-6ac3-45fa-a5fa-d2814a15b148 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:55.710805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4665883-6ac3-45fa-a5fa-d2814a15b148 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:55.711079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4665883-6ac3-45fa-a5fa-d2814a15b148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:55.721181 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4665883-6ac3-45fa-a5fa-d2814a15b148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:55.722692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4665883-6ac3-45fa-a5fa-d2814a15b148 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:55.734440 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1259/2533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:55.735748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f405b06-fac5-4b33-9108-3d01eba6bcbf None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:55.736039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f405b06-fac5-4b33-9108-3d01eba6bcbf None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:55.736388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f405b06-fac5-4b33-9108-3d01eba6bcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:55.757862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-0f405b06-fac5-4b33-9108-3d01eba6bcbf None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:55.759553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0f405b06-fac5-4b33-9108-3d01eba6bcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:55.767887 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1260/2534] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:55.769314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bcf0d-6b47-466b-b0ef-2652b600915e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:55.769694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bcf0d-6b47-466b-b0ef-2652b600915e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:55.770031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63bcf0d-6b47-466b-b0ef-2652b600915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:55.792453 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-f63bcf0d-6b47-466b-b0ef-2652b600915e None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:55.793964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-f63bcf0d-6b47-466b-b0ef-2652b600915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:55.826365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1261/2535] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:55.826365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bcf0d-6b47-466b-b0ef-2652b600915e None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:55.835401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8189ea6b464647ab0d28f2cb1ea3b2', 'request_id': 'req-3af6567c-3bff-4133-8dca-6d7cff01bfa9'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:55.850607 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63bcf0d-6b47-466b-b0ef-2652b600915e None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:55.945962 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace415f-0410-46ce-9b3f-e72a8388a9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:55.946724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace415f-0410-46ce-9b3f-e72a8388a9ea admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:55.947248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace415f-0410-46ce-9b3f-e72a8388a9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:55.947681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace415f-0410-46ce-9b3f-e72a8388a9ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:55.948454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace415f-0410-46ce-9b3f-e72a8388a9ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:55.948905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace415f-0410-46ce-9b3f-e72a8388a9ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:55.951171 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace415f-0410-46ce-9b3f-e72a8388a9ea admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:55.966600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1262/2536] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:55.967602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace415f-0410-46ce-9b3f-e72a8388a9ea admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:55.982283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace415f-0410-46ce-9b3f-e72a8388a9ea admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:55.987631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984cf98-e1e2-4045-9933-77b056d3f3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:55.988269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984cf98-e1e2-4045-9933-77b056d3f3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:55.988553 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984cf98-e1e2-4045-9933-77b056d3f3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:55.988838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984cf98-e1e2-4045-9933-77b056d3f3a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:55.990428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984cf98-e1e2-4045-9933-77b056d3f3a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:55.990894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984cf98-e1e2-4045-9933-77b056d3f3a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:55.992582 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984cf98-e1e2-4045-9933-77b056d3f3a2 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:55.999747 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8189ea6b464647ab0d28f2cb1ea3b2', 'request_id': 'req-3af6567c-3bff-4133-8dca-6d7cff01bfa9'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:56.009219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1263/2537] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:56.009521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8189ea6b464647ab0d28f2cb1ea3b2', 'request_id': 'req-3af6567c-3bff-4133-8dca-6d7cff01bfa9'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:56.020454 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984cf98-e1e2-4045-9933-77b056d3f3a2 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:56.024086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984cf98-e1e2-4045-9933-77b056d3f3a2 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:56.026386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] The token cache is being invalidate because project db8189ea6b464647ab0d28f2cb1ea3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:56.026875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:56.027658 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:56.029452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1275/2538] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:55 2022] DELETE /identity/v3/projects/db8189ea6b464647ab0d28f2cb1ea3b2 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:56.030170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:56.030728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42f4c8-6437-4897-9686-179ce3f4ca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:56.031774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42f4c8-6437-4897-9686-179ce3f4ca8e admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:56.032020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:56.032133 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42f4c8-6437-4897-9686-179ce3f4ca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:56.032336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42f4c8-6437-4897-9686-179ce3f4ca8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:56.032947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42f4c8-6437-4897-9686-179ce3f4ca8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:56.034938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42f4c8-6437-4897-9686-179ce3f4ca8e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:56.046115 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6567c-3bff-4133-8dca-6d7cff01bfa9 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:56.055703 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135cc39-412e-41af-b59b-9ce19c2064da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:56.057094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135cc39-412e-41af-b59b-9ce19c2064da admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:56.057637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135cc39-412e-41af-b59b-9ce19c2064da admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:56.058071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135cc39-412e-41af-b59b-9ce19c2064da admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:56.058832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135cc39-412e-41af-b59b-9ce19c2064da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:56.068412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135cc39-412e-41af-b59b-9ce19c2064da admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:56.252912 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1276/2539] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:56 2022] POST /identity/v3/projects => generated 389 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:56.257115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1264/2540] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:56 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:56.257115 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42f4c8-6437-4897-9686-179ce3f4ca8e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:56.258156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20c762-da23-42ff-8cca-4cfc0dd2fb8c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:56.258156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20c762-da23-42ff-8cca-4cfc0dd2fb8c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:56.258156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20c762-da23-42ff-8cca-4cfc0dd2fb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:56.261137 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5f42f4c8-6437-4897-9686-179ce3f4ca8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:56.282207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-1f20c762-da23-42ff-8cca-4cfc0dd2fb8c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:56.283455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1f20c762-da23-42ff-8cca-4cfc0dd2fb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:56.330693 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42f4c8-6437-4897-9686-179ce3f4ca8e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:56.357032 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1277/2541] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:56.358047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20c762-da23-42ff-8cca-4cfc0dd2fb8c None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:56.359675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1f20c762-da23-42ff-8cca-4cfc0dd2fb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:56.373122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20c762-da23-42ff-8cca-4cfc0dd2fb8c None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:56.378229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf842e-33fb-4c67-8b42-fbb120b5bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:56.378856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf842e-33fb-4c67-8b42-fbb120b5bf2e admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:56.379142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf842e-33fb-4c67-8b42-fbb120b5bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:56.379584 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf842e-33fb-4c67-8b42-fbb120b5bf2e admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:56.380417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf842e-33fb-4c67-8b42-fbb120b5bf2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:56.382581 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf842e-33fb-4c67-8b42-fbb120b5bf2e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:56.450511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e5264-a3c1-49aa-81f7-89a0af993b2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:56.450511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e5264-a3c1-49aa-81f7-89a0af993b2b service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:56.450511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e5264-a3c1-49aa-81f7-89a0af993b2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:56.450511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e5264-a3c1-49aa-81f7-89a0af993b2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:56.451462 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d17e5264-a3c1-49aa-81f7-89a0af993b2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:56.483920 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e5264-a3c1-49aa-81f7-89a0af993b2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:56.486386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e5264-a3c1-49aa-81f7-89a0af993b2b service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:56.502504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1265/2542] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:56.503908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e5264-a3c1-49aa-81f7-89a0af993b2b service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:56.521062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e5264-a3c1-49aa-81f7-89a0af993b2b service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:56.528934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806ea86-f54a-483d-9648-b1283625a736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:56.529859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806ea86-f54a-483d-9648-b1283625a736 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:56.530284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806ea86-f54a-483d-9648-b1283625a736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:56.530877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806ea86-f54a-483d-9648-b1283625a736 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:56.531830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806ea86-f54a-483d-9648-b1283625a736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:56.535217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806ea86-f54a-483d-9648-b1283625a736 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:56.553331 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1278/2543] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:56 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:56.555686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602f954-4feb-48d5-b523-4a607352a7d4 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:56.556221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602f954-4feb-48d5-b523-4a607352a7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:56.557344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602f954-4feb-48d5-b523-4a607352a7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:56.579683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-2602f954-4feb-48d5-b523-4a607352a7d4 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:56.580999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2602f954-4feb-48d5-b523-4a607352a7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:56.590171 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1279/2544] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:56.591257 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602f954-4feb-48d5-b523-4a607352a7d4 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:56.593020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2602f954-4feb-48d5-b523-4a607352a7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:56.613822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602f954-4feb-48d5-b523-4a607352a7d4 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:56.622874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:56.623528 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:56.623822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:56.624122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] PATH_INFO: `/v3/projects/251d81631e7b480180a3a6462c5160c2` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:56.625361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=251d81631e7b480180a3a6462c5160c2)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:56.627501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:56.689995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1266/2545] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:56 2022] POST /identity/v3/users => generated 295 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:56.691072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806ea86-f54a-483d-9648-b1283625a736 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:56.704041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806ea86-f54a-483d-9648-b1283625a736 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:56.718272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaecb98-cf02-4742-aa7b-64c32e821309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:56.719387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaecb98-cf02-4742-aa7b-64c32e821309 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:56.719892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaecb98-cf02-4742-aa7b-64c32e821309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:56.720287 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaecb98-cf02-4742-aa7b-64c32e821309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:56.720970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaecb98-cf02-4742-aa7b-64c32e821309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:56.745733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaecb98-cf02-4742-aa7b-64c32e821309 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:56.745733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1267/2546] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:56.745733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaecb98-cf02-4742-aa7b-64c32e821309 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:56.752559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaecb98-cf02-4742-aa7b-64c32e821309 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:56.758873 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae54aa-107c-4a8e-a7eb-9f528bf3ccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:56.759679 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae54aa-107c-4a8e-a7eb-9f528bf3ccd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:56.760132 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae54aa-107c-4a8e-a7eb-9f528bf3ccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:56.760594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae54aa-107c-4a8e-a7eb-9f528bf3ccd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:56.761934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae54aa-107c-4a8e-a7eb-9f528bf3ccd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:56.762437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae54aa-107c-4a8e-a7eb-9f528bf3ccd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:56.764089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae54aa-107c-4a8e-a7eb-9f528bf3ccd0 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:56.778390 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1268/2547] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:44:56.779283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae54aa-107c-4a8e-a7eb-9f528bf3ccd0 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:56.790443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae54aa-107c-4a8e-a7eb-9f528bf3ccd0 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:56.795873 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182b91-2441-465a-a6e8-2e88913151a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:56.802668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182b91-2441-465a-a6e8-2e88913151a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:56.802668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182b91-2441-465a-a6e8-2e88913151a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:56.802668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a182b91-2441-465a-a6e8-2e88913151a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:56.802668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a182b91-2441-465a-a6e8-2e88913151a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:56.802668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a182b91-2441-465a-a6e8-2e88913151a5 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:56.824551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1269/2548] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:56.824551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182b91-2441-465a-a6e8-2e88913151a5 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:56.827793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1a182b91-2441-465a-a6e8-2e88913151a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:56.847001 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a182b91-2441-465a-a6e8-2e88913151a5 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:56.866524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '251d81631e7b480180a3a6462c5160c2', 'request_id': 'req-c56fd931-a52e-4e2a-b245-53ea77d377c1'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:56.871017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:56.921153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:56.922251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:56.922644 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:56.923027 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] PATH_INFO: `/v3/users/7eec3233b63943828435bd92c820fac1` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:56.924422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eec3233b63943828435bd92c820fac1)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:56.928720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:56.957427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '251d81631e7b480180a3a6462c5160c2', 'request_id': 'req-c56fd931-a52e-4e2a-b245-53ea77d377c1'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:56.964750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '251d81631e7b480180a3a6462c5160c2', 'request_id': 'req-c56fd931-a52e-4e2a-b245-53ea77d377c1'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:56.977707 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] The token cache is being invalidate because project 251d81631e7b480180a3a6462c5160c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:56.978011 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:56.978866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:56.985296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1280/2549] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:56 2022] DELETE /identity/v3/projects/251d81631e7b480180a3a6462c5160c2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:56.985296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:56.986593 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:57.002145 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fd931-a52e-4e2a-b245-53ea77d377c1 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:57.008543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc08db-5dd9-4046-9759-f9fac27a609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:57.009332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc08db-5dd9-4046-9759-f9fac27a609d admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:57.009711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc08db-5dd9-4046-9759-f9fac27a609d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:57.009948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc08db-5dd9-4046-9759-f9fac27a609d admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:57.010613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc08db-5dd9-4046-9759-f9fac27a609d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:57.012489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc08db-5dd9-4046-9759-f9fac27a609d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:57.025054 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1281/2550] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:57.026058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc08db-5dd9-4046-9759-f9fac27a609d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:57.028445 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-4acc08db-5dd9-4046-9759-f9fac27a609d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:57.043403 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc08db-5dd9-4046-9759-f9fac27a609d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:57.049570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5a487-f7a6-4250-beb3-c5bbf47e017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:57.050384 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5a487-f7a6-4250-beb3-c5bbf47e017d admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:57.050775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5a487-f7a6-4250-beb3-c5bbf47e017d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:57.051130 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5a487-f7a6-4250-beb3-c5bbf47e017d admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:57.051848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5a487-f7a6-4250-beb3-c5bbf47e017d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:57.054601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5a487-f7a6-4250-beb3-c5bbf47e017d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:57.219521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1282/2551] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:57 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:57.219521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5a487-f7a6-4250-beb3-c5bbf47e017d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:57.219521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-60f5a487-f7a6-4250-beb3-c5bbf47e017d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:57.223592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eec3233b63943828435bd92c820fac1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:57.234233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eec3233b63943828435bd92c820fac1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:57.316284 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5a487-f7a6-4250-beb3-c5bbf47e017d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:57.323665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8955d-ebc3-41b0-8e35-70d0a9c92e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:57.324807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8955d-ebc3-41b0-8e35-70d0a9c92e20 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:57.324807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8955d-ebc3-41b0-8e35-70d0a9c92e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:57.324993 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8955d-ebc3-41b0-8e35-70d0a9c92e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:57.325513 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8955d-ebc3-41b0-8e35-70d0a9c92e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:57.327445 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8955d-ebc3-41b0-8e35-70d0a9c92e20 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:57.338245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1283/2552] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:57.339137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8955d-ebc3-41b0-8e35-70d0a9c92e20 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:57.340974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8ce8955d-ebc3-41b0-8e35-70d0a9c92e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:57.355496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8955d-ebc3-41b0-8e35-70d0a9c92e20 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:57.360788 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:57.361476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:57.361762 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:57.368571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] PATH_INFO: `/v3/users/9d98f21dffbb45d2a6dc2f67d18dfced` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:57.368571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d98f21dffbb45d2a6dc2f67d18dfced)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:57.368571 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:57.397624 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eec3233b63943828435bd92c820fac1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:57.398253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eec3233b63943828435bd92c820fac1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:57.398883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eec3233b63943828435bd92c820fac1'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:57.424749 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1270/2553] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:56 2022] DELETE /identity/v3/users/7eec3233b63943828435bd92c820fac1 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:57.425613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:57.427724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:57.514140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41b7ce-daaa-4bcd-b351-8ef3788a87db admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:57.520891 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a6303-977e-472c-a18c-d47b929ac16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:57.521835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6303-977e-472c-a18c-d47b929ac16c admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:57.522163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6303-977e-472c-a18c-d47b929ac16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:57.522659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a6303-977e-472c-a18c-d47b929ac16c admin admin] PATH_INFO: `/v3/projects/81955c219a284b8cbd089d46d099ce27/users/d6742115bbfd498a8910708d77f9f35e/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:57.540349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a6303-977e-472c-a18c-d47b929ac16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=81955c219a284b8cbd089d46d099ce27, user_id=d6742115bbfd498a8910708d77f9f35e, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:57.543339 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a6303-977e-472c-a18c-d47b929ac16c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:57.569350 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:44:57.618222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d98f21dffbb45d2a6dc2f67d18dfced'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:57.633930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d98f21dffbb45d2a6dc2f67d18dfced'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:57.641927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d98f21dffbb45d2a6dc2f67d18dfced'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:57.661363 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1271/2554] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:57 2022] PUT /identity/v3/projects/81955c219a284b8cbd089d46d099ce27/users/d6742115bbfd498a8910708d77f9f35e/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:57.662645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a6303-977e-472c-a18c-d47b929ac16c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:57.672134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-960a6303-977e-472c-a18c-d47b929ac16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:57.728892 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d98f21dffbb45d2a6dc2f67d18dfced'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:57.729868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d98f21dffbb45d2a6dc2f67d18dfced'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:57.738239 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1284/2555] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:44:57 2022] DELETE /identity/v3/users/9d98f21dffbb45d2a6dc2f67d18dfced => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:57.740164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:57.742320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:57.745213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a6303-977e-472c-a18c-d47b929ac16c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:57.840573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd263154-450d-41e9-838a-9997922cbebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:57.841219 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd263154-450d-41e9-838a-9997922cbebb service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:57.841546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd263154-450d-41e9-838a-9997922cbebb service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:57.841826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd263154-450d-41e9-838a-9997922cbebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:57.845615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fd263154-450d-41e9-838a-9997922cbebb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:57.936920 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd263154-450d-41e9-838a-9997922cbebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:57.938437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd263154-450d-41e9-838a-9997922cbebb service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:57.949702 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1272/2556] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:57.950614 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd263154-450d-41e9-838a-9997922cbebb service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:57.952097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fd263154-450d-41e9-838a-9997922cbebb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:57.976253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76398d78-331d-495e-a6c5-d10ac854c7cc admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:57.983427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99532fc2-0b25-468c-8250-f13fb0f988de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:57.984056 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99532fc2-0b25-468c-8250-f13fb0f988de admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:57.984382 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99532fc2-0b25-468c-8250-f13fb0f988de admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:57.984663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99532fc2-0b25-468c-8250-f13fb0f988de admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:57.985309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99532fc2-0b25-468c-8250-f13fb0f988de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:57.987358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99532fc2-0b25-468c-8250-f13fb0f988de admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:58.063374 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd263154-450d-41e9-838a-9997922cbebb service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:58.077990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27b8c7-9d27-4156-92e6-5150fcf895ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:58.077990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b8c7-9d27-4156-92e6-5150fcf895ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:58.077990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b8c7-9d27-4156-92e6-5150fcf895ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:58.077990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27b8c7-9d27-4156-92e6-5150fcf895ce admin admin] PATH_INFO: `/v3/projects/ce3f0dca006f49caa2a9ce381af91aad/users/c7ceeb2df265458eacb09e98b684ab07/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:58.171051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1285/2557] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:44:57 2022] POST /identity/v3/users => generated 287 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:44:58.172867 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941c23-ca64-4ec8-8d90-39b7c69d6f22 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:58.173248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941c23-ca64-4ec8-8d90-39b7c69d6f22 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:58.173648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d941c23-ca64-4ec8-8d90-39b7c69d6f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:58.197701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5d941c23-ca64-4ec8-8d90-39b7c69d6f22 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:58.199196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5d941c23-ca64-4ec8-8d90-39b7c69d6f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:58.211272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1286/2558] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:58.211272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56199e-9b5f-4c87-9b68-741563503f2a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:58.211272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56199e-9b5f-4c87-9b68-741563503f2a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:58.211272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56199e-9b5f-4c87-9b68-741563503f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:58.220037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27b8c7-9d27-4156-92e6-5150fcf895ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3f0dca006f49caa2a9ce381af91aad, user_id=c7ceeb2df265458eacb09e98b684ab07, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:58.223036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27b8c7-9d27-4156-92e6-5150fcf895ce admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:58.253781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-fd56199e-9b5f-4c87-9b68-741563503f2a None None] MFA Rules not processed for user `d6742115bbfd498a8910708d77f9f35e`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:58.255667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-fd56199e-9b5f-4c87-9b68-741563503f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:58.355579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1287/2559] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:58.357051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56199e-9b5f-4c87-9b68-741563503f2a None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:58.371470 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56199e-9b5f-4c87-9b68-741563503f2a None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:58.378185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276999d3-4c2f-4a17-9182-4bd7c6c42372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:58.379262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276999d3-4c2f-4a17-9182-4bd7c6c42372 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:58.380216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276999d3-4c2f-4a17-9182-4bd7c6c42372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:58.380662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276999d3-4c2f-4a17-9182-4bd7c6c42372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:58.381454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276999d3-4c2f-4a17-9182-4bd7c6c42372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:58.385350 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276999d3-4c2f-4a17-9182-4bd7c6c42372 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:58.400902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1288/2560] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:58.402668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276999d3-4c2f-4a17-9182-4bd7c6c42372 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:58.404340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-276999d3-4c2f-4a17-9182-4bd7c6c42372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:58.476012 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276999d3-4c2f-4a17-9182-4bd7c6c42372 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:58.480050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9025afd-86b6-4213-865a-80077da221f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:58.480793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9025afd-86b6-4213-865a-80077da221f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:58.481073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9025afd-86b6-4213-865a-80077da221f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:58.481583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9025afd-86b6-4213-865a-80077da221f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:58.495146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9025afd-86b6-4213-865a-80077da221f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:58.497108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9025afd-86b6-4213-865a-80077da221f4 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:58.510455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1289/2561] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:58.511957 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9025afd-86b6-4213-865a-80077da221f4 service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:58.513779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f9025afd-86b6-4213-865a-80077da221f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:58.621745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9025afd-86b6-4213-865a-80077da221f4 service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:58.625999 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700449b1-4aec-44cf-9a7b-4593e78a1a79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c596e424ab8e4637bae1721488c9fcc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:58.626685 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700449b1-4aec-44cf-9a7b-4593e78a1a79 service glance] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:58.626968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700449b1-4aec-44cf-9a7b-4593e78a1a79 service glance] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:58.627269 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700449b1-4aec-44cf-9a7b-4593e78a1a79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:58.638721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700449b1-4aec-44cf-9a7b-4593e78a1a79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:58.640222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700449b1-4aec-44cf-9a7b-4593e78a1a79 service glance] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:58.650833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1290/2562] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:44:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:44:58.652039 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700449b1-4aec-44cf-9a7b-4593e78a1a79 service glance] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:58.662612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700449b1-4aec-44cf-9a7b-4593e78a1a79 service glance] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:58.668017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2a993-d1d5-4f37-9bb0-5ff53dd96b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:58.668942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2a993-d1d5-4f37-9bb0-5ff53dd96b10 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:58.669189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2a993-d1d5-4f37-9bb0-5ff53dd96b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:58.671612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2a993-d1d5-4f37-9bb0-5ff53dd96b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:58.671612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2a993-d1d5-4f37-9bb0-5ff53dd96b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:58.672116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2a993-d1d5-4f37-9bb0-5ff53dd96b10 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:58.684972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1291/2563] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:44:58.688864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2a993-d1d5-4f37-9bb0-5ff53dd96b10 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:58.700238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2a993-d1d5-4f37-9bb0-5ff53dd96b10 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:58.706830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e344db44-f1e8-49ed-91c5-04aa1aa056fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:58.709635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344db44-f1e8-49ed-91c5-04aa1aa056fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:58.710054 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344db44-f1e8-49ed-91c5-04aa1aa056fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:58.710765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e344db44-f1e8-49ed-91c5-04aa1aa056fa admin admin] PATH_INFO: `/v3/projects/f553e5a48edb464cb5228ec471acd41e/users/8f12d4f6b56446c0bef78b3b292abe45/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:58.738929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344db44-f1e8-49ed-91c5-04aa1aa056fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f553e5a48edb464cb5228ec471acd41e, user_id=8f12d4f6b56446c0bef78b3b292abe45, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:58.743256 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e344db44-f1e8-49ed-91c5-04aa1aa056fa admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:59.035031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1273/2564] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:57 2022] PUT /identity/v3/projects/ce3f0dca006f49caa2a9ce381af91aad/users/c7ceeb2df265458eacb09e98b684ab07/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 1085 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:59.036071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27b8c7-9d27-4156-92e6-5150fcf895ce admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:59.038706 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5a27b8c7-9d27-4156-92e6-5150fcf895ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:59.046062 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1292/2565] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:44:58 2022] PUT /identity/v3/projects/f553e5a48edb464cb5228ec471acd41e/users/8f12d4f6b56446c0bef78b3b292abe45/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:44:59.055756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422637-03fe-4ca6-8da8-1cd12b378769 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:59.056903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422637-03fe-4ca6-8da8-1cd12b378769 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:59.057921 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422637-03fe-4ca6-8da8-1cd12b378769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:59.097032 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c8422637-03fe-4ca6-8da8-1cd12b378769 None None] MFA Rules not processed for user `c7ceeb2df265458eacb09e98b684ab07`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:59.097032 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c8422637-03fe-4ca6-8da8-1cd12b378769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:59.178520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27b8c7-9d27-4156-92e6-5150fcf895ce admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:59.213339 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1293/2566] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:59.214670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e822c5-56a6-4849-aa60-64bd733f74b3 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:59.214936 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e822c5-56a6-4849-aa60-64bd733f74b3 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:59.215215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e822c5-56a6-4849-aa60-64bd733f74b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:59.249590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:59.250243 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:59.250521 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:59.250930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] PATH_INFO: `/v3/projects/65d0d83e9fa545108092a1cd51ef965a` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:59.251081 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-f5e822c5-56a6-4849-aa60-64bd733f74b3 None None] MFA Rules not processed for user `8f12d4f6b56446c0bef78b3b292abe45`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:59.252319 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=65d0d83e9fa545108092a1cd51ef965a)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:59.252744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f5e822c5-56a6-4849-aa60-64bd733f74b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:59.254828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:59.327196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1294/2567] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:59.535483 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65d0d83e9fa545108092a1cd51ef965a', 'request_id': 'req-aac88c47-b1eb-4c58-a484-050625d042ec'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:59.543282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65d0d83e9fa545108092a1cd51ef965a', 'request_id': 'req-aac88c47-b1eb-4c58-a484-050625d042ec'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:59.645584 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65d0d83e9fa545108092a1cd51ef965a', 'request_id': 'req-aac88c47-b1eb-4c58-a484-050625d042ec'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:59.660136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] The token cache is being invalidate because project 65d0d83e9fa545108092a1cd51ef965a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:44:59.660430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:59.661707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:44:59.663422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1274/2568] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:59 2022] DELETE /identity/v3/projects/65d0d83e9fa545108092a1cd51ef965a => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:44:59.668902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f46cbb-8909-4378-a147-deb769577878 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:59.669310 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f46cbb-8909-4378-a147-deb769577878 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:59.669783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f46cbb-8909-4378-a147-deb769577878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:59.689734 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-54f46cbb-8909-4378-a147-deb769577878 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:59.691021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-54f46cbb-8909-4378-a147-deb769577878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:59.718707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:59.720264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:59.763859 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1295/2569] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:59.771630 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7651451-5690-495b-aefd-904415d12dcc None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:59.772022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7651451-5690-495b-aefd-904415d12dcc None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:59.772401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7651451-5690-495b-aefd-904415d12dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:59.802941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c7651451-5690-495b-aefd-904415d12dcc None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:44:59.804180 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c7651451-5690-495b-aefd-904415d12dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:44:59.811974 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac88c47-b1eb-4c58-a484-050625d042ec admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:59.812798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1296/2570] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:44:59.817150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7651451-5690-495b-aefd-904415d12dcc None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:59.818417 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:59.819083 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:59.819519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:59.819797 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] PATH_INFO: `/v3/projects/801670dcaf6841e297160b080fd7952a` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:59.821022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=801670dcaf6841e297160b080fd7952a)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:59.823011 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:59.828965 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7651451-5690-495b-aefd-904415d12dcc None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:59.837791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b80831-e4e3-4fb0-8c2e-1dbdd51d74cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:59.837791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b80831-e4e3-4fb0-8c2e-1dbdd51d74cb admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:59.838197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b80831-e4e3-4fb0-8c2e-1dbdd51d74cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:59.838543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b80831-e4e3-4fb0-8c2e-1dbdd51d74cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:59.839327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b80831-e4e3-4fb0-8c2e-1dbdd51d74cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:44:59.839832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b80831-e4e3-4fb0-8c2e-1dbdd51d74cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:59.842578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b80831-e4e3-4fb0-8c2e-1dbdd51d74cb admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:59.861438 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1297/2571] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:44:59.866401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b80831-e4e3-4fb0-8c2e-1dbdd51d74cb admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:44:59.886741 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b80831-e4e3-4fb0-8c2e-1dbdd51d74cb admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:44:59.893799 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0a9cd-ee56-443d-898e-7e6452fae915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:44:59.896811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0a9cd-ee56-443d-898e-7e6452fae915 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:44:59.897252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0a9cd-ee56-443d-898e-7e6452fae915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:44:59.897622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0a9cd-ee56-443d-898e-7e6452fae915 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:44:59.906961 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0a9cd-ee56-443d-898e-7e6452fae915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:44:59.909020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0a9cd-ee56-443d-898e-7e6452fae915 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:44:59.993987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801670dcaf6841e297160b080fd7952a', 'request_id': 'req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:00.006126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801670dcaf6841e297160b080fd7952a', 'request_id': 'req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:00.014925 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1298/2572] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:44:59 2022] POST /identity/v3/projects => generated 399 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:45:00.016290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0a9cd-ee56-443d-898e-7e6452fae915 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:00.022372 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e2c0a9cd-ee56-443d-898e-7e6452fae915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:00.096000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0a9cd-ee56-443d-898e-7e6452fae915 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:00.101674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c48bf2-6ffa-46a4-9c73-5d32e65f5a69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:00.102296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c48bf2-6ffa-46a4-9c73-5d32e65f5a69 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:00.102579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c48bf2-6ffa-46a4-9c73-5d32e65f5a69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:00.102854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c48bf2-6ffa-46a4-9c73-5d32e65f5a69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:00.104626 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-17c48bf2-6ffa-46a4-9c73-5d32e65f5a69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:00.111315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801670dcaf6841e297160b080fd7952a', 'request_id': 'req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:00.124218 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] The token cache is being invalidate because project 801670dcaf6841e297160b080fd7952a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:00.132438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:00.132438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:00.132438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1275/2573] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:44:59 2022] DELETE /identity/v3/projects/801670dcaf6841e297160b080fd7952a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:00.132438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:00.132438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:00.188517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c48bf2-6ffa-46a4-9c73-5d32e65f5a69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:00.191424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c48bf2-6ffa-46a4-9c73-5d32e65f5a69 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:00.206870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c92fcb-bfb4-4610-aee4-11572f8c1f9e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:00.209738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1299/2574] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:45:00.220001 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c48bf2-6ffa-46a4-9c73-5d32e65f5a69 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:00.307165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7b557-28b7-4487-9b24-bf12b30bd635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:00.307791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7b557-28b7-4487-9b24-bf12b30bd635 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:00.308077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7b557-28b7-4487-9b24-bf12b30bd635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:00.308372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7b557-28b7-4487-9b24-bf12b30bd635 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:00.308998 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7b557-28b7-4487-9b24-bf12b30bd635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:00.311016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7b557-28b7-4487-9b24-bf12b30bd635 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:00.317886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c48bf2-6ffa-46a4-9c73-5d32e65f5a69 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:00.325356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:00.326695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:00.326905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:00.327354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] PATH_INFO: `/v3/users/284fe9b694c547c79c647636c119bd79` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:00.329181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] RBAC: Authorizing `identity:delete_user(user_id=284fe9b694c547c79c647636c119bd79)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:00.332341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:00.506500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1276/2575] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:45:00 2022] POST /identity/v3/users => generated 300 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:45:00.510966 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7b557-28b7-4487-9b24-bf12b30bd635 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:00.521582 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7b557-28b7-4487-9b24-bf12b30bd635 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:00.526380 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b295a2-fbbb-4600-beb6-42a598528397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:00.526988 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b295a2-fbbb-4600-beb6-42a598528397 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:00.527269 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b295a2-fbbb-4600-beb6-42a598528397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:00.527542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b295a2-fbbb-4600-beb6-42a598528397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:00.528188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b295a2-fbbb-4600-beb6-42a598528397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:00.529867 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b295a2-fbbb-4600-beb6-42a598528397 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:00.544687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1277/2576] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:45:00.546161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b295a2-fbbb-4600-beb6-42a598528397 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:00.566479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b295a2-fbbb-4600-beb6-42a598528397 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:00.573601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec48ce8-8203-4379-9fc7-0a87bba2b830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:00.574259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec48ce8-8203-4379-9fc7-0a87bba2b830 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:00.574577 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec48ce8-8203-4379-9fc7-0a87bba2b830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:00.574907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec48ce8-8203-4379-9fc7-0a87bba2b830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:00.575576 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec48ce8-8203-4379-9fc7-0a87bba2b830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:00.577326 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec48ce8-8203-4379-9fc7-0a87bba2b830 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:00.589478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1278/2577] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:45:00.590356 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec48ce8-8203-4379-9fc7-0a87bba2b830 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:00.592351 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-dec48ce8-8203-4379-9fc7-0a87bba2b830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:00.607001 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec48ce8-8203-4379-9fc7-0a87bba2b830 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:00.610925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f8f7d-aad7-48a1-973e-e677e3b58a3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:00.611595 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f8f7d-aad7-48a1-973e-e677e3b58a3b service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:00.611756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f8f7d-aad7-48a1-973e-e677e3b58a3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:00.612033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f8f7d-aad7-48a1-973e-e677e3b58a3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:00.614467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2c9f8f7d-aad7-48a1-973e-e677e3b58a3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:00.653211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284fe9b694c547c79c647636c119bd79'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:00.671018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284fe9b694c547c79c647636c119bd79'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:00.680050 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:00.684411 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284fe9b694c547c79c647636c119bd79'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:00.695249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f8f7d-aad7-48a1-973e-e677e3b58a3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:00.696714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f8f7d-aad7-48a1-973e-e677e3b58a3b service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:00.707289 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1279/2578] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:45:00.708234 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f8f7d-aad7-48a1-973e-e677e3b58a3b service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:00.721770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f8f7d-aad7-48a1-973e-e677e3b58a3b service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:00.737582 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96a900-c070-4ed6-88b0-e1d2eabb0a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:00.738323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96a900-c070-4ed6-88b0-e1d2eabb0a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:00.738884 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96a900-c070-4ed6-88b0-e1d2eabb0a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:00.740100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96a900-c070-4ed6-88b0-e1d2eabb0a64 admin admin] PATH_INFO: `/v3/projects/1371d8ff3dd14cd58fe6faca0db8c4dc/users/5bc6bca5dee944f4b1a039e71437340d/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:00.794952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96a900-c070-4ed6-88b0-e1d2eabb0a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1371d8ff3dd14cd58fe6faca0db8c4dc, user_id=5bc6bca5dee944f4b1a039e71437340d, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:00.798299 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96a900-c070-4ed6-88b0-e1d2eabb0a64 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:00.861084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284fe9b694c547c79c647636c119bd79'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:00.862414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284fe9b694c547c79c647636c119bd79'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:00.876172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1300/2579] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:45:00 2022] DELETE /identity/v3/users/284fe9b694c547c79c647636c119bd79 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:00.876172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:00.876172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:00.983375 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a1dd5-45b9-4de4-b96e-a56e1dfb063c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:00.988507 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:00.989922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:00.990737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:00.991233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] PATH_INFO: `/v3/users/8f12d4f6b56446c0bef78b3b292abe45` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:01.002677 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f12d4f6b56446c0bef78b3b292abe45)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:01.005648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:01.034663 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1280/2580] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:45:00 2022] PUT /identity/v3/projects/1371d8ff3dd14cd58fe6faca0db8c4dc/users/5bc6bca5dee944f4b1a039e71437340d/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:01.035509 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4b9ed-c64c-4790-a9bd-2223237fdb38 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:01.036421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4b9ed-c64c-4790-a9bd-2223237fdb38 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:01.036817 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4b9ed-c64c-4790-a9bd-2223237fdb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:01.110654 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-1bf4b9ed-c64c-4790-a9bd-2223237fdb38 None None] MFA Rules not processed for user `eb75c0fb10484f3d80813962a4283b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:01.114868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1bf4b9ed-c64c-4790-a9bd-2223237fdb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:01.237020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1281/2581] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:45:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:01.239634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae215c-559d-4ef0-a98f-ca907ea4b0d0 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:01.240122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae215c-559d-4ef0-a98f-ca907ea4b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:01.240673 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae215c-559d-4ef0-a98f-ca907ea4b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:01.281288 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-fcae215c-559d-4ef0-a98f-ca907ea4b0d0 None None] MFA Rules not processed for user `5bc6bca5dee944f4b1a039e71437340d`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:01.283601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fcae215c-559d-4ef0-a98f-ca907ea4b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:01.367814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f12d4f6b56446c0bef78b3b292abe45'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:01.384669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f12d4f6b56446c0bef78b3b292abe45'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:01.393817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f12d4f6b56446c0bef78b3b292abe45'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:01.474320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:01.481726 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1282/2582] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:01.482707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae215c-559d-4ef0-a98f-ca907ea4b0d0 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:01.484145 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fcae215c-559d-4ef0-a98f-ca907ea4b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:01.553842 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f12d4f6b56446c0bef78b3b292abe45'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:01.554583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f12d4f6b56446c0bef78b3b292abe45'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:01.564381 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1301/2583] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:45:00 2022] DELETE /identity/v3/users/8f12d4f6b56446c0bef78b3b292abe45 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:01.565241 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:01.566872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:01.570988 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae215c-559d-4ef0-a98f-ca907ea4b0d0 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:01.648944 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecdaae-6eb3-465f-8ba5-3053d456c538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:01.649869 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecdaae-6eb3-465f-8ba5-3053d456c538 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:01.650324 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecdaae-6eb3-465f-8ba5-3053d456c538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:01.650893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecdaae-6eb3-465f-8ba5-3053d456c538 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:01.651755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecdaae-6eb3-465f-8ba5-3053d456c538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:01.654051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aecdaae-6eb3-465f-8ba5-3053d456c538 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:01.664595 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dfed4-dc14-4acf-99f8-fd5e8205d19d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:01.669187 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc0922-1aac-441c-8d89-5e3bbcc08bbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:01.670278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc0922-1aac-441c-8d89-5e3bbcc08bbe service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:01.670562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc0922-1aac-441c-8d89-5e3bbcc08bbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:01.670839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc0922-1aac-441c-8d89-5e3bbcc08bbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:01.673058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-27cc0922-1aac-441c-8d89-5e3bbcc08bbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:01.744118 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc0922-1aac-441c-8d89-5e3bbcc08bbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:01.745599 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc0922-1aac-441c-8d89-5e3bbcc08bbe service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:01.764083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1302/2584] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:45:01.764083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc0922-1aac-441c-8d89-5e3bbcc08bbe service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:01.764083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-27cc0922-1aac-441c-8d89-5e3bbcc08bbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:01.772585 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc0922-1aac-441c-8d89-5e3bbcc08bbe service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:01.777475 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:01.778146 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:01.778433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:01.778707 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] PATH_INFO: `/v3/projects/5dc141e99c014b55853b246e74629280` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:01.779871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc141e99c014b55853b246e74629280)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:01.781905 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:01.815118 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1283/2585] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:45:01 2022] POST /identity/v3/projects => generated 401 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:45:01.820960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8e15-79b4-4db6-977d-632222e82cca None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:01.820960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8e15-79b4-4db6-977d-632222e82cca None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:01.820960 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8e15-79b4-4db6-977d-632222e82cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:01.840343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-3d4b8e15-79b4-4db6-977d-632222e82cca None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:01.841623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3d4b8e15-79b4-4db6-977d-632222e82cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:01.911418 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1284/2586] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:01.914303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38d5d3-d970-4cfb-9b6c-5f61f0a1eeca None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:01.915290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38d5d3-d970-4cfb-9b6c-5f61f0a1eeca None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:01.915476 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38d5d3-d970-4cfb-9b6c-5f61f0a1eeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:01.945236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-9a38d5d3-d970-4cfb-9b6c-5f61f0a1eeca None None] MFA Rules not processed for user `eb75c0fb10484f3d80813962a4283b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:01.946506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9a38d5d3-d970-4cfb-9b6c-5f61f0a1eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:01.984456 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc141e99c014b55853b246e74629280', 'request_id': 'req-3614371a-7776-4df1-86e9-612ca58ac1f2'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:02.021109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1285/2587] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:45:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:02.022769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38d5d3-d970-4cfb-9b6c-5f61f0a1eeca None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:02.026963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-9a38d5d3-d970-4cfb-9b6c-5f61f0a1eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:02.170892 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38d5d3-d970-4cfb-9b6c-5f61f0a1eeca None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:02.179307 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef67f08-47dc-4d7a-aaf0-bbac4f2e38d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a0d07b79212443480c87f4a4ff3ca00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:02.179946 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef67f08-47dc-4d7a-aaf0-bbac4f2e38d6 service swift] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:02.180336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef67f08-47dc-4d7a-aaf0-bbac4f2e38d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:02.180652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef67f08-47dc-4d7a-aaf0-bbac4f2e38d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:02.183224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0ef67f08-47dc-4d7a-aaf0-bbac4f2e38d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:02.186904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc141e99c014b55853b246e74629280', 'request_id': 'req-3614371a-7776-4df1-86e9-612ca58ac1f2'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:02.200163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc141e99c014b55853b246e74629280', 'request_id': 'req-3614371a-7776-4df1-86e9-612ca58ac1f2'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:02.212729 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef67f08-47dc-4d7a-aaf0-bbac4f2e38d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:02.221739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef67f08-47dc-4d7a-aaf0-bbac4f2e38d6 service swift] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:02.221838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] The token cache is being invalidate because project 5dc141e99c014b55853b246e74629280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:02.221838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:02.221838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:02.226122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1303/2588] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:45:01 2022] DELETE /identity/v3/projects/5dc141e99c014b55853b246e74629280 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:02.226122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:02.226562 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:02.248849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1286/2589] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Sep 1 05:45:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:45:02.250628 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef67f08-47dc-4d7a-aaf0-bbac4f2e38d6 service swift] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:02.253760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0ef67f08-47dc-4d7a-aaf0-bbac4f2e38d6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:02.341851 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef67f08-47dc-4d7a-aaf0-bbac4f2e38d6 service swift] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:02.345619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614371a-7776-4df1-86e9-612ca58ac1f2 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:02.348792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94a744-62ac-48ea-803e-ba5246e4dbea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:02.350131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94a744-62ac-48ea-803e-ba5246e4dbea service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:02.350619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94a744-62ac-48ea-803e-ba5246e4dbea service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:02.351123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94a744-62ac-48ea-803e-ba5246e4dbea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:02.352163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe11cfb-5c6b-4843-9a21-52b120ae5480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:02.352856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11cfb-5c6b-4843-9a21-52b120ae5480 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:02.353137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11cfb-5c6b-4843-9a21-52b120ae5480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:02.353529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11cfb-5c6b-4843-9a21-52b120ae5480 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:02.354274 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8c94a744-62ac-48ea-803e-ba5246e4dbea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:02.355404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe11cfb-5c6b-4843-9a21-52b120ae5480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:02.357889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe11cfb-5c6b-4843-9a21-52b120ae5480 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:02.375907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94a744-62ac-48ea-803e-ba5246e4dbea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:02.378776 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94a744-62ac-48ea-803e-ba5246e4dbea service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:02.398076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1287/2590] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:45:02.399617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94a744-62ac-48ea-803e-ba5246e4dbea service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:02.401893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8c94a744-62ac-48ea-803e-ba5246e4dbea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:02.430704 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94a744-62ac-48ea-803e-ba5246e4dbea service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:02.441007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594e1db-5f90-4507-a660-b43541f4cc76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a0d07b79212443480c87f4a4ff3ca00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:02.441692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594e1db-5f90-4507-a660-b43541f4cc76 service swift] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:02.443525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594e1db-5f90-4507-a660-b43541f4cc76 service swift] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:02.443847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594e1db-5f90-4507-a660-b43541f4cc76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:02.446290 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d594e1db-5f90-4507-a660-b43541f4cc76 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:02.465320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594e1db-5f90-4507-a660-b43541f4cc76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:02.473239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594e1db-5f90-4507-a660-b43541f4cc76 service swift] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:02.479150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1288/2591] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Sep 1 05:45:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:45:02.480258 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaab431-e9b1-44f0-9037-b02071c2de02 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:02.480612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaab431-e9b1-44f0-9037-b02071c2de02 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:02.480779 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaab431-e9b1-44f0-9037-b02071c2de02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:02.512767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-aaaab431-e9b1-44f0-9037-b02071c2de02 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:02.514314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-aaaab431-e9b1-44f0-9037-b02071c2de02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:02.537877 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1304/2592] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:45:02 2022] POST /identity/v3/users => generated 307 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:45:02.540690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fff8c4-43dc-45eb-99c6-942c9e444b9c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:02.540690 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fff8c4-43dc-45eb-99c6-942c9e444b9c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:02.540941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fff8c4-43dc-45eb-99c6-942c9e444b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:02.544191 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1289/2593] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:02.545912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaab431-e9b1-44f0-9037-b02071c2de02 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:02.561316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaab431-e9b1-44f0-9037-b02071c2de02 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:02.570294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e695a7-c690-4e74-b76d-0ce168a17981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:02.571328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e695a7-c690-4e74-b76d-0ce168a17981 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:02.571807 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e695a7-c690-4e74-b76d-0ce168a17981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:02.572194 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e695a7-c690-4e74-b76d-0ce168a17981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:02.583740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e695a7-c690-4e74-b76d-0ce168a17981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:02.588057 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e695a7-c690-4e74-b76d-0ce168a17981 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:02.604716 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1290/2594] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:45:02.612342 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e695a7-c690-4e74-b76d-0ce168a17981 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:02.620017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-a3fff8c4-43dc-45eb-99c6-942c9e444b9c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:02.625962 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a3fff8c4-43dc-45eb-99c6-942c9e444b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:02.651256 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e695a7-c690-4e74-b76d-0ce168a17981 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:02.664968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1305/2595] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:45:02.666251 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1887a48-42b7-4f07-86de-b585bf51a5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:02.671077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1887a48-42b7-4f07-86de-b585bf51a5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:02.671077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1887a48-42b7-4f07-86de-b585bf51a5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:02.671077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1887a48-42b7-4f07-86de-b585bf51a5a9 admin admin] PATH_INFO: `/v3/projects/96008971375e4cfb9bc353ee4fb2043e/users/d1a83436bb5d4ab88d9fe1647d70d02c/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:02.674043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fff8c4-43dc-45eb-99c6-942c9e444b9c None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:02.691680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fff8c4-43dc-45eb-99c6-942c9e444b9c None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:02.704193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12716c5b-35da-44f8-8b11-1af8b20b9228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:02.705093 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12716c5b-35da-44f8-8b11-1af8b20b9228 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:02.705406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12716c5b-35da-44f8-8b11-1af8b20b9228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:02.713787 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12716c5b-35da-44f8-8b11-1af8b20b9228 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:02.715521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12716c5b-35da-44f8-8b11-1af8b20b9228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:45:02.716130 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12716c5b-35da-44f8-8b11-1af8b20b9228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:02.718500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1887a48-42b7-4f07-86de-b585bf51a5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96008971375e4cfb9bc353ee4fb2043e, user_id=d1a83436bb5d4ab88d9fe1647d70d02c, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:02.718801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12716c5b-35da-44f8-8b11-1af8b20b9228 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:02.725907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1887a48-42b7-4f07-86de-b585bf51a5a9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:02.744539 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1306/2596] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:45:02.750037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12716c5b-35da-44f8-8b11-1af8b20b9228 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:02.766393 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12716c5b-35da-44f8-8b11-1af8b20b9228 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:02.771744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae5e67-322c-4463-9a8f-a3cde6d4ba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:02.772517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae5e67-322c-4463-9a8f-a3cde6d4ba8e admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:02.778622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae5e67-322c-4463-9a8f-a3cde6d4ba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:02.778622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae5e67-322c-4463-9a8f-a3cde6d4ba8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:02.778622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae5e67-322c-4463-9a8f-a3cde6d4ba8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:02.778622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae5e67-322c-4463-9a8f-a3cde6d4ba8e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:02.871905 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1291/2597] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:45:02 2022] PUT /identity/v3/projects/96008971375e4cfb9bc353ee4fb2043e/users/d1a83436bb5d4ab88d9fe1647d70d02c/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:02.886329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1887a48-42b7-4f07-86de-b585bf51a5a9 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:02.982309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1307/2598] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:45:02 2022] POST /identity/v3/projects => generated 371 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:45:02.987267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae5e67-322c-4463-9a8f-a3cde6d4ba8e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:03.005667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1887a48-42b7-4f07-86de-b585bf51a5a9 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:03.128573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9780a7-d7fc-4065-b221-7c6655a1abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:03.131522 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae5e67-322c-4463-9a8f-a3cde6d4ba8e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:03.132758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9780a7-d7fc-4065-b221-7c6655a1abe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.133255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9780a7-d7fc-4065-b221-7c6655a1abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.134020 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9780a7-d7fc-4065-b221-7c6655a1abe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.135532 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9780a7-d7fc-4065-b221-7c6655a1abe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:03.138688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9780a7-d7fc-4065-b221-7c6655a1abe9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:03.144542 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91f4d-7e46-4344-868d-693716bfdccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:03.145998 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91f4d-7e46-4344-868d-693716bfdccd admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.146798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91f4d-7e46-4344-868d-693716bfdccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.147482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91f4d-7e46-4344-868d-693716bfdccd admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.148397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91f4d-7e46-4344-868d-693716bfdccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:03.151396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91f4d-7e46-4344-868d-693716bfdccd admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:03.173154 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1292/2599] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:45:03.181270 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9780a7-d7fc-4065-b221-7c6655a1abe9 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:03.201979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9780a7-d7fc-4065-b221-7c6655a1abe9 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:03.208650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b186f6f-787b-4c35-8c67-bf401b4bd40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:03.210618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b186f6f-787b-4c35-8c67-bf401b4bd40b admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.211179 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b186f6f-787b-4c35-8c67-bf401b4bd40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.211767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b186f6f-787b-4c35-8c67-bf401b4bd40b admin admin] PATH_INFO: `/v3/projects/96008971375e4cfb9bc353ee4fb2043e/users/d1a83436bb5d4ab88d9fe1647d70d02c/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.215896 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b186f6f-787b-4c35-8c67-bf401b4bd40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=96008971375e4cfb9bc353ee4fb2043e, user_id=d1a83436bb5d4ab88d9fe1647d70d02c, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:03.222424 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b186f6f-787b-4c35-8c67-bf401b4bd40b admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:03.242949 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1293/2600] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:45:03 2022] PUT /identity/v3/projects/96008971375e4cfb9bc353ee4fb2043e/users/d1a83436bb5d4ab88d9fe1647d70d02c/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:45:03.246261 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b186f6f-787b-4c35-8c67-bf401b4bd40b admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:03.249885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1b186f6f-787b-4c35-8c67-bf401b4bd40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:03.362570 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b186f6f-787b-4c35-8c67-bf401b4bd40b admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:03.378529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:03.379958 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.387591 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.387591 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] PATH_INFO: `/v3/projects/f553e5a48edb464cb5228ec471acd41e` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.387591 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f553e5a48edb464cb5228ec471acd41e)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:03.387591 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:03.389272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1308/2601] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:45:02 2022] POST /identity/v3/users => generated 286 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:45:03.390992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866551-5de5-4d59-a24e-f66df49c3744 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.391282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866551-5de5-4d59-a24e-f66df49c3744 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.391588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44866551-5de5-4d59-a24e-f66df49c3744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.442653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-44866551-5de5-4d59-a24e-f66df49c3744 None None] MFA Rules not processed for user `d1a83436bb5d4ab88d9fe1647d70d02c`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:03.444684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-44866551-5de5-4d59-a24e-f66df49c3744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:03.553255 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1309/2602] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:03 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:03.553255 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44866551-5de5-4d59-a24e-f66df49c3744 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:03.566572 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44866551-5de5-4d59-a24e-f66df49c3744 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:03.569605 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f553e5a48edb464cb5228ec471acd41e', 'request_id': 'req-4376fc62-7dc7-46b3-9653-6580c0231766'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:03.578145 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f553e5a48edb464cb5228ec471acd41e', 'request_id': 'req-4376fc62-7dc7-46b3-9653-6580c0231766'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:03.639196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a563ee-c793-42c0-a95e-37eee72bb2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:03.640399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a563ee-c793-42c0-a95e-37eee72bb2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.640675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a563ee-c793-42c0-a95e-37eee72bb2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.640955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a563ee-c793-42c0-a95e-37eee72bb2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.641669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a563ee-c793-42c0-a95e-37eee72bb2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:03.643508 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a563ee-c793-42c0-a95e-37eee72bb2c2 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:03.654682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1310/2603] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:45:03.655576 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a563ee-c793-42c0-a95e-37eee72bb2c2 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:03.657731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-99a563ee-c793-42c0-a95e-37eee72bb2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:03.668521 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f553e5a48edb464cb5228ec471acd41e', 'request_id': 'req-4376fc62-7dc7-46b3-9653-6580c0231766'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:03.690680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] The token cache is being invalidate because project f553e5a48edb464cb5228ec471acd41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:03.691162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:03.693038 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:03.695848 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1294/2604] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:45:03 2022] DELETE /identity/v3/projects/f553e5a48edb464cb5228ec471acd41e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:03.697240 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:03.699485 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:03.721229 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376fc62-7dc7-46b3-9653-6580c0231766 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:03.728497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ac809-d539-4f6c-b1ce-e133fa05faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:03.729130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac809-d539-4f6c-b1ce-e133fa05faaf admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.729445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac809-d539-4f6c-b1ce-e133fa05faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.729722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac809-d539-4f6c-b1ce-e133fa05faaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.730427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ac809-d539-4f6c-b1ce-e133fa05faaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:03.732381 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ac809-d539-4f6c-b1ce-e133fa05faaf admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:03.732708 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a563ee-c793-42c0-a95e-37eee72bb2c2 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:03.737077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e14730-14d2-4b37-8976-4359f80553bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:03.737850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e14730-14d2-4b37-8976-4359f80553bd service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.738238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e14730-14d2-4b37-8976-4359f80553bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.738745 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e14730-14d2-4b37-8976-4359f80553bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.741678 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-00e14730-14d2-4b37-8976-4359f80553bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:03.749761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1295/2605] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:45:03.751228 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59468-bc71-412d-9711-a6b48aa4671d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.751518 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59468-bc71-412d-9711-a6b48aa4671d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.751791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59468-bc71-412d-9711-a6b48aa4671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.773167 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-dbe59468-bc71-412d-9711-a6b48aa4671d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:03.774441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-dbe59468-bc71-412d-9711-a6b48aa4671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:03.782851 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1296/2606] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:03.783718 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe59468-bc71-412d-9711-a6b48aa4671d None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:03.794611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe59468-bc71-412d-9711-a6b48aa4671d None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:03.799300 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b27cba-8d8a-41b1-be63-aaeb0c58985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:03.799964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b27cba-8d8a-41b1-be63-aaeb0c58985f admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.800247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b27cba-8d8a-41b1-be63-aaeb0c58985f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.800671 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b27cba-8d8a-41b1-be63-aaeb0c58985f admin admin] PATH_INFO: `/v3/projects/c8d18d7c412e40c895e66b154cec9603/users/e594e1b3caa54f21b2e651b0e8a91e46/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.818810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b27cba-8d8a-41b1-be63-aaeb0c58985f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d18d7c412e40c895e66b154cec9603, user_id=e594e1b3caa54f21b2e651b0e8a91e46, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:03.822061 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b27cba-8d8a-41b1-be63-aaeb0c58985f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:03.822769 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e14730-14d2-4b37-8976-4359f80553bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:03.824204 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e14730-14d2-4b37-8976-4359f80553bd service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:03.834688 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1311/2607] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:03 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:45:03.842577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e1f8b-ba29-46b1-985d-64c45e3fe597 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.842577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e1f8b-ba29-46b1-985d-64c45e3fe597 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.842577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e1f8b-ba29-46b1-985d-64c45e3fe597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.858451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-c96e1f8b-ba29-46b1-985d-64c45e3fe597 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:03.859702 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-c96e1f8b-ba29-46b1-985d-64c45e3fe597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:03.869123 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1312/2608] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:03.875125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e1f8b-ba29-46b1-985d-64c45e3fe597 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:03.888422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e1f8b-ba29-46b1-985d-64c45e3fe597 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:03.893215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dec7c-e421-4470-bfdb-3d42a7c587ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:03.893922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dec7c-e421-4470-bfdb-3d42a7c587ef admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.894209 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dec7c-e421-4470-bfdb-3d42a7c587ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.894472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dec7c-e421-4470-bfdb-3d42a7c587ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.898873 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dec7c-e421-4470-bfdb-3d42a7c587ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:45:03.899196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dec7c-e421-4470-bfdb-3d42a7c587ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:03.900864 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231dec7c-e421-4470-bfdb-3d42a7c587ef admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:03.914185 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1313/2609] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:45:03.918674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dec7c-e421-4470-bfdb-3d42a7c587ef admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:03.929866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dec7c-e421-4470-bfdb-3d42a7c587ef admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:03.934695 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35ff90-252a-47c5-b96d-46af2ac28d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:03.935306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35ff90-252a-47c5-b96d-46af2ac28d4d admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.935586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35ff90-252a-47c5-b96d-46af2ac28d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.935895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35ff90-252a-47c5-b96d-46af2ac28d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.936524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35ff90-252a-47c5-b96d-46af2ac28d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:03.938484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35ff90-252a-47c5-b96d-46af2ac28d4d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:03.954724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1297/2610] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:45:03 2022] PUT /identity/v3/projects/c8d18d7c412e40c895e66b154cec9603/users/e594e1b3caa54f21b2e651b0e8a91e46/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:03.961579 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a295cff-3e2b-4ccb-95dc-055043bf01e5 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:03.961975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a295cff-3e2b-4ccb-95dc-055043bf01e5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:03.962317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a295cff-3e2b-4ccb-95dc-055043bf01e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:03.987504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:04.001959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-7a295cff-3e2b-4ccb-95dc-055043bf01e5 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:04.005111 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7a295cff-3e2b-4ccb-95dc-055043bf01e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:04.079340 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1314/2611] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:45:03 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:45:04.080793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35ff90-252a-47c5-b96d-46af2ac28d4d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:04.141758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1298/2612] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:04.149762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a295cff-3e2b-4ccb-95dc-055043bf01e5 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:04.151730 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7a295cff-3e2b-4ccb-95dc-055043bf01e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:04.190487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35ff90-252a-47c5-b96d-46af2ac28d4d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:04.199204 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c129d0-91ab-42eb-a116-9914b9523800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:04.200351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c129d0-91ab-42eb-a116-9914b9523800 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:04.201064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c129d0-91ab-42eb-a116-9914b9523800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:04.201566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c129d0-91ab-42eb-a116-9914b9523800 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:04.203218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c129d0-91ab-42eb-a116-9914b9523800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:04.208280 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c129d0-91ab-42eb-a116-9914b9523800 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:04.251397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a295cff-3e2b-4ccb-95dc-055043bf01e5 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:04.321343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd97dc-1ad3-44df-9571-5e1baa8ffd84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:04.321343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd97dc-1ad3-44df-9571-5e1baa8ffd84 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:04.321343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd97dc-1ad3-44df-9571-5e1baa8ffd84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:04.321343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd97dc-1ad3-44df-9571-5e1baa8ffd84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:04.330915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd97dc-1ad3-44df-9571-5e1baa8ffd84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:04.332965 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd97dc-1ad3-44df-9571-5e1baa8ffd84 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:04.343675 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1299/2613] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:45:04.344676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd97dc-1ad3-44df-9571-5e1baa8ffd84 service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:04.346266 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-13cd97dc-1ad3-44df-9571-5e1baa8ffd84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:04.409863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1315/2614] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:45:04 2022] POST /identity/v3/users => generated 287 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:45:04.414466 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c129d0-91ab-42eb-a116-9914b9523800 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:04.430474 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c129d0-91ab-42eb-a116-9914b9523800 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:04.436761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd97dc-1ad3-44df-9571-5e1baa8ffd84 service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:04.439592 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1efb8-817b-46be-83d5-d57a6904e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:04.440266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1efb8-817b-46be-83d5-d57a6904e644 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:04.440488 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ba8a7-3f44-4b0d-aaee-d2681adbed19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:04.440610 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1efb8-817b-46be-83d5-d57a6904e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:04.440939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1efb8-817b-46be-83d5-d57a6904e644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:04.441106 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba8a7-3f44-4b0d-aaee-d2681adbed19 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:04.441409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba8a7-3f44-4b0d-aaee-d2681adbed19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:04.441622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1efb8-817b-46be-83d5-d57a6904e644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:04.442262 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ba8a7-3f44-4b0d-aaee-d2681adbed19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:04.443785 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c1efb8-817b-46be-83d5-d57a6904e644 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:04.444417 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-352ba8a7-3f44-4b0d-aaee-d2681adbed19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:04.456414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1316/2615] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:45:04.461584 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1efb8-817b-46be-83d5-d57a6904e644 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:04.472129 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1efb8-817b-46be-83d5-d57a6904e644 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:04.477578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090201e-7072-45e5-acee-fadc4fc314ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:04.478176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090201e-7072-45e5-acee-fadc4fc314ee admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:04.478586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090201e-7072-45e5-acee-fadc4fc314ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:04.478869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1090201e-7072-45e5-acee-fadc4fc314ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:04.479509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090201e-7072-45e5-acee-fadc4fc314ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:04.481395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1090201e-7072-45e5-acee-fadc4fc314ee admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:04.492613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1317/2616] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:45:04.497413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090201e-7072-45e5-acee-fadc4fc314ee admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:04.509657 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1090201e-7072-45e5-acee-fadc4fc314ee admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:04.514274 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ba8a7-3f44-4b0d-aaee-d2681adbed19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:04.514616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794dd85-8a7e-417b-af4e-8d3394915aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:04.515472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794dd85-8a7e-417b-af4e-8d3394915aae admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:04.515741 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794dd85-8a7e-417b-af4e-8d3394915aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:04.515912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ba8a7-3f44-4b0d-aaee-d2681adbed19 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:04.516099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794dd85-8a7e-417b-af4e-8d3394915aae admin admin] PATH_INFO: `/v3/projects/a9d9a98f44784cbf9e58fe0a178412b2/users/e0a6477d49864009a09abcf63837edf6/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:04.529599 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:04.534814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1300/2617] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:04 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:45:04.539484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794dd85-8a7e-417b-af4e-8d3394915aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d9a98f44784cbf9e58fe0a178412b2, user_id=e0a6477d49864009a09abcf63837edf6, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:04.542449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794dd85-8a7e-417b-af4e-8d3394915aae admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:04.669414 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1318/2618] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:45:04 2022] PUT /identity/v3/projects/a9d9a98f44784cbf9e58fe0a178412b2/users/e0a6477d49864009a09abcf63837edf6/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:04.678345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b678f9-8236-4086-9b21-398850ae8933 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:04.678684 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b678f9-8236-4086-9b21-398850ae8933 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:04.678947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b678f9-8236-4086-9b21-398850ae8933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:04.711656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-d9b678f9-8236-4086-9b21-398850ae8933 None None] MFA Rules not processed for user `e0a6477d49864009a09abcf63837edf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:04.712961 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d9b678f9-8236-4086-9b21-398850ae8933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:04.787051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1301/2619] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:45:05.041028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794dd85-8a7e-417b-af4e-8d3394915aae admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:05.043009 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e794dd85-8a7e-417b-af4e-8d3394915aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:05.108270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794dd85-8a7e-417b-af4e-8d3394915aae admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:05.113346 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eeab1-bc8a-418d-a3ff-9476f2255340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:05.115263 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eeab1-bc8a-418d-a3ff-9476f2255340 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:05.115570 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eeab1-bc8a-418d-a3ff-9476f2255340 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:05.115881 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eeab1-bc8a-418d-a3ff-9476f2255340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:05.125947 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09eeab1-bc8a-418d-a3ff-9476f2255340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:05.127800 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09eeab1-bc8a-418d-a3ff-9476f2255340 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:05.138918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1319/2620] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:45:07.028652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf9742-d73b-47e7-a62e-327bb5d35cb2 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:07.028652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf9742-d73b-47e7-a62e-327bb5d35cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:07.028652 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf9742-d73b-47e7-a62e-327bb5d35cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:07.069051 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-1aaf9742-d73b-47e7-a62e-327bb5d35cb2 None None] MFA Rules not processed for user `e594e1b3caa54f21b2e651b0e8a91e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:07.070438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-1aaf9742-d73b-47e7-a62e-327bb5d35cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:07.155142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1302/2621] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:07.160227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eeab1-bc8a-418d-a3ff-9476f2255340 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:07.237887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eeab1-bc8a-418d-a3ff-9476f2255340 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:07.248352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4d8a6-753c-4c99-8d33-6d4d752cd62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:07.248352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4d8a6-753c-4c99-8d33-6d4d752cd62d admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:07.248352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4d8a6-753c-4c99-8d33-6d4d752cd62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:07.248352 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4d8a6-753c-4c99-8d33-6d4d752cd62d admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:07.248963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4d8a6-753c-4c99-8d33-6d4d752cd62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:07.248963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4d8a6-753c-4c99-8d33-6d4d752cd62d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:07.452975 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1320/2622] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:45:07 2022] POST /identity/v3/projects => generated 373 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:45:07.457006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf9742-d73b-47e7-a62e-327bb5d35cb2 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:07.468946 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf9742-d73b-47e7-a62e-327bb5d35cb2 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:07.528712 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7d641-6498-476c-9204-060f5b2bc53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:07.529239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7d641-6498-476c-9204-060f5b2bc53c admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:07.529557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7d641-6498-476c-9204-060f5b2bc53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:07.529827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7d641-6498-476c-9204-060f5b2bc53c admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:07.530482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7d641-6498-476c-9204-060f5b2bc53c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:07.532412 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7d641-6498-476c-9204-060f5b2bc53c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:07.673574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1303/2623] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:45:07 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:45:07.703858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4d8a6-753c-4c99-8d33-6d4d752cd62d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:07.716913 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4d8a6-753c-4c99-8d33-6d4d752cd62d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:07.726015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672f2d-9a0d-4cbb-88c2-f1e14a41b676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:07.726015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672f2d-9a0d-4cbb-88c2-f1e14a41b676 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:07.726015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672f2d-9a0d-4cbb-88c2-f1e14a41b676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:07.726015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672f2d-9a0d-4cbb-88c2-f1e14a41b676 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:07.726617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1672f2d-9a0d-4cbb-88c2-f1e14a41b676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:07.726617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1672f2d-9a0d-4cbb-88c2-f1e14a41b676 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:07.738307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1321/2624] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:45:07.743032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7d641-6498-476c-9204-060f5b2bc53c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:07.753629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7d641-6498-476c-9204-060f5b2bc53c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:07.759080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064f11d-c133-446e-a77a-3d0391a2266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:07.768722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064f11d-c133-446e-a77a-3d0391a2266c admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:07.768722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064f11d-c133-446e-a77a-3d0391a2266c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:07.768722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064f11d-c133-446e-a77a-3d0391a2266c admin admin] PATH_INFO: `/v3/projects/0d86d94d51044341adbe915b563a32d4/users/0364779e8b46410a99903cea715403a5/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:07.776747 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064f11d-c133-446e-a77a-3d0391a2266c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d86d94d51044341adbe915b563a32d4, user_id=0364779e8b46410a99903cea715403a5, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:07.779503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064f11d-c133-446e-a77a-3d0391a2266c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:08.076855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1304/2625] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:45:07 2022] PUT /identity/v3/projects/0d86d94d51044341adbe915b563a32d4/users/0364779e8b46410a99903cea715403a5/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:45:08.080899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672f2d-9a0d-4cbb-88c2-f1e14a41b676 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:08.091675 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672f2d-9a0d-4cbb-88c2-f1e14a41b676 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:08.111668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:08.157469 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda362ca-31fc-4615-91f6-4443f6de94de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:08.158437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda362ca-31fc-4615-91f6-4443f6de94de admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:08.158721 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda362ca-31fc-4615-91f6-4443f6de94de admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:08.159000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda362ca-31fc-4615-91f6-4443f6de94de admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:08.159697 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda362ca-31fc-4615-91f6-4443f6de94de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:08.161959 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda362ca-31fc-4615-91f6-4443f6de94de admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:08.173137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1322/2626] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:45:08.178075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064f11d-c133-446e-a77a-3d0391a2266c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:08.188724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064f11d-c133-446e-a77a-3d0391a2266c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:08.193653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b02f1-27da-44ae-89ad-5451b457eff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:08.194332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b02f1-27da-44ae-89ad-5451b457eff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:08.194609 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b02f1-27da-44ae-89ad-5451b457eff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:08.195104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b02f1-27da-44ae-89ad-5451b457eff4 admin admin] PATH_INFO: `/v3/projects/0d86d94d51044341adbe915b563a32d4/users/0364779e8b46410a99903cea715403a5/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:08.197088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b02f1-27da-44ae-89ad-5451b457eff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d86d94d51044341adbe915b563a32d4, user_id=0364779e8b46410a99903cea715403a5, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:08.199774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b02f1-27da-44ae-89ad-5451b457eff4 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:08.211412 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1305/2627] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:45:08 2022] PUT /identity/v3/projects/0d86d94d51044341adbe915b563a32d4/users/0364779e8b46410a99903cea715403a5/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:09.290210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:09.831849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda362ca-31fc-4615-91f6-4443f6de94de admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:09.838025 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-eda362ca-31fc-4615-91f6-4443f6de94de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:09.853835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda362ca-31fc-4615-91f6-4443f6de94de admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:09.939110 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b02f1-27da-44ae-89ad-5451b457eff4 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:09.940970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a71b02f1-27da-44ae-89ad-5451b457eff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:09.977624 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffa4c4-901a-4465-a72d-fffb68f4219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:09.978902 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffa4c4-901a-4465-a72d-fffb68f4219b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:09.979408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffa4c4-901a-4465-a72d-fffb68f4219b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:09.979945 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffa4c4-901a-4465-a72d-fffb68f4219b admin admin] PATH_INFO: `/v3/users/ff6b10b91c5f41069f74865aa5883089` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:09.981939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffa4c4-901a-4465-a72d-fffb68f4219b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6b10b91c5f41069f74865aa5883089)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:09.985641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffa4c4-901a-4465-a72d-fffb68f4219b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:10.028049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b02f1-27da-44ae-89ad-5451b457eff4 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:10.032933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4ae67-0f6e-4281-a446-179d7e2f9529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:10.033617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4ae67-0f6e-4281-a446-179d7e2f9529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:10.033901 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4ae67-0f6e-4281-a446-179d7e2f9529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:10.034172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4ae67-0f6e-4281-a446-179d7e2f9529 admin admin] PATH_INFO: `/v3/users/eecc57219a924e98aef06849d85d44e5` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:10.035382 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4ae67-0f6e-4281-a446-179d7e2f9529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eecc57219a924e98aef06849d85d44e5)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:10.038102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4ae67-0f6e-4281-a446-179d7e2f9529 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:10.368194 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-30ffa4c4-901a-4465-a72d-fffb68f4219b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6b10b91c5f41069f74865aa5883089'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:10.393201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e6e4ae67-0f6e-4281-a446-179d7e2f9529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eecc57219a924e98aef06849d85d44e5'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:10.394851 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-30ffa4c4-901a-4465-a72d-fffb68f4219b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6b10b91c5f41069f74865aa5883089'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:10.401339 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e6e4ae67-0f6e-4281-a446-179d7e2f9529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eecc57219a924e98aef06849d85d44e5'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:10.408245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-30ffa4c4-901a-4465-a72d-fffb68f4219b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6b10b91c5f41069f74865aa5883089'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:10.644616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e6e4ae67-0f6e-4281-a446-179d7e2f9529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eecc57219a924e98aef06849d85d44e5'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:10.645517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e6e4ae67-0f6e-4281-a446-179d7e2f9529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eecc57219a924e98aef06849d85d44e5'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:10.646402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e6e4ae67-0f6e-4281-a446-179d7e2f9529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eecc57219a924e98aef06849d85d44e5'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:10.683840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1306/2628] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:45:09 2022] DELETE /identity/v3/users/eecc57219a924e98aef06849d85d44e5 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:10.683840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bf4c2-fbfd-4ced-8e5d-df170f28357b None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:10.683840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bf4c2-fbfd-4ced-8e5d-df170f28357b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:10.683840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bf4c2-fbfd-4ced-8e5d-df170f28357b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:10.708311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-2a2bf4c2-fbfd-4ced-8e5d-df170f28357b None None] MFA Rules not processed for user `0364779e8b46410a99903cea715403a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:10.709666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2a2bf4c2-fbfd-4ced-8e5d-df170f28357b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:10.789963 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1307/2629] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:10.791232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a120-7604-47ac-8f57-5a3345e908ae None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:10.791517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a120-7604-47ac-8f57-5a3345e908ae None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:10.791790 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a120-7604-47ac-8f57-5a3345e908ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:10.801432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-30ffa4c4-901a-4465-a72d-fffb68f4219b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6b10b91c5f41069f74865aa5883089'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:10.810192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-30ffa4c4-901a-4465-a72d-fffb68f4219b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6b10b91c5f41069f74865aa5883089'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:10.810192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1323/2630] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:45:09 2022] DELETE /identity/v3/users/ff6b10b91c5f41069f74865aa5883089 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:10.810192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d5ef-40c5-4f6e-bf05-c85c6094edd9 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:10.810484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d5ef-40c5-4f6e-bf05-c85c6094edd9 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:10.810751 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d5ef-40c5-4f6e-bf05-c85c6094edd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:10.813335 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-4d81a120-7604-47ac-8f57-5a3345e908ae None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:10.815755 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4d81a120-7604-47ac-8f57-5a3345e908ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:10.837717 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-55c3d5ef-40c5-4f6e-bf05-c85c6094edd9 None None] MFA Rules not processed for user `e594e1b3caa54f21b2e651b0e8a91e46`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:10.838982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-55c3d5ef-40c5-4f6e-bf05-c85c6094edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:10.893846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1308/2631] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:10.893846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903f42-951d-4d90-ba47-a99599a118d6 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:10.893846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903f42-951d-4d90-ba47-a99599a118d6 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:10.893846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2903f42-951d-4d90-ba47-a99599a118d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:10.916178 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b2903f42-951d-4d90-ba47-a99599a118d6 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:10.917815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b2903f42-951d-4d90-ba47-a99599a118d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:10.934025 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1324/2632] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:10.934025 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d5ef-40c5-4f6e-bf05-c85c6094edd9 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:10.934469 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1309/2633] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:10.935025 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-55c3d5ef-40c5-4f6e-bf05-c85c6094edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:10.965284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903f42-951d-4d90-ba47-a99599a118d6 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:10.965284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b2903f42-951d-4d90-ba47-a99599a118d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:11.031852 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d5ef-40c5-4f6e-bf05-c85c6094edd9 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:11.036679 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4f8b2-58a6-48bb-b037-5e1f3b071b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:11.037348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f8b2-58a6-48bb-b037-5e1f3b071b33 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:11.056423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f8b2-58a6-48bb-b037-5e1f3b071b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:11.056423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4f8b2-58a6-48bb-b037-5e1f3b071b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:11.056423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4f8b2-58a6-48bb-b037-5e1f3b071b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:11.056423 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf4f8b2-58a6-48bb-b037-5e1f3b071b33 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:11.056811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2903f42-951d-4d90-ba47-a99599a118d6 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:11.059048 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1325/2634] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:45:11.059861 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4f8b2-58a6-48bb-b037-5e1f3b071b33 service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:11.061154 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-aaf4f8b2-58a6-48bb-b037-5e1f3b071b33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:11.061514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed615f3-9b8c-4093-a14f-cfe5c9f2fd96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:11.062283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed615f3-9b8c-4093-a14f-cfe5c9f2fd96 service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:11.062565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed615f3-9b8c-4093-a14f-cfe5c9f2fd96 service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:11.062838 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed615f3-9b8c-4093-a14f-cfe5c9f2fd96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:11.064623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8ed615f3-9b8c-4093-a14f-cfe5c9f2fd96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:11.073608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4f8b2-58a6-48bb-b037-5e1f3b071b33 service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:11.076009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed615f3-9b8c-4093-a14f-cfe5c9f2fd96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:11.077811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed615f3-9b8c-4093-a14f-cfe5c9f2fd96 service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:11.078253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a0cfb-5753-4822-aa62-b8ef71a965a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:11.078908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a0cfb-5753-4822-aa62-b8ef71a965a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:11.079275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a0cfb-5753-4822-aa62-b8ef71a965a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:11.079551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a0cfb-5753-4822-aa62-b8ef71a965a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:11.087991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1310/2635] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:45:11.091462 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a0cfb-5753-4822-aa62-b8ef71a965a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:11.092903 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a0cfb-5753-4822-aa62-b8ef71a965a3 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:11.105682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1326/2636] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:45:11.405471 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:11.657895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed615f3-9b8c-4093-a14f-cfe5c9f2fd96 service nova] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:11.657895 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8ed615f3-9b8c-4093-a14f-cfe5c9f2fd96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:11.683969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed615f3-9b8c-4093-a14f-cfe5c9f2fd96 service nova] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:11.689294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:11.692477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:11.692477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:11.692477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] PATH_INFO: `/v3/projects/36c2ceeffe0049a4994f1b41a96c6cda` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:11.692477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c2ceeffe0049a4994f1b41a96c6cda)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:11.694402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:11.772244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a0cfb-5753-4822-aa62-b8ef71a965a3 service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:11.773768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-090a0cfb-5753-4822-aa62-b8ef71a965a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:11.787328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a0cfb-5753-4822-aa62-b8ef71a965a3 service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:11.792133 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:11.792765 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:11.793045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:11.793319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] PATH_INFO: `/v3/projects/12e386fac2eb41639a52e188727236b8` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:11.794534 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12e386fac2eb41639a52e188727236b8)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:11.796698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:11.952544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c2ceeffe0049a4994f1b41a96c6cda', 'request_id': 'req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:11.959938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c2ceeffe0049a4994f1b41a96c6cda', 'request_id': 'req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.007863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12e386fac2eb41639a52e188727236b8', 'request_id': 'req-9f40cbac-5206-4305-b560-3a1c8807fb60'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.112954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c2ceeffe0049a4994f1b41a96c6cda', 'request_id': 'req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.125030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] The token cache is being invalidate because project 36c2ceeffe0049a4994f1b41a96c6cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:12.125334 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.126000 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.127666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1311/2637] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:45:11 2022] DELETE /identity/v3/projects/36c2ceeffe0049a4994f1b41a96c6cda => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:12.132843 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:12.134359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:12.207420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3eb4c3-0a94-4ddf-bf9a-df4dc73b1c14 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:12.274037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:12.274694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:12.277123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:12.277123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] PATH_INFO: `/v3/users/a93afe70f22f458591968dca92688745` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:12.278443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a93afe70f22f458591968dca92688745)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:12.280412 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:12.338272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12e386fac2eb41639a52e188727236b8', 'request_id': 'req-9f40cbac-5206-4305-b560-3a1c8807fb60'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.346397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12e386fac2eb41639a52e188727236b8', 'request_id': 'req-9f40cbac-5206-4305-b560-3a1c8807fb60'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.365723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] The token cache is being invalidate because project 12e386fac2eb41639a52e188727236b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:12.366234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.367339 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.370495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1327/2638] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:45:11 2022] DELETE /identity/v3/projects/12e386fac2eb41639a52e188727236b8 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:45:12.380980 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:12.383494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:12.399201 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40cbac-5206-4305-b560-3a1c8807fb60 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:12.404370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:12.405142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:12.405459 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:12.405739 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] PATH_INFO: `/v3/users/c20aa522fc4f4f839e93f6231f78ac4a` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:12.406888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c20aa522fc4f4f839e93f6231f78ac4a)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:12.408906 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:12.479169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:12.572095 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a93afe70f22f458591968dca92688745'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.579039 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a93afe70f22f458591968dca92688745'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.847909 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a93afe70f22f458591968dca92688745'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.848681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a93afe70f22f458591968dca92688745'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.849064 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a93afe70f22f458591968dca92688745'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.868930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1312/2639] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:45:12 2022] DELETE /identity/v3/users/a93afe70f22f458591968dca92688745 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:45:12.870186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:12.871694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:12.914460 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c20aa522fc4f4f839e93f6231f78ac4a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.929047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c20aa522fc4f4f839e93f6231f78ac4a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.936893 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c20aa522fc4f4f839e93f6231f78ac4a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:12.960826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d791e4-b45f-4ee9-8e16-d354de121f37 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:12.967813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a57ef5-d84a-4b6c-b755-d5abd81bfcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:12.968506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a57ef5-d84a-4b6c-b755-d5abd81bfcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:12.968791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a57ef5-d84a-4b6c-b755-d5abd81bfcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:12.969068 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a57ef5-d84a-4b6c-b755-d5abd81bfcb1 admin admin] PATH_INFO: `/v3/users/5bc6bca5dee944f4b1a039e71437340d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:12.970577 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a57ef5-d84a-4b6c-b755-d5abd81bfcb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc6bca5dee944f4b1a039e71437340d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:12.972577 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a57ef5-d84a-4b6c-b755-d5abd81bfcb1 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:13.090366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c20aa522fc4f4f839e93f6231f78ac4a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:13.091140 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c20aa522fc4f4f839e93f6231f78ac4a'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:13.098193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1328/2640] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:45:12 2022] DELETE /identity/v3/users/c20aa522fc4f4f839e93f6231f78ac4a => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:13.570362 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-90a57ef5-d84a-4b6c-b755-d5abd81bfcb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc6bca5dee944f4b1a039e71437340d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:13.586847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-90a57ef5-d84a-4b6c-b755-d5abd81bfcb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc6bca5dee944f4b1a039e71437340d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:13.615976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:13.618553 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:13.726186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-90a57ef5-d84a-4b6c-b755-d5abd81bfcb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc6bca5dee944f4b1a039e71437340d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:13.726883 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-90a57ef5-d84a-4b6c-b755-d5abd81bfcb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc6bca5dee944f4b1a039e71437340d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:13.727501 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-90a57ef5-d84a-4b6c-b755-d5abd81bfcb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc6bca5dee944f4b1a039e71437340d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:13.745983 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bd9c2-1ef6-4da4-a65e-8a5a5ec5c7cc admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:13.753274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:13.754512 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:13.755319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:13.758434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1313/2641] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:45:12 2022] DELETE /identity/v3/users/5bc6bca5dee944f4b1a039e71437340d => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:13.758698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] PATH_INFO: `/v3/projects/4eb82ee091194b569ec389a0117c3e35` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:13.760354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb82ee091194b569ec389a0117c3e35)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:13.761507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5d41-8899-44d5-80a0-da88d225348f None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:13.761922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5d41-8899-44d5-80a0-da88d225348f None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:13.762340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe5d41-8899-44d5-80a0-da88d225348f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:13.762785 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:13.837492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-ebbe5d41-8899-44d5-80a0-da88d225348f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:13.844818 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ebbe5d41-8899-44d5-80a0-da88d225348f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:13.993780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1314/2642] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:45:13.997610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe5d41-8899-44d5-80a0-da88d225348f None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:13.999144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-ebbe5d41-8899-44d5-80a0-da88d225348f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:14.057865 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb82ee091194b569ec389a0117c3e35', 'request_id': 'req-be92802e-4574-4302-85d6-6bc8a69fe27e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:14.074767 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe5d41-8899-44d5-80a0-da88d225348f None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:14.143991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fcccd-c3ba-4e1a-8f0a-3589206a11ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:14.145859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fcccd-c3ba-4e1a-8f0a-3589206a11ee service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:14.146344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fcccd-c3ba-4e1a-8f0a-3589206a11ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:14.146832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fcccd-c3ba-4e1a-8f0a-3589206a11ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:14.235006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb82ee091194b569ec389a0117c3e35', 'request_id': 'req-be92802e-4574-4302-85d6-6bc8a69fe27e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:14.243725 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb82ee091194b569ec389a0117c3e35', 'request_id': 'req-be92802e-4574-4302-85d6-6bc8a69fe27e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:14.245620 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fcccd-c3ba-4e1a-8f0a-3589206a11ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:14.247143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fcccd-c3ba-4e1a-8f0a-3589206a11ee service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:14.256051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] The token cache is being invalidate because project 4eb82ee091194b569ec389a0117c3e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:14.256344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:14.257025 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:14.258658 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1329/2643] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:45:13 2022] DELETE /identity/v3/projects/4eb82ee091194b569ec389a0117c3e35 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:45:14.262385 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1315/2644] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:45:14.262643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:14.263875 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:14.264232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fcccd-c3ba-4e1a-8f0a-3589206a11ee service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:14.266027 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5e6fcccd-c3ba-4e1a-8f0a-3589206a11ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:14.278402 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be92802e-4574-4302-85d6-6bc8a69fe27e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:14.284623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fcccd-c3ba-4e1a-8f0a-3589206a11ee service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:14.287472 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:14.288373 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:14.289142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:14.289142 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] PATH_INFO: `/v3/projects/c43116a3ec444465907144b72879ef56` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:14.290234 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c43116a3ec444465907144b72879ef56)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:14.292346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:14.292549 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:14.292999 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:14.293287 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:14.293597 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] PATH_INFO: `/v3/users/fdaf4a4749744599a4a2fcb74d8b5c3d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:14.294885 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdaf4a4749744599a4a2fcb74d8b5c3d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:14.298096 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:14.723600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c43116a3ec444465907144b72879ef56', 'request_id': 'req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:14.730028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdaf4a4749744599a4a2fcb74d8b5c3d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:14.742145 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdaf4a4749744599a4a2fcb74d8b5c3d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:14.908370 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c43116a3ec444465907144b72879ef56', 'request_id': 'req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:14.916314 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c43116a3ec444465907144b72879ef56', 'request_id': 'req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:14.932121 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] The token cache is being invalidate because project c43116a3ec444465907144b72879ef56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:14.932507 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:14.933264 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:14.935009 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1330/2645] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:45:14 2022] DELETE /identity/v3/projects/c43116a3ec444465907144b72879ef56 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:14.936291 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:14.938210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:15.015757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e385a9e-cf0d-41a5-8d5f-86b72179bc54 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:15.022521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:15.023216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:15.023495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:15.023908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] PATH_INFO: `/v3/projects/1371d8ff3dd14cd58fe6faca0db8c4dc` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:15.025080 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1371d8ff3dd14cd58fe6faca0db8c4dc)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:15.027296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:15.037143 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdaf4a4749744599a4a2fcb74d8b5c3d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.043640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdaf4a4749744599a4a2fcb74d8b5c3d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.043640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdaf4a4749744599a4a2fcb74d8b5c3d'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.063436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1316/2646] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:45:14 2022] DELETE /identity/v3/users/fdaf4a4749744599a4a2fcb74d8b5c3d => generated 0 bytes in 801 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:45:15.064488 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:15.065940 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:15.144296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa36b95-02b1-4a37-adba-306f584bee4d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:15.149907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:15.150558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:15.150862 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:15.151149 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] PATH_INFO: `/v3/users/e562f246791f46848269da72a38a07a4` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:15.152308 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e562f246791f46848269da72a38a07a4)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:15.154277 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:15.239182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1371d8ff3dd14cd58fe6faca0db8c4dc', 'request_id': 'req-caed0a96-149c-4dd7-8f8d-603add85f25c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.439516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1371d8ff3dd14cd58fe6faca0db8c4dc', 'request_id': 'req-caed0a96-149c-4dd7-8f8d-603add85f25c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.450260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1371d8ff3dd14cd58fe6faca0db8c4dc', 'request_id': 'req-caed0a96-149c-4dd7-8f8d-603add85f25c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.463595 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] The token cache is being invalidate because project 1371d8ff3dd14cd58fe6faca0db8c4dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:15.463909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.464870 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.467312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1331/2647] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:45:14 2022] DELETE /identity/v3/projects/1371d8ff3dd14cd58fe6faca0db8c4dc => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:15.471578 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:15.474828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:15.568045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed0a96-149c-4dd7-8f8d-603add85f25c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:15.578963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24932e38-5538-4592-95db-4ae37c427651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:15.578963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24932e38-5538-4592-95db-4ae37c427651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:15.578963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24932e38-5538-4592-95db-4ae37c427651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:15.578963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24932e38-5538-4592-95db-4ae37c427651 admin admin] PATH_INFO: `/v3/users/d1a83436bb5d4ab88d9fe1647d70d02c` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:15.579343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24932e38-5538-4592-95db-4ae37c427651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a83436bb5d4ab88d9fe1647d70d02c)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:15.579343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24932e38-5538-4592-95db-4ae37c427651 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:15.601021 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e562f246791f46848269da72a38a07a4'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.608979 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e562f246791f46848269da72a38a07a4'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.762138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e562f246791f46848269da72a38a07a4'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.762731 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e562f246791f46848269da72a38a07a4'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.763337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e562f246791f46848269da72a38a07a4'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.788873 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1317/2648] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:45:15 2022] DELETE /identity/v3/users/e562f246791f46848269da72a38a07a4 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:15.790123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:15.791697 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:15.865193 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd0e76-2a1d-46c6-bd1b-7bab82fadc5c admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:15.870188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:15.870878 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:15.871183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:15.871495 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] PATH_INFO: `/v3/projects/13de28b76d5b45dbbd38a535b5eee13d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:15.872834 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=13de28b76d5b45dbbd38a535b5eee13d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:15.874977 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:15.908245 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-24932e38-5538-4592-95db-4ae37c427651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a83436bb5d4ab88d9fe1647d70d02c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.937799 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-24932e38-5538-4592-95db-4ae37c427651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a83436bb5d4ab88d9fe1647d70d02c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.938051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-24932e38-5538-4592-95db-4ae37c427651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a83436bb5d4ab88d9fe1647d70d02c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:15.976587 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:16.151619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-24932e38-5538-4592-95db-4ae37c427651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a83436bb5d4ab88d9fe1647d70d02c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:16.154802 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-24932e38-5538-4592-95db-4ae37c427651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a83436bb5d4ab88d9fe1647d70d02c'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:16.166614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1332/2649] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:45:15 2022] DELETE /identity/v3/users/d1a83436bb5d4ab88d9fe1647d70d02c => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:16.174308 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13de28b76d5b45dbbd38a535b5eee13d', 'request_id': 'req-52cfa916-c545-473b-812f-2ba8dd3e50ed'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:16.185175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13de28b76d5b45dbbd38a535b5eee13d', 'request_id': 'req-52cfa916-c545-473b-812f-2ba8dd3e50ed'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:16.445618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13de28b76d5b45dbbd38a535b5eee13d', 'request_id': 'req-52cfa916-c545-473b-812f-2ba8dd3e50ed'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:16.458288 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] The token cache is being invalidate because project 13de28b76d5b45dbbd38a535b5eee13d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:16.459331 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:16.459331 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:16.460842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1318/2650] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:45:15 2022] DELETE /identity/v3/projects/13de28b76d5b45dbbd38a535b5eee13d => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:16.466297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111d6aa-1629-4643-a5c3-4d6044b69992 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:16.466814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111d6aa-1629-4643-a5c3-4d6044b69992 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:16.466896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111d6aa-1629-4643-a5c3-4d6044b69992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:16.488197 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-9111d6aa-1629-4643-a5c3-4d6044b69992 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:16.490213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9111d6aa-1629-4643-a5c3-4d6044b69992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:16.513925 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:16.516572 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:16.577524 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1333/2651] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:45:16.583518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b4104-dfe9-43bd-951f-f2d5081c9050 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:16.583921 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b4104-dfe9-43bd-951f-f2d5081c9050 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:16.584247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b4104-dfe9-43bd-951f-f2d5081c9050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:16.611100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-870b4104-dfe9-43bd-951f-f2d5081c9050 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:16.619954 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-870b4104-dfe9-43bd-951f-f2d5081c9050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:16.628520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1334/2652] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:16.629900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b4104-dfe9-43bd-951f-f2d5081c9050 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:16.641191 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b4104-dfe9-43bd-951f-f2d5081c9050 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:16.654081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfa916-c545-473b-812f-2ba8dd3e50ed admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:16.658002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b311b-7b31-4d9c-8fe2-c2dc780b62a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:16.659969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b311b-7b31-4d9c-8fe2-c2dc780b62a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:16.659969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b311b-7b31-4d9c-8fe2-c2dc780b62a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:16.660969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:16.661069 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b311b-7b31-4d9c-8fe2-c2dc780b62a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:16.661156 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:16.661235 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b311b-7b31-4d9c-8fe2-c2dc780b62a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:45:16.661317 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:16.661955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b311b-7b31-4d9c-8fe2-c2dc780b62a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:16.662040 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2 admin admin] PATH_INFO: `/v3/projects/d2bb1cb78c4d4714b33e3a5424c5b31d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:16.662444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b311b-7b31-4d9c-8fe2-c2dc780b62a6 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:16.665751 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2bb1cb78c4d4714b33e3a5424c5b31d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:16.668071 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:16.682270 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1335/2653] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:45:16.683495 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b311b-7b31-4d9c-8fe2-c2dc780b62a6 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:16.705785 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b311b-7b31-4d9c-8fe2-c2dc780b62a6 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:16.745071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69890b-14ff-46a4-9324-5e6bf149e82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:16.751901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69890b-14ff-46a4-9324-5e6bf149e82b admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:16.751901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69890b-14ff-46a4-9324-5e6bf149e82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:16.751901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69890b-14ff-46a4-9324-5e6bf149e82b admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:16.751901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69890b-14ff-46a4-9324-5e6bf149e82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:16.755807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69890b-14ff-46a4-9324-5e6bf149e82b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:16.941812 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bb1cb78c4d4714b33e3a5424c5b31d', 'request_id': 'req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:16.949766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bb1cb78c4d4714b33e3a5424c5b31d', 'request_id': 'req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:16.986627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:17.013059 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1336/2654] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:45:16 2022] POST /identity/v3/projects => generated 367 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:45:17.021489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69890b-14ff-46a4-9324-5e6bf149e82b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:17.082922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bb1cb78c4d4714b33e3a5424c5b31d', 'request_id': 'req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:17.092632 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69890b-14ff-46a4-9324-5e6bf149e82b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:17.095271 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2 admin admin] The token cache is being invalidate because project d2bb1cb78c4d4714b33e3a5424c5b31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:17.095762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:17.096527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-6af8886e-bfde-4e15-b5ce-6128ab2af7e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:17.104376 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d0ce6-263f-488d-9bb2-56929d3ef27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:17.104601 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1319/2655] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:45:16 2022] DELETE /identity/v3/projects/d2bb1cb78c4d4714b33e3a5424c5b31d => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:17.104713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d0ce6-263f-488d-9bb2-56929d3ef27d admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.104713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d0ce6-263f-488d-9bb2-56929d3ef27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.104713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d0ce6-263f-488d-9bb2-56929d3ef27d admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:17.104713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d0ce6-263f-488d-9bb2-56929d3ef27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:17.104713 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d0ce6-263f-488d-9bb2-56929d3ef27d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:17.106385 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce1cf-a779-40bf-a296-86873c09a782 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.106792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce1cf-a779-40bf-a296-86873c09a782 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.106956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ce1cf-a779-40bf-a296-86873c09a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:17.149791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-875ce1cf-a779-40bf-a296-86873c09a782 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:17.151043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-875ce1cf-a779-40bf-a296-86873c09a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:17.160365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1320/2656] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:17.161624 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce1cf-a779-40bf-a296-86873c09a782 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:17.166675 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-875ce1cf-a779-40bf-a296-86873c09a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:17.181122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ce1cf-a779-40bf-a296-86873c09a782 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:17.186427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:17.187081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.187560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.188004 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] PATH_INFO: `/v3/projects/96008971375e4cfb9bc353ee4fb2043e` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:17.189172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] RBAC: Authorizing `identity:delete_project(project_id=96008971375e4cfb9bc353ee4fb2043e)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:17.191774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:17.285516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1337/2657] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:45:17 2022] POST /identity/v3/users => generated 284 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:45:17.286889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1a90-9ed6-4542-9a63-18f14ca49923 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.287175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1a90-9ed6-4542-9a63-18f14ca49923 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.287452 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb1a90-9ed6-4542-9a63-18f14ca49923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:17.310361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-e9bb1a90-9ed6-4542-9a63-18f14ca49923 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:17.311665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e9bb1a90-9ed6-4542-9a63-18f14ca49923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:17.321218 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1338/2658] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:17.322137 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb1a90-9ed6-4542-9a63-18f14ca49923 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:17.328035 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e9bb1a90-9ed6-4542-9a63-18f14ca49923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:17.341469 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb1a90-9ed6-4542-9a63-18f14ca49923 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:17.347326 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9425049-9c5e-49df-9122-925d908a7c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:17.348156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9425049-9c5e-49df-9122-925d908a7c21 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.348624 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9425049-9c5e-49df-9122-925d908a7c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.349010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9425049-9c5e-49df-9122-925d908a7c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:17.350017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9425049-9c5e-49df-9122-925d908a7c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:17.351669 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9425049-9c5e-49df-9122-925d908a7c21 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:17.366263 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1339/2659] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:45:17.366263 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9425049-9c5e-49df-9122-925d908a7c21 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:17.374004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9425049-9c5e-49df-9122-925d908a7c21 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:17.383225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2792ce9-b3ce-4858-842f-c4b7d92ef262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:17.402318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2792ce9-b3ce-4858-842f-c4b7d92ef262 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.402318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2792ce9-b3ce-4858-842f-c4b7d92ef262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.402318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2792ce9-b3ce-4858-842f-c4b7d92ef262 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:17.402318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2792ce9-b3ce-4858-842f-c4b7d92ef262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:45:17.402318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2792ce9-b3ce-4858-842f-c4b7d92ef262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:17.402318 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2792ce9-b3ce-4858-842f-c4b7d92ef262 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:17.406341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1340/2660] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:45:17.407619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2792ce9-b3ce-4858-842f-c4b7d92ef262 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:17.418432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96008971375e4cfb9bc353ee4fb2043e', 'request_id': 'req-4ebbe499-cc21-4f00-a7b5-7658bcee95af'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:17.424601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2792ce9-b3ce-4858-842f-c4b7d92ef262 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:17.425313 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96008971375e4cfb9bc353ee4fb2043e', 'request_id': 'req-4ebbe499-cc21-4f00-a7b5-7658bcee95af'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:17.490361 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cc543-155d-4d3a-ae39-a222b68253f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:17.490969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cc543-155d-4d3a-ae39-a222b68253f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.491210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cc543-155d-4d3a-ae39-a222b68253f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.491548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cc543-155d-4d3a-ae39-a222b68253f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:17.494126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cc543-155d-4d3a-ae39-a222b68253f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:17.494290 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4cc543-155d-4d3a-ae39-a222b68253f5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:17.517415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1341/2661] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:45:17.518307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cc543-155d-4d3a-ae39-a222b68253f5 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:17.530872 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cc543-155d-4d3a-ae39-a222b68253f5 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:17.535783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d787c7-bb9c-408a-bed4-16e8f6cd892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:17.536396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d787c7-bb9c-408a-bed4-16e8f6cd892f admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.536671 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d787c7-bb9c-408a-bed4-16e8f6cd892f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.536940 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d787c7-bb9c-408a-bed4-16e8f6cd892f admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:17.537600 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d787c7-bb9c-408a-bed4-16e8f6cd892f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:17.539504 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d787c7-bb9c-408a-bed4-16e8f6cd892f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:17.587761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96008971375e4cfb9bc353ee4fb2043e', 'request_id': 'req-4ebbe499-cc21-4f00-a7b5-7658bcee95af'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:17.603056 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] The token cache is being invalidate because project 96008971375e4cfb9bc353ee4fb2043e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:17.603927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:17.604802 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:17.619680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1321/2662] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:45:17 2022] DELETE /identity/v3/projects/96008971375e4cfb9bc353ee4fb2043e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:17.619680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:17.619680 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:17.628716 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe499-cc21-4f00-a7b5-7658bcee95af admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:17.633936 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aad67-3c78-457e-ab39-1239cebbbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:17.634615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aad67-3c78-457e-ab39-1239cebbbdc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.634899 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aad67-3c78-457e-ab39-1239cebbbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.635179 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aad67-3c78-457e-ab39-1239cebbbdc6 admin admin] PATH_INFO: `/v3/projects/2947c28abd444fdebb5bec54dc2af29f/users/34b1deac363a4b208d1a87cfb555f6ed/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:17.653610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aad67-3c78-457e-ab39-1239cebbbdc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2947c28abd444fdebb5bec54dc2af29f, user_id=34b1deac363a4b208d1a87cfb555f6ed, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:17.657284 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aad67-3c78-457e-ab39-1239cebbbdc6 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:17.750253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1342/2663] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:45:17 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:45:17.751653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27661ef-b247-4a76-a9ac-43e2235527cd None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.751970 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27661ef-b247-4a76-a9ac-43e2235527cd None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.752227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27661ef-b247-4a76-a9ac-43e2235527cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:17.779880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-b27661ef-b247-4a76-a9ac-43e2235527cd None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:17.781342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b27661ef-b247-4a76-a9ac-43e2235527cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:17.841186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1322/2664] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:45:17 2022] PUT /identity/v3/projects/2947c28abd444fdebb5bec54dc2af29f/users/34b1deac363a4b208d1a87cfb555f6ed/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:17.842458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aad67-3c78-457e-ab39-1239cebbbdc6 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:17.844499 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-070aad67-3c78-457e-ab39-1239cebbbdc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:17.863897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1343/2665] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:17.865419 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34105f-4582-4591-ab42-91e9c505f2e9 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.865538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34105f-4582-4591-ab42-91e9c505f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.865744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34105f-4582-4591-ab42-91e9c505f2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:17.914735 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-4e34105f-4582-4591-ab42-91e9c505f2e9 None None] MFA Rules not processed for user `34b1deac363a4b208d1a87cfb555f6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:17.914735 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-4e34105f-4582-4591-ab42-91e9c505f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:17.920661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aad67-3c78-457e-ab39-1239cebbbdc6 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:17.928327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd5a16-f35e-4a99-8d3a-983faa6b55d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:17.929322 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd5a16-f35e-4a99-8d3a-983faa6b55d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.929853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd5a16-f35e-4a99-8d3a-983faa6b55d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.930347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd5a16-f35e-4a99-8d3a-983faa6b55d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:17.932104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd5a16-f35e-4a99-8d3a-983faa6b55d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:17.934497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd5a16-f35e-4a99-8d3a-983faa6b55d5 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:17.985135 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1344/2666] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:17.986494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb61d-5c75-42d2-a9f7-3ef52a9e7617 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:17.986781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb61d-5c75-42d2-a9f7-3ef52a9e7617 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:17.987051 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb61d-5c75-42d2-a9f7-3ef52a9e7617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.008445 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-99aeb61d-5c75-42d2-a9f7-3ef52a9e7617 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:18.013336 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-99aeb61d-5c75-42d2-a9f7-3ef52a9e7617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:18.018933 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1345/2667] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:18.024827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeb61d-5c75-42d2-a9f7-3ef52a9e7617 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:18.039536 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeb61d-5c75-42d2-a9f7-3ef52a9e7617 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:18.048712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46e3ae-06b4-4280-b9ca-7a9458a7ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:18.049355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46e3ae-06b4-4280-b9ca-7a9458a7ba0d admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:18.049661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46e3ae-06b4-4280-b9ca-7a9458a7ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:18.049941 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46e3ae-06b4-4280-b9ca-7a9458a7ba0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.050611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46e3ae-06b4-4280-b9ca-7a9458a7ba0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:45:18.051874 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46e3ae-06b4-4280-b9ca-7a9458a7ba0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:18.054601 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46e3ae-06b4-4280-b9ca-7a9458a7ba0d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:18.075746 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1346/2668] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:45:18.079064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46e3ae-06b4-4280-b9ca-7a9458a7ba0d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:18.092805 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46e3ae-06b4-4280-b9ca-7a9458a7ba0d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:18.098854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cff48-409c-4407-a9a5-dad4a91f6b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:18.099538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cff48-409c-4407-a9a5-dad4a91f6b4b admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:18.099817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cff48-409c-4407-a9a5-dad4a91f6b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:18.100072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516cff48-409c-4407-a9a5-dad4a91f6b4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.100704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cff48-409c-4407-a9a5-dad4a91f6b4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:18.102997 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516cff48-409c-4407-a9a5-dad4a91f6b4b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:18.109832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1323/2669] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:45:17 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:45:18.123295 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd5a16-f35e-4a99-8d3a-983faa6b55d5 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:18.140573 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd5a16-f35e-4a99-8d3a-983faa6b55d5 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:18.156145 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86081411-ffb5-4fa8-9c5a-26408746e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:18.156924 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86081411-ffb5-4fa8-9c5a-26408746e3ad admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:18.157497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86081411-ffb5-4fa8-9c5a-26408746e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:18.158015 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86081411-ffb5-4fa8-9c5a-26408746e3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.158908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86081411-ffb5-4fa8-9c5a-26408746e3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:18.162199 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86081411-ffb5-4fa8-9c5a-26408746e3ad admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:18.178423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1324/2670] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:45:18.181089 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86081411-ffb5-4fa8-9c5a-26408746e3ad admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:18.191559 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86081411-ffb5-4fa8-9c5a-26408746e3ad admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:18.196870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a13d3b-1c95-48e6-aa88-1d9e4036abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:18.197608 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a13d3b-1c95-48e6-aa88-1d9e4036abe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:18.197991 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a13d3b-1c95-48e6-aa88-1d9e4036abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:18.198167 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a13d3b-1c95-48e6-aa88-1d9e4036abe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.198819 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a13d3b-1c95-48e6-aa88-1d9e4036abe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:18.200563 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a13d3b-1c95-48e6-aa88-1d9e4036abe7 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:18.212815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1325/2671] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:45:18.217291 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a13d3b-1c95-48e6-aa88-1d9e4036abe7 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:18.235505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a13d3b-1c95-48e6-aa88-1d9e4036abe7 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:18.242344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3ff54-0c2e-466f-88e5-eefe73696daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:18.243280 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3ff54-0c2e-466f-88e5-eefe73696daf admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:18.243649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3ff54-0c2e-466f-88e5-eefe73696daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:18.244013 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3ff54-0c2e-466f-88e5-eefe73696daf admin admin] PATH_INFO: `/v3/projects/184c772ed91642dd9079a50df6162fb1/users/200142f258be460086f6ca504625eafb/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.265947 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3ff54-0c2e-466f-88e5-eefe73696daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=184c772ed91642dd9079a50df6162fb1, user_id=200142f258be460086f6ca504625eafb, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:18.268136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3ff54-0c2e-466f-88e5-eefe73696daf admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:18.278164 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1347/2672] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:45:18 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:45:18.281158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cff48-409c-4407-a9a5-dad4a91f6b4b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:18.350258 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516cff48-409c-4407-a9a5-dad4a91f6b4b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:18.355294 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b1aaa-f4c7-4c88-8a96-563be4785aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:18.356521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b1aaa-f4c7-4c88-8a96-563be4785aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:18.356521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b1aaa-f4c7-4c88-8a96-563be4785aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:18.356521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b1aaa-f4c7-4c88-8a96-563be4785aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.357095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b1aaa-f4c7-4c88-8a96-563be4785aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:18.359260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b1aaa-f4c7-4c88-8a96-563be4785aa3 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:18.440163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1326/2673] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:45:18 2022] PUT /identity/v3/projects/184c772ed91642dd9079a50df6162fb1/users/200142f258be460086f6ca504625eafb/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:45:18.454017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553a07c-7d0e-493f-92d6-30aa400d2aa0 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:18.454231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553a07c-7d0e-493f-92d6-30aa400d2aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:18.458421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553a07c-7d0e-493f-92d6-30aa400d2aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.499046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-5553a07c-7d0e-493f-92d6-30aa400d2aa0 None None] MFA Rules not processed for user `200142f258be460086f6ca504625eafb`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:18.500540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5553a07c-7d0e-493f-92d6-30aa400d2aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:18.530919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1348/2674] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:45:18 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:45:18.535885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b1aaa-f4c7-4c88-8a96-563be4785aa3 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:18.547058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b1aaa-f4c7-4c88-8a96-563be4785aa3 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:18.584021 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1327/2675] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:18.597744 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553a07c-7d0e-493f-92d6-30aa400d2aa0 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:18.601299 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5553a07c-7d0e-493f-92d6-30aa400d2aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:18.628232 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62841659-5924-4573-a818-645f1b93cdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:18.629649 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62841659-5924-4573-a818-645f1b93cdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:18.629932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62841659-5924-4573-a818-645f1b93cdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:18.630210 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62841659-5924-4573-a818-645f1b93cdc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.630871 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62841659-5924-4573-a818-645f1b93cdc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:18.632539 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62841659-5924-4573-a818-645f1b93cdc3 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:18.651195 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1349/2676] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:45:18.653041 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62841659-5924-4573-a818-645f1b93cdc3 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:18.664963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62841659-5924-4573-a818-645f1b93cdc3 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:18.670066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908a86-9dc4-4ec7-a96e-fa995b924e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:18.670685 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908a86-9dc4-4ec7-a96e-fa995b924e5c admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:18.670972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908a86-9dc4-4ec7-a96e-fa995b924e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:18.671276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1908a86-9dc4-4ec7-a96e-fa995b924e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.671910 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908a86-9dc4-4ec7-a96e-fa995b924e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:18.673667 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1908a86-9dc4-4ec7-a96e-fa995b924e5c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:18.678698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553a07c-7d0e-493f-92d6-30aa400d2aa0 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:18.683196 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e4ae-8dde-4b5f-848b-af6d2bcc88c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:18.684058 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e4ae-8dde-4b5f-848b-af6d2bcc88c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:18.684529 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e4ae-8dde-4b5f-848b-af6d2bcc88c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:18.684986 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e4ae-8dde-4b5f-848b-af6d2bcc88c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.685113 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1350/2677] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:45:18.689469 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908a86-9dc4-4ec7-a96e-fa995b924e5c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:18.695835 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2e4ae-8dde-4b5f-848b-af6d2bcc88c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:18.697494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2e4ae-8dde-4b5f-848b-af6d2bcc88c2 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:18.700444 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1908a86-9dc4-4ec7-a96e-fa995b924e5c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:18.707182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baecd47-67e1-49a6-9ee9-2cd849454b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:18.707886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baecd47-67e1-49a6-9ee9-2cd849454b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:18.708231 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baecd47-67e1-49a6-9ee9-2cd849454b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:18.708436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baecd47-67e1-49a6-9ee9-2cd849454b2d admin admin] PATH_INFO: `/v3/projects/1bcbb65929ac4eb38a4c5d9453f6c15f/users/ef02f05272274dd88fb669983a921103/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.716262 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1328/2678] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:45:18.732922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baecd47-67e1-49a6-9ee9-2cd849454b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bcbb65929ac4eb38a4c5d9453f6c15f, user_id=ef02f05272274dd88fb669983a921103, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:18.735778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baecd47-67e1-49a6-9ee9-2cd849454b2d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:18.916801 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:18.923391 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1351/2679] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:45:18 2022] PUT /identity/v3/projects/1bcbb65929ac4eb38a4c5d9453f6c15f/users/ef02f05272274dd88fb669983a921103/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:45:18.935335 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78b79-0416-41ef-ae7b-ab8a17e9ebcd None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:18.935619 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78b79-0416-41ef-ae7b-ab8a17e9ebcd None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:18.935897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a78b79-0416-41ef-ae7b-ab8a17e9ebcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:18.966502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-b8a78b79-0416-41ef-ae7b-ab8a17e9ebcd None None] MFA Rules not processed for user `ef02f05272274dd88fb669983a921103`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:18.967756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-b8a78b79-0416-41ef-ae7b-ab8a17e9ebcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:19.064298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1329/2680] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:19.383045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:19.572486 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baecd47-67e1-49a6-9ee9-2cd849454b2d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:19.574264 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1baecd47-67e1-49a6-9ee9-2cd849454b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:19.646519 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baecd47-67e1-49a6-9ee9-2cd849454b2d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:19.651034 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:19.651663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:19.651937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:19.652213 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] PATH_INFO: `/v3/users/c7ceeb2df265458eacb09e98b684ab07` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:19.653341 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ceeb2df265458eacb09e98b684ab07)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:19.655359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:19.968179 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ceeb2df265458eacb09e98b684ab07'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:19.982502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ceeb2df265458eacb09e98b684ab07'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:19.991377 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:19.994390 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ceeb2df265458eacb09e98b684ab07'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:20.122173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ceeb2df265458eacb09e98b684ab07'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:20.122826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ceeb2df265458eacb09e98b684ab07'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:20.130700 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1352/2681] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:45:19 2022] DELETE /identity/v3/users/c7ceeb2df265458eacb09e98b684ab07 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:20.135260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f6ca4-3085-4e6e-bdd9-7a32deecf4f2 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:20.135541 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f6ca4-3085-4e6e-bdd9-7a32deecf4f2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:20.135846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f6ca4-3085-4e6e-bdd9-7a32deecf4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:20.155826 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-aa5f6ca4-3085-4e6e-bdd9-7a32deecf4f2 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:20.157043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-aa5f6ca4-3085-4e6e-bdd9-7a32deecf4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:20.233903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1330/2682] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:20.244518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:20.246917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:20.333588 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30893e9-a5ec-49fa-a540-13cdb998087f admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:20.339022 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0946452-eb43-4b45-8984-e1e978e0c905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:20.339889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0946452-eb43-4b45-8984-e1e978e0c905 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:20.340289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0946452-eb43-4b45-8984-e1e978e0c905 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:20.340752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0946452-eb43-4b45-8984-e1e978e0c905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:20.353857 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0946452-eb43-4b45-8984-e1e978e0c905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:20.355433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0946452-eb43-4b45-8984-e1e978e0c905 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:20.368839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1353/2683] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:45:21.013109 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f6ca4-3085-4e6e-bdd9-7a32deecf4f2 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:21.016215 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-aa5f6ca4-3085-4e6e-bdd9-7a32deecf4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:21.033857 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f6ca4-3085-4e6e-bdd9-7a32deecf4f2 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:21.044661 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:21.045516 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:21.045829 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:21.046228 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] PATH_INFO: `/v3/projects/ce3f0dca006f49caa2a9ce381af91aad` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:21.048044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3f0dca006f49caa2a9ce381af91aad)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:21.050217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:21.351395 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3f0dca006f49caa2a9ce381af91aad', 'request_id': 'req-a4ad7c42-bd6a-439a-aaea-0889142d0443'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:21.357815 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3f0dca006f49caa2a9ce381af91aad', 'request_id': 'req-a4ad7c42-bd6a-439a-aaea-0889142d0443'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:21.496318 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3f0dca006f49caa2a9ce381af91aad', 'request_id': 'req-a4ad7c42-bd6a-439a-aaea-0889142d0443'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:21.512926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] The token cache is being invalidate because project ce3f0dca006f49caa2a9ce381af91aad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:21.514292 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:21.514292 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:21.515861 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1331/2684] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:45:21 2022] DELETE /identity/v3/projects/ce3f0dca006f49caa2a9ce381af91aad => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:45:22.071767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084993f-e33c-44d1-9aa3-3cf4727e4aef None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:22.072979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084993f-e33c-44d1-9aa3-3cf4727e4aef None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:22.072979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084993f-e33c-44d1-9aa3-3cf4727e4aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:22.100608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-2084993f-e33c-44d1-9aa3-3cf4727e4aef None None] MFA Rules not processed for user `200142f258be460086f6ca504625eafb`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:22.101895 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2084993f-e33c-44d1-9aa3-3cf4727e4aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:22.162004 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1354/2685] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:45:23.027511 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:23.083763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:23.085387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:23.167811 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad7c42-bd6a-439a-aaea-0889142d0443 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:23.172590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:23.173227 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:23.173546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:23.173805 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] PATH_INFO: `/v3/users/e0a6477d49864009a09abcf63837edf6` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:23.175138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a6477d49864009a09abcf63837edf6)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:23.178140 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:23.430097 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a6477d49864009a09abcf63837edf6'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:23.438445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a6477d49864009a09abcf63837edf6'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:23.533517 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a6477d49864009a09abcf63837edf6'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:23.534212 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a6477d49864009a09abcf63837edf6'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:23.535542 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a6477d49864009a09abcf63837edf6'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:23.554726 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1332/2686] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:45:23 2022] DELETE /identity/v3/users/e0a6477d49864009a09abcf63837edf6 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:23.559368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946e44d-2204-421e-9711-633ac5c2c469 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:23.559909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946e44d-2204-421e-9711-633ac5c2c469 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:23.560162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946e44d-2204-421e-9711-633ac5c2c469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:23.580360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-0946e44d-2204-421e-9711-633ac5c2c469 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:45:23.582172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0946e44d-2204-421e-9711-633ac5c2c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:23.619670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:23.646417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1355/2687] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:45:23.656155 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:23.657725 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:23.722185 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f147a3-a7f6-4028-a408-efcc526474fd admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:23.727076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532efcb7-9823-4957-884c-4cdf567c36c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:23.727699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532efcb7-9823-4957-884c-4cdf567c36c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:23.727969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532efcb7-9823-4957-884c-4cdf567c36c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:23.728271 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532efcb7-9823-4957-884c-4cdf567c36c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:23.738441 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532efcb7-9823-4957-884c-4cdf567c36c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:23.740131 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532efcb7-9823-4957-884c-4cdf567c36c9 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:23.751908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1333/2688] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:45:24.366852 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946e44d-2204-421e-9711-633ac5c2c469 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:45:24.368400 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0946e44d-2204-421e-9711-633ac5c2c469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:45:24.383048 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946e44d-2204-421e-9711-633ac5c2c469 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:45:24.396253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:45:24.397003 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:45:24.397308 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:45:24.397613 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] PATH_INFO: `/v3/projects/a9d9a98f44784cbf9e58fe0a178412b2` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:45:24.399538 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d9a98f44784cbf9e58fe0a178412b2)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:45:24.402510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:45:24.679404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d9a98f44784cbf9e58fe0a178412b2', 'request_id': 'req-3d6985ea-187c-4d2d-a339-ca3897027984'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:24.831084 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d9a98f44784cbf9e58fe0a178412b2', 'request_id': 'req-3d6985ea-187c-4d2d-a339-ca3897027984'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:24.838415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d9a98f44784cbf9e58fe0a178412b2', 'request_id': 'req-3d6985ea-187c-4d2d-a339-ca3897027984'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:24.853748 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] The token cache is being invalidate because project a9d9a98f44784cbf9e58fe0a178412b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:45:24.862042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:24.862042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:45:24.862042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1356/2689] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:45:24 2022] DELETE /identity/v3/projects/a9d9a98f44784cbf9e58fe0a178412b2 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:45:25.456211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:25.690750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:26.728433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:26.926659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:27.764985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:27.996590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:29.089804 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:29.496119 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:30.528052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:30.994611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:32.033251 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:32.327689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:33.773496 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:34.016521 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:34.528684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:35.322291 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:35.430990 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:35.933794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:36.038166 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:36.870622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:37.019983 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:37.527731 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:38.162226 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:38.276420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:39.205651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:39.704801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:39.890433 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:40.753014 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:40.976500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:41.807772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:41.913507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:42.524489 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:42.682186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:42.981821 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:43.131170 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:43.340930 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:43.928031 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:44.005323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:44.362833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:44.564354 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:44.644972 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:44.728273 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:45.318631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:45.414032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:45.583151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:45.819395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:45.894865 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:46.401808 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:46.493381 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:46.879704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:46.974371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:47.227997 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:47.296048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:47.638762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:47.870641 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:48.078709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:48.153017 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:48.295806 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:48.421949 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:48.465026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:48.565798 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:48.600282 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:48.953188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:49.056503 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:49.353216 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:49.410421 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:49.490381 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:49.524714 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:49.624935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:49.696442 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:49.785646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:49.964358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:50.027631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:50.247880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:50.312860 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:50.467386 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:50.510252 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:50.769675 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:50.817100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:51.344651 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:51.419059 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:51.568305 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:51.639110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:51.810760 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:51.844514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:52.015792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:52.050259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:52.550752 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:52.708019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:52.930442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:52.964502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:53.304789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:53.556589 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:53.591040 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:53.762928 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:53.812747 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:53.914064 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:54.021420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:54.051625 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:54.177674 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:54.236470 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:54.413773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:54.456920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:54.562695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:54.670728 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:54.790658 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:54.911090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:54.953342 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:54.993157 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:55.193712 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:55.240002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:55.312683 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:55.431950 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:55.547423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:56.020008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:56.055888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:56.241635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:56.281978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:56.427311 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:56.457016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:56.582586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:56.607820 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:56.819607 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:56.858907 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:57.056100 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:57.084746 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:57.181545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:57.244701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:57.275967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:57.421600 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:57.451822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:57.587420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:57.616135 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:57.779172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:57.825984 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:57.941785 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:58.061474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:58.099320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:58.224934 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:58.256316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:58.447557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:58.478506 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:58.507302 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:58.664630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:58.699313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:59.030555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:59.091576 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:59.413190 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:59.447491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:59.590439 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:45:59.627238 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:00.104544 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:00.191770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:00.402036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:00.436363 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:00.567759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:00.815998 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:01.044535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:01.219847 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:01.280874 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:01.342176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:01.615780 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:01.655831 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:01.764240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:01.867502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:01.969939 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:02.004460 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:02.135769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:02.170166 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:02.432808 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:02.493897 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:02.819420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:02.862161 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:03.029418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:03.450257 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:03.590678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:03.624671 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:03.779336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:03.810139 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:04.036432 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:04.067189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:04.278770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:04.313277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:04.514275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:04.558465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:04.706792 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:04.739574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:04.927289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:05.044090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:05.219316 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:05.473801 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:05.681698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:05.755716 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:14.475830 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532efcb7-9823-4957-884c-4cdf567c36c9 service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:14.477855 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-532efcb7-9823-4957-884c-4cdf567c36c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:14.545643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:14.551231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532efcb7-9823-4957-884c-4cdf567c36c9 service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:14.606644 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c0505-d8eb-4475-8b9a-493ebd9b69ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:14.607335 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c0505-d8eb-4475-8b9a-493ebd9b69ad service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:14.607622 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c0505-d8eb-4475-8b9a-493ebd9b69ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:14.608360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c0505-d8eb-4475-8b9a-493ebd9b69ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:14.612431 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3e3c0505-d8eb-4475-8b9a-493ebd9b69ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:14.687641 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c0505-d8eb-4475-8b9a-493ebd9b69ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:14.691349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c0505-d8eb-4475-8b9a-493ebd9b69ad service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:14.710319 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1334/2690] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:46:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:46:15.587264 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:24.400955 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:24.402509 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:24.492617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6985ea-187c-4d2d-a339-ca3897027984 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:24.498274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21738f8-77f4-4d36-983b-6e6b1324139b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055823f7760f485eb91266a0d63db602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:24.498946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21738f8-77f4-4d36-983b-6e6b1324139b service placement] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:24.499226 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21738f8-77f4-4d36-983b-6e6b1324139b service placement] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:24.499494 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21738f8-77f4-4d36-983b-6e6b1324139b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:24.501478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a21738f8-77f4-4d36-983b-6e6b1324139b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:24.514506 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21738f8-77f4-4d36-983b-6e6b1324139b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:24.516151 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21738f8-77f4-4d36-983b-6e6b1324139b service placement] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:24.528482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1357/2691] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:46:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:46:24.755522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=48 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:32.269524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c0505-d8eb-4475-8b9a-493ebd9b69ad service cinder] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:32.271102 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3e3c0505-d8eb-4475-8b9a-493ebd9b69ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:32.336898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c0505-d8eb-4475-8b9a-493ebd9b69ad service cinder] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:32.344046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21738f8-77f4-4d36-983b-6e6b1324139b service placement] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:32.345519 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ca391-9379-4d80-987f-d79c4bd2f652 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c596e424ab8e4637bae1721488c9fcc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:32.346162 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ca391-9379-4d80-987f-d79c4bd2f652 service glance] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:32.346317 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a21738f8-77f4-4d36-983b-6e6b1324139b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:32.346482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ca391-9379-4d80-987f-d79c4bd2f652 service glance] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:32.346707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ca391-9379-4d80-987f-d79c4bd2f652 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:32.348582 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bd7ca391-9379-4d80-987f-d79c4bd2f652 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:32.361416 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21738f8-77f4-4d36-983b-6e6b1324139b service placement] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:32.365901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0485ef-f147-4c35-946d-d2ad406592c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c596e424ab8e4637bae1721488c9fcc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:32.370407 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0485ef-f147-4c35-946d-d2ad406592c9 service glance] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:32.372024 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0485ef-f147-4c35-946d-d2ad406592c9 service glance] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:32.372552 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0485ef-f147-4c35-946d-d2ad406592c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:32.374974 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2d0485ef-f147-4c35-946d-d2ad406592c9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:32.452547 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ca391-9379-4d80-987f-d79c4bd2f652 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:32.452547 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ca391-9379-4d80-987f-d79c4bd2f652 service glance] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:32.462388 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1335/2692] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:46:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:46:32.486798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0485ef-f147-4c35-946d-d2ad406592c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:32.489302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0485ef-f147-4c35-946d-d2ad406592c9 service glance] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:32.513455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1358/2693] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:46:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:46:32.682009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ca391-9379-4d80-987f-d79c4bd2f652 service glance] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:32.683764 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bd7ca391-9379-4d80-987f-d79c4bd2f652 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:32.802745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ca391-9379-4d80-987f-d79c4bd2f652 service glance] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:32.812070 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:32.812836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:32.813190 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:32.813773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] PATH_INFO: `/v3/users/e594e1b3caa54f21b2e651b0e8a91e46` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:32.816296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e594e1b3caa54f21b2e651b0e8a91e46)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:32.818758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:33.133026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d867e-fcb2-444f-894a-24382f019e84 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:33.133899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d867e-fcb2-444f-894a-24382f019e84 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:33.134598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d867e-fcb2-444f-894a-24382f019e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:33.136369 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e594e1b3caa54f21b2e651b0e8a91e46'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:33.156922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e594e1b3caa54f21b2e651b0e8a91e46'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:33.160976 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:33.169058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-558d867e-fcb2-444f-894a-24382f019e84 None None] MFA Rules not processed for user `eb75c0fb10484f3d80813962a4283b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:33.171224 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-558d867e-fcb2-444f-894a-24382f019e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:33.265347 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1359/2694] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:46:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:46:33.280129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e594e1b3caa54f21b2e651b0e8a91e46'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:33.280129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e594e1b3caa54f21b2e651b0e8a91e46'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:33.280129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e594e1b3caa54f21b2e651b0e8a91e46'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:33.320138 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1336/2695] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:46:32 2022] DELETE /identity/v3/users/e594e1b3caa54f21b2e651b0e8a91e46 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:46:33.320468 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d867e-fcb2-444f-894a-24382f019e84 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:33.322396 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-558d867e-fcb2-444f-894a-24382f019e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:33.394650 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:33.437563 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d867e-fcb2-444f-894a-24382f019e84 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:33.523449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0c269-f59c-4b5f-af75-dbee746a6907 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a0d07b79212443480c87f4a4ff3ca00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:33.524161 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0c269-f59c-4b5f-af75-dbee746a6907 service swift] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:33.524451 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0c269-f59c-4b5f-af75-dbee746a6907 service swift] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:33.524732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0c269-f59c-4b5f-af75-dbee746a6907 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:33.527138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-34f0c269-f59c-4b5f-af75-dbee746a6907 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:33.622565 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0c269-f59c-4b5f-af75-dbee746a6907 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:33.625579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0c269-f59c-4b5f-af75-dbee746a6907 service swift] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:33.642430 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1360/2696] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Sep 1 05:46:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:46:33.686769 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:33.687581 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:33.775725 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b737339-ecfe-4860-91ce-ef170a20d259 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:33.781593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef2da-8301-45c6-9bea-686835e7de76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055823f7760f485eb91266a0d63db602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:33.782753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef2da-8301-45c6-9bea-686835e7de76 service placement] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:33.783033 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef2da-8301-45c6-9bea-686835e7de76 service placement] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:33.783301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef2da-8301-45c6-9bea-686835e7de76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:33.786275 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-391ef2da-8301-45c6-9bea-686835e7de76 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:33.814099 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ef2da-8301-45c6-9bea-686835e7de76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:33.814099 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ef2da-8301-45c6-9bea-686835e7de76 service placement] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:33.817568 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0c269-f59c-4b5f-af75-dbee746a6907 service swift] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:33.817852 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-34f0c269-f59c-4b5f-af75-dbee746a6907 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:33.826615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1337/2697] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:46:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:46:33.960466 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0c269-f59c-4b5f-af75-dbee746a6907 service swift] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:33.966010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfe5d4-2294-428a-8adb-071ee39660f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:33.966666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfe5d4-2294-428a-8adb-071ee39660f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:33.967193 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfe5d4-2294-428a-8adb-071ee39660f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:33.967368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfe5d4-2294-428a-8adb-071ee39660f8 admin admin] PATH_INFO: `/v3/projects/c8d18d7c412e40c895e66b154cec9603` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:33.968749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfe5d4-2294-428a-8adb-071ee39660f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d18d7c412e40c895e66b154cec9603)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:33.971491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfe5d4-2294-428a-8adb-071ee39660f8 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:34.003932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:34.273262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7bdfe5d4-2294-428a-8adb-071ee39660f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d18d7c412e40c895e66b154cec9603', 'request_id': 'req-7bdfe5d4-2294-428a-8adb-071ee39660f8'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:34.363704 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7bdfe5d4-2294-428a-8adb-071ee39660f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d18d7c412e40c895e66b154cec9603', 'request_id': 'req-7bdfe5d4-2294-428a-8adb-071ee39660f8'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:34.374156 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7bdfe5d4-2294-428a-8adb-071ee39660f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d18d7c412e40c895e66b154cec9603', 'request_id': 'req-7bdfe5d4-2294-428a-8adb-071ee39660f8'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:34.388192 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7bdfe5d4-2294-428a-8adb-071ee39660f8 admin admin] The token cache is being invalidate because project c8d18d7c412e40c895e66b154cec9603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:46:34.388487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7bdfe5d4-2294-428a-8adb-071ee39660f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:34.389162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-7bdfe5d4-2294-428a-8adb-071ee39660f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:34.390685 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1361/2698] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:46:33 2022] DELETE /identity/v3/projects/c8d18d7c412e40c895e66b154cec9603 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:46:34.396134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef2da-8301-45c6-9bea-686835e7de76 service placement] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:34.408337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef2da-8301-45c6-9bea-686835e7de76 service placement] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:34.474081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:34.474724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:34.475260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:34.475539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] PATH_INFO: `/v3/users/0364779e8b46410a99903cea715403a5` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:34.476750 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0364779e8b46410a99903cea715403a5)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:34.479151 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:34.768524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0364779e8b46410a99903cea715403a5'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:34.785320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0364779e8b46410a99903cea715403a5'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:34.907170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0364779e8b46410a99903cea715403a5'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:34.909445 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0364779e8b46410a99903cea715403a5'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:34.910170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0364779e8b46410a99903cea715403a5'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:34.913575 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:34.939685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1338/2699] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:46:34 2022] DELETE /identity/v3/users/0364779e8b46410a99903cea715403a5 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:46:35.174733 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378da40-b330-4143-9fa1-339b7838a705 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:35.175621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378da40-b330-4143-9fa1-339b7838a705 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:35.175621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378da40-b330-4143-9fa1-339b7838a705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:35.216368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-2378da40-b330-4143-9fa1-339b7838a705 None None] MFA Rules not processed for user `eb75c0fb10484f3d80813962a4283b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:35.216368 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2378da40-b330-4143-9fa1-339b7838a705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:35.308971 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1362/2700] 10.222.0.48 () {58 vars in 967 bytes} [Thu Sep 1 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:46:35.327265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:35.329814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:35.383102 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378da40-b330-4143-9fa1-339b7838a705 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:35.384773 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-2378da40-b330-4143-9fa1-339b7838a705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:35.430153 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5b770-abfe-48d6-84f1-ccacc3ff672d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:35.436507 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca8d79-2b2e-477c-8065-cb67edc42277 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a0d07b79212443480c87f4a4ff3ca00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:35.437259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca8d79-2b2e-477c-8065-cb67edc42277 service swift] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:35.441624 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca8d79-2b2e-477c-8065-cb67edc42277 service swift] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:35.441624 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca8d79-2b2e-477c-8065-cb67edc42277 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:35.449780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca8d79-2b2e-477c-8065-cb67edc42277 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:35.451545 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca8d79-2b2e-477c-8065-cb67edc42277 service swift] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:35.463028 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1339/2701] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Sep 1 05:46:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:46:35.537147 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378da40-b330-4143-9fa1-339b7838a705 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:35.543103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733680d-5146-4f93-b211-fb12bb54b901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:35.543798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733680d-5146-4f93-b211-fb12bb54b901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:35.544072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733680d-5146-4f93-b211-fb12bb54b901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:35.544351 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733680d-5146-4f93-b211-fb12bb54b901 admin admin] PATH_INFO: `/v3/projects/0d86d94d51044341adbe915b563a32d4` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:35.546042 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733680d-5146-4f93-b211-fb12bb54b901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d86d94d51044341adbe915b563a32d4)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:35.549425 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733680d-5146-4f93-b211-fb12bb54b901 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:35.754378 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5733680d-5146-4f93-b211-fb12bb54b901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d86d94d51044341adbe915b563a32d4', 'request_id': 'req-5733680d-5146-4f93-b211-fb12bb54b901'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:35.760932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:35.886625 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5733680d-5146-4f93-b211-fb12bb54b901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d86d94d51044341adbe915b563a32d4', 'request_id': 'req-5733680d-5146-4f93-b211-fb12bb54b901'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:35.895815 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5733680d-5146-4f93-b211-fb12bb54b901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d86d94d51044341adbe915b563a32d4', 'request_id': 'req-5733680d-5146-4f93-b211-fb12bb54b901'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:35.911858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5733680d-5146-4f93-b211-fb12bb54b901 admin admin] The token cache is being invalidate because project 0d86d94d51044341adbe915b563a32d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:46:35.912149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5733680d-5146-4f93-b211-fb12bb54b901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:35.912816 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-5733680d-5146-4f93-b211-fb12bb54b901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:35.914432 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1363/2702] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:46:35 2022] DELETE /identity/v3/projects/0d86d94d51044341adbe915b563a32d4 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:46:35.919681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585c379-4dd2-4b3b-82be-4b92a2c33fcb None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:35.920002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585c379-4dd2-4b3b-82be-4b92a2c33fcb None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:35.920247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585c379-4dd2-4b3b-82be-4b92a2c33fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:35.942775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-8585c379-4dd2-4b3b-82be-4b92a2c33fcb None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:35.944025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8585c379-4dd2-4b3b-82be-4b92a2c33fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:36.029712 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1340/2703] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:46:36.038510 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0812b-779f-446e-bcec-b56ad0cf07f6 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:36.042659 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0812b-779f-446e-bcec-b56ad0cf07f6 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:36.042659 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0812b-779f-446e-bcec-b56ad0cf07f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:36.067365 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-56d0812b-779f-446e-bcec-b56ad0cf07f6 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:36.068621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-56d0812b-779f-446e-bcec-b56ad0cf07f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:36.084020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1364/2704] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:46:36.088378 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585c379-4dd2-4b3b-82be-4b92a2c33fcb None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:36.101029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585c379-4dd2-4b3b-82be-4b92a2c33fcb None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:36.106046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cf42b-b50e-468c-b653-822688a887af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:36.106669 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cf42b-b50e-468c-b653-822688a887af admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:36.106969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cf42b-b50e-468c-b653-822688a887af admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:36.107239 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cf42b-b50e-468c-b653-822688a887af admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:36.107926 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cf42b-b50e-468c-b653-822688a887af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:46:36.108216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cf42b-b50e-468c-b653-822688a887af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:36.109843 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cf42b-b50e-468c-b653-822688a887af admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:36.124037 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1341/2705] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:46:36.128892 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0812b-779f-446e-bcec-b56ad0cf07f6 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:36.144522 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0812b-779f-446e-bcec-b56ad0cf07f6 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:36.151028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de0d57-d6a7-4396-a128-ece036681882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:36.151278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de0d57-d6a7-4396-a128-ece036681882 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:36.151577 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de0d57-d6a7-4396-a128-ece036681882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:36.151854 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de0d57-d6a7-4396-a128-ece036681882 admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:36.152499 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de0d57-d6a7-4396-a128-ece036681882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:36.154612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de0d57-d6a7-4396-a128-ece036681882 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:36.304521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1365/2706] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:46:36 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:46:36.308397 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cf42b-b50e-468c-b653-822688a887af admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:36.333122 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cf42b-b50e-468c-b653-822688a887af admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:36.431358 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf1d7b-c1c7-49df-8e84-82b9e2e4556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:36.432522 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf1d7b-c1c7-49df-8e84-82b9e2e4556c admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:36.432825 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf1d7b-c1c7-49df-8e84-82b9e2e4556c admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:36.433201 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf1d7b-c1c7-49df-8e84-82b9e2e4556c admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:36.434664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf1d7b-c1c7-49df-8e84-82b9e2e4556c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:36.436667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf1d7b-c1c7-49df-8e84-82b9e2e4556c admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:36.448780 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:36.553954 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1342/2707] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:46:36 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:46:36.559029 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de0d57-d6a7-4396-a128-ece036681882 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:36.572603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de0d57-d6a7-4396-a128-ece036681882 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:36.576694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42dd18-f9b0-4e48-b8bb-92bf4d38711e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:36.577172 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42dd18-f9b0-4e48-b8bb-92bf4d38711e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:36.577649 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42dd18-f9b0-4e48-b8bb-92bf4d38711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:36.580644 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02cc6a-5b09-45b8-b2aa-018b838d6099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:36.581631 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02cc6a-5b09-45b8-b2aa-018b838d6099 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:36.582086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02cc6a-5b09-45b8-b2aa-018b838d6099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:36.582539 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02cc6a-5b09-45b8-b2aa-018b838d6099 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:36.583668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02cc6a-5b09-45b8-b2aa-018b838d6099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:36.586805 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02cc6a-5b09-45b8-b2aa-018b838d6099 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:36.605122 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1366/2708] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:46:36.609697 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02cc6a-5b09-45b8-b2aa-018b838d6099 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:36.612664 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-8a42dd18-f9b0-4e48-b8bb-92bf4d38711e None None] MFA Rules not processed for user `eb75c0fb10484f3d80813962a4283b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:36.614803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8a42dd18-f9b0-4e48-b8bb-92bf4d38711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:36.636435 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02cc6a-5b09-45b8-b2aa-018b838d6099 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:36.641821 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dc6bc-e325-4e22-9e76-577c3c17ffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:36.642735 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dc6bc-e325-4e22-9e76-577c3c17ffaa admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:36.643136 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dc6bc-e325-4e22-9e76-577c3c17ffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:36.643477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dc6bc-e325-4e22-9e76-577c3c17ffaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:36.644344 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78dc6bc-e325-4e22-9e76-577c3c17ffaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:36.646073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78dc6bc-e325-4e22-9e76-577c3c17ffaa admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:36.659090 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1367/2709] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:46:36.663661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dc6bc-e325-4e22-9e76-577c3c17ffaa admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:36.677837 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dc6bc-e325-4e22-9e76-577c3c17ffaa admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:36.686275 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92213010-86a7-40ba-b28b-48691ff187f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:36.687390 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92213010-86a7-40ba-b28b-48691ff187f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:36.688052 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92213010-86a7-40ba-b28b-48691ff187f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:36.694507 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92213010-86a7-40ba-b28b-48691ff187f1 admin admin] PATH_INFO: `/v3/projects/f16a471f651c449d866e82634f6483e4/users/8455993d7ec342d0b1e4f3ec899b60fd/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:36.707315 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92213010-86a7-40ba-b28b-48691ff187f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16a471f651c449d866e82634f6483e4, user_id=8455993d7ec342d0b1e4f3ec899b60fd, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:36.711886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92213010-86a7-40ba-b28b-48691ff187f1 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:36.728029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1343/2710] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:46:36.745165 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42dd18-f9b0-4e48-b8bb-92bf4d38711e None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:36.746950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8a42dd18-f9b0-4e48-b8bb-92bf4d38711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:36.838472 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42dd18-f9b0-4e48-b8bb-92bf4d38711e None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:36.844026 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969a0dc-b70f-4824-96aa-72cd4690a82a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a0d07b79212443480c87f4a4ff3ca00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:36.845263 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969a0dc-b70f-4824-96aa-72cd4690a82a service swift] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:36.845458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969a0dc-b70f-4824-96aa-72cd4690a82a service swift] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:36.845720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969a0dc-b70f-4824-96aa-72cd4690a82a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:36.857667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969a0dc-b70f-4824-96aa-72cd4690a82a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:36.861574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969a0dc-b70f-4824-96aa-72cd4690a82a service swift] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:36.877551 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1344/2711] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Sep 1 05:46:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:46:36.900278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1368/2712] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:46:36 2022] PUT /identity/v3/projects/f16a471f651c449d866e82634f6483e4/users/8455993d7ec342d0b1e4f3ec899b60fd/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:46:36.906482 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b41e7-caad-410e-b1e1-d91b29720ad5 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:36.909228 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b41e7-caad-410e-b1e1-d91b29720ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:36.909228 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b41e7-caad-410e-b1e1-d91b29720ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:36.939230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-996b41e7-caad-410e-b1e1-d91b29720ad5 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:36.941357 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-996b41e7-caad-410e-b1e1-d91b29720ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:37.038590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1345/2713] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:46:37.049951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92213010-86a7-40ba-b28b-48691ff187f1 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:37.051886 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-92213010-86a7-40ba-b28b-48691ff187f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:37.147771 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92213010-86a7-40ba-b28b-48691ff187f1 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:37.152036 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4331e68-0afc-473a-b1d5-ce0ce6bb384d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:37.152771 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4331e68-0afc-473a-b1d5-ce0ce6bb384d service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:37.153166 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4331e68-0afc-473a-b1d5-ce0ce6bb384d service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:37.153548 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4331e68-0afc-473a-b1d5-ce0ce6bb384d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:37.166152 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4331e68-0afc-473a-b1d5-ce0ce6bb384d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:37.167866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4331e68-0afc-473a-b1d5-ce0ce6bb384d service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:37.187753 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1369/2714] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:46:39.213793 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca76a6-a9ab-4175-bf02-789bc6cb5472 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:39.214671 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca76a6-a9ab-4175-bf02-789bc6cb5472 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:39.214803 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca76a6-a9ab-4175-bf02-789bc6cb5472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:39.270966 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-89ca76a6-a9ab-4175-bf02-789bc6cb5472 None None] MFA Rules not processed for user `8455993d7ec342d0b1e4f3ec899b60fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:39.273210 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-89ca76a6-a9ab-4175-bf02-789bc6cb5472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:39.296899 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:39.432525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1346/2715] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:46:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:46:39.468826 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4331e68-0afc-473a-b1d5-ce0ce6bb384d service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:39.472073 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-b4331e68-0afc-473a-b1d5-ce0ce6bb384d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:39.572229 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4331e68-0afc-473a-b1d5-ce0ce6bb384d service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:39.579379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa44ea8-da87-42f2-b379-cdb6ccc15756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:39.580434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa44ea8-da87-42f2-b379-cdb6ccc15756 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:39.580911 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa44ea8-da87-42f2-b379-cdb6ccc15756 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:39.581450 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa44ea8-da87-42f2-b379-cdb6ccc15756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:39.597328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa44ea8-da87-42f2-b379-cdb6ccc15756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:39.600554 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa44ea8-da87-42f2-b379-cdb6ccc15756 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:39.617535 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1370/2716] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:46:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:46:40.210289 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4202ade-45ee-4c4a-92f6-e74fff69d981 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:40.210605 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4202ade-45ee-4c4a-92f6-e74fff69d981 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:40.210877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4202ade-45ee-4c4a-92f6-e74fff69d981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:40.258325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-d4202ade-45ee-4c4a-92f6-e74fff69d981 None None] MFA Rules not processed for user `2e7d31c0ec474c428ed932882b989d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:40.259631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d4202ade-45ee-4c4a-92f6-e74fff69d981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:40.267008 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1347/2717] 10.222.0.61 () {58 vars in 1015 bytes} [Thu Sep 1 05:46:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:46:40.281530 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa44ea8-da87-42f2-b379-cdb6ccc15756 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:40.298517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa44ea8-da87-42f2-b379-cdb6ccc15756 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:40.305781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db30974-212f-4391-9f20-99979e995f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:40.306817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db30974-212f-4391-9f20-99979e995f72 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:40.307295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db30974-212f-4391-9f20-99979e995f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:40.307772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db30974-212f-4391-9f20-99979e995f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:40.321772 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db30974-212f-4391-9f20-99979e995f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:40.324678 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db30974-212f-4391-9f20-99979e995f72 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:40.332935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:40.339737 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1371/2718] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:46:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:46:41.458554 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df71f30-8fcc-4f34-baa6-2f9cbe1e8fcf None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:41.459156 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df71f30-8fcc-4f34-baa6-2f9cbe1e8fcf None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:41.459156 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df71f30-8fcc-4f34-baa6-2f9cbe1e8fcf None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:41.460896 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1348/2719] 10.222.0.48 () {54 vars in 921 bytes} [Thu Sep 1 05:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:46:41.470732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef3e0-688e-49df-bada-b56b4926d8b0 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:41.471827 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef3e0-688e-49df-bada-b56b4926d8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:41.472556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef3e0-688e-49df-bada-b56b4926d8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:41.510968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-751ef3e0-688e-49df-bada-b56b4926d8b0 None None] MFA Rules not processed for user `b7e84a5652df4d64aa1fd28f3d5383fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:41.512228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-751ef3e0-688e-49df-bada-b56b4926d8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:41.628172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1372/2720] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Sep 1 05:46:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:46:41.648366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df71f30-8fcc-4f34-baa6-2f9cbe1e8fcf None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:41.650853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8df71f30-8fcc-4f34-baa6-2f9cbe1e8fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:41.675094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df71f30-8fcc-4f34-baa6-2f9cbe1e8fcf None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:41.682311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978a066-ebac-4354-92f8-be0920c1429b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:41.687129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a066-ebac-4354-92f8-be0920c1429b service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:41.687129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a066-ebac-4354-92f8-be0920c1429b service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:41.687129 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978a066-ebac-4354-92f8-be0920c1429b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:41.696004 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978a066-ebac-4354-92f8-be0920c1429b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:41.699416 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978a066-ebac-4354-92f8-be0920c1429b service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:41.720541 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1349/2721] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:46:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:46:42.028992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf6c96-a22f-4dea-9c37-b1c0a0a50b30 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:42.029302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf6c96-a22f-4dea-9c37-b1c0a0a50b30 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:42.029661 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf6c96-a22f-4dea-9c37-b1c0a0a50b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:42.050839 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-8bbf6c96-a22f-4dea-9c37-b1c0a0a50b30 None None] MFA Rules not processed for user `8455993d7ec342d0b1e4f3ec899b60fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:42.052448 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-8bbf6c96-a22f-4dea-9c37-b1c0a0a50b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:42.060836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1373/2722] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:46:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:46:49.118496 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d0890-9a2c-4f9f-b201-95620508e5e9 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:49.119025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d0890-9a2c-4f9f-b201-95620508e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:49.119134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d0890-9a2c-4f9f-b201-95620508e5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:49.142665 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-d98d0890-9a2c-4f9f-b201-95620508e5e9 None None] MFA Rules not processed for user `eb75c0fb10484f3d80813962a4283b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:49.142665 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d98d0890-9a2c-4f9f-b201-95620508e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:49.217740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1350/2723] 10.222.0.48 () {58 vars in 967 bytes} [Thu Sep 1 05:46:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:46:49.235267 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf6c96-a22f-4dea-9c37-b1c0a0a50b30 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:49.327558 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf6c96-a22f-4dea-9c37-b1c0a0a50b30 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:49.335937 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d701b-b34c-4249-83e7-f4e5678748bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a0d07b79212443480c87f4a4ff3ca00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:49.336838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d701b-b34c-4249-83e7-f4e5678748bf service swift] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:49.337129 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d701b-b34c-4249-83e7-f4e5678748bf service swift] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:49.337433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d701b-b34c-4249-83e7-f4e5678748bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:49.350882 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d701b-b34c-4249-83e7-f4e5678748bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:49.352484 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d701b-b34c-4249-83e7-f4e5678748bf service swift] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:49.363868 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1374/2724] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Sep 1 05:46:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:46:50.059203 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286f36c-b3ca-4b5f-8900-595885a8ba18 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:50.059492 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286f36c-b3ca-4b5f-8900-595885a8ba18 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:50.059764 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286f36c-b3ca-4b5f-8900-595885a8ba18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-2286f36c-b3ca-4b5f-8900-595885a8ba18 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:46:50.067391 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:46:50.068384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:46:50.069291 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1351/2725] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:46:50 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 01 05:46:50.102775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e363d6b-03e3-4ac5-bbf8-ad5ae7c8c6cb None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:50.102775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e363d6b-03e3-4ac5-bbf8-ad5ae7c8c6cb None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:50.102775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e363d6b-03e3-4ac5-bbf8-ad5ae7c8c6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:50.121097 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-6e363d6b-03e3-4ac5-bbf8-ad5ae7c8c6cb None None] MFA Rules not processed for user `8455993d7ec342d0b1e4f3ec899b60fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:50.122413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-6e363d6b-03e3-4ac5-bbf8-ad5ae7c8c6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:50.136881 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1375/2726] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:46:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:46:52.426814 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286f36c-b3ca-4b5f-8900-595885a8ba18 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:52.429724 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-2286f36c-b3ca-4b5f-8900-595885a8ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:52.458460 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286f36c-b3ca-4b5f-8900-595885a8ba18 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:52.468784 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:52.471856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:52.472169 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:52.472434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] PATH_INFO: `/v3/users/200142f258be460086f6ca504625eafb` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:52.473711 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] RBAC: Authorizing `identity:delete_user(user_id=200142f258be460086f6ca504625eafb)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:52.479640 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:52.711778 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '200142f258be460086f6ca504625eafb'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:52.721555 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '200142f258be460086f6ca504625eafb'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:52.798497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '200142f258be460086f6ca504625eafb'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:52.800846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '200142f258be460086f6ca504625eafb'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:52.800846 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '200142f258be460086f6ca504625eafb'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:52.817401 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:52.822980 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1352/2727] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:46:52 2022] DELETE /identity/v3/users/200142f258be460086f6ca504625eafb => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:46:52.827852 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267785a2-fd40-4c41-94fe-68dd66ac2009 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:52.828478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267785a2-fd40-4c41-94fe-68dd66ac2009 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:52.828478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267785a2-fd40-4c41-94fe-68dd66ac2009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:52.848878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-267785a2-fd40-4c41-94fe-68dd66ac2009 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:52.850098 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-267785a2-fd40-4c41-94fe-68dd66ac2009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:52.917664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1376/2728] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:46:52.928623 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:52.930080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:53.014360 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955f149-8350-4207-bfd8-da32a5a0f6af admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:53.018407 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6592-23fd-41aa-9f16-6d97adf83d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:53.019022 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6592-23fd-41aa-9f16-6d97adf83d84 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:53.019325 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6592-23fd-41aa-9f16-6d97adf83d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:53.019574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6592-23fd-41aa-9f16-6d97adf83d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:53.030034 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe6592-23fd-41aa-9f16-6d97adf83d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:53.031691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe6592-23fd-41aa-9f16-6d97adf83d84 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:53.042367 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1353/2729] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:46:54.384443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70c087-2b5b-4468-8b95-94741df3416f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:54.385130 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70c087-2b5b-4468-8b95-94741df3416f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:54.385273 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70c087-2b5b-4468-8b95-94741df3416f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-7f70c087-2b5b-4468-8b95-94741df3416f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:46:54.395021 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:46:54.396646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:46:54.397616 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1377/2730] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:46:54 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 13 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 01 05:46:57.573978 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6592-23fd-41aa-9f16-6d97adf83d84 service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:57.575531 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-56fe6592-23fd-41aa-9f16-6d97adf83d84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:57.592339 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6592-23fd-41aa-9f16-6d97adf83d84 service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:57.599992 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:57.601282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:57.601733 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:57.602160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] PATH_INFO: `/v3/users/d6742115bbfd498a8910708d77f9f35e` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:57.603617 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6742115bbfd498a8910708d77f9f35e)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:57.606822 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:57.843525 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6742115bbfd498a8910708d77f9f35e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:57.857973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6742115bbfd498a8910708d77f9f35e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:58.001434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6742115bbfd498a8910708d77f9f35e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:58.001434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6742115bbfd498a8910708d77f9f35e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:58.002258 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6742115bbfd498a8910708d77f9f35e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:58.028409 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1354/2731] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:46:57 2022] DELETE /identity/v3/users/d6742115bbfd498a8910708d77f9f35e => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:46:58.034579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b89d92-9920-4a23-b8a3-05289626f10e None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:58.035188 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b89d92-9920-4a23-b8a3-05289626f10e None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:58.035537 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b89d92-9920-4a23-b8a3-05289626f10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:58.058603 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-82b89d92-9920-4a23-b8a3-05289626f10e None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:58.059927 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-82b89d92-9920-4a23-b8a3-05289626f10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:58.065082 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=100 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:58.142930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1378/2732] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:46:58.154364 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:58.162048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:58.222586 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89bedc-7630-4aaa-b01d-90b816795141 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:58.226527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8c7a4-f285-4046-8d19-97b636e455af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:58.227142 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8c7a4-f285-4046-8d19-97b636e455af service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:58.227423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8c7a4-f285-4046-8d19-97b636e455af service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:58.227695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8c7a4-f285-4046-8d19-97b636e455af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:58.238427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8c7a4-f285-4046-8d19-97b636e455af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:58.239959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8c7a4-f285-4046-8d19-97b636e455af service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:58.250474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1355/2733] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:46:58.846520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b89d92-9920-4a23-b8a3-05289626f10e None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:58.848397 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-82b89d92-9920-4a23-b8a3-05289626f10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:58.882715 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b89d92-9920-4a23-b8a3-05289626f10e None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:58.901354 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7767cc-9aac-4911-a139-c69a1da6836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:58.902150 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7767cc-9aac-4911-a139-c69a1da6836e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:58.902434 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7767cc-9aac-4911-a139-c69a1da6836e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:58.902709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7767cc-9aac-4911-a139-c69a1da6836e admin admin] PATH_INFO: `/v3/projects/81955c219a284b8cbd089d46d099ce27` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:58.908006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7767cc-9aac-4911-a139-c69a1da6836e admin admin] RBAC: Authorizing `identity:delete_project(project_id=81955c219a284b8cbd089d46d099ce27)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:58.914456 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7767cc-9aac-4911-a139-c69a1da6836e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:59.078198 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-cd7767cc-9aac-4911-a139-c69a1da6836e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81955c219a284b8cbd089d46d099ce27', 'request_id': 'req-cd7767cc-9aac-4911-a139-c69a1da6836e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:59.081228 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e30af0-0fa2-4888-bdba-ae96ba156956 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:59.082156 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e30af0-0fa2-4888-bdba-ae96ba156956 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:59.082539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e30af0-0fa2-4888-bdba-ae96ba156956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:59.107592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-00e30af0-0fa2-4888-bdba-ae96ba156956 None None] MFA Rules not processed for user `eb75c0fb10484f3d80813962a4283b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:59.108854 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-00e30af0-0fa2-4888-bdba-ae96ba156956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:59.123249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:59.178610 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1356/2734] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:46:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:46:59.195204 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e30af0-0fa2-4888-bdba-ae96ba156956 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:59.198852 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-00e30af0-0fa2-4888-bdba-ae96ba156956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:59.209056 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-cd7767cc-9aac-4911-a139-c69a1da6836e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81955c219a284b8cbd089d46d099ce27', 'request_id': 'req-cd7767cc-9aac-4911-a139-c69a1da6836e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:59.216798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-cd7767cc-9aac-4911-a139-c69a1da6836e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81955c219a284b8cbd089d46d099ce27', 'request_id': 'req-cd7767cc-9aac-4911-a139-c69a1da6836e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:59.241723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-cd7767cc-9aac-4911-a139-c69a1da6836e admin admin] The token cache is being invalidate because project 81955c219a284b8cbd089d46d099ce27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:46:59.242066 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-cd7767cc-9aac-4911-a139-c69a1da6836e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:59.243058 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-cd7767cc-9aac-4911-a139-c69a1da6836e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:46:59.245328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1379/2735] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:46:58 2022] DELETE /identity/v3/projects/81955c219a284b8cbd089d46d099ce27 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:46:59.259095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a19b56-72bb-4e66-b86d-0f6c2b79cea2 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:59.261615 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a19b56-72bb-4e66-b86d-0f6c2b79cea2 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:59.262457 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a19b56-72bb-4e66-b86d-0f6c2b79cea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:59.308917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-f2a19b56-72bb-4e66-b86d-0f6c2b79cea2 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:59.310946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f2a19b56-72bb-4e66-b86d-0f6c2b79cea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:59.328079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e30af0-0fa2-4888-bdba-ae96ba156956 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:59.335382 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a8425-19e3-4a24-af9d-08a558601413 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a0d07b79212443480c87f4a4ff3ca00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:59.336025 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a8425-19e3-4a24-af9d-08a558601413 service swift] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:59.336302 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a8425-19e3-4a24-af9d-08a558601413 service swift] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:59.336758 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a8425-19e3-4a24-af9d-08a558601413 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:59.339544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-e38a8425-19e3-4a24-af9d-08a558601413 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:59.355381 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a8425-19e3-4a24-af9d-08a558601413 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:59.357088 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a8425-19e3-4a24-af9d-08a558601413 service swift] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:59.368546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1357/2736] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Sep 1 05:46:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:46:59.396629 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1380/2737] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:46:59.405023 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bd004-009b-4441-962b-bc6ccb9ef3b1 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:59.405336 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bd004-009b-4441-962b-bc6ccb9ef3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:59.405638 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9bd004-009b-4441-962b-bc6ccb9ef3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:59.428782 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-3c9bd004-009b-4441-962b-bc6ccb9ef3b1 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:46:59.430423 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3c9bd004-009b-4441-962b-bc6ccb9ef3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:46:59.440789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1358/2738] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:46:59.445363 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a19b56-72bb-4e66-b86d-0f6c2b79cea2 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:59.459586 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a19b56-72bb-4e66-b86d-0f6c2b79cea2 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:59.467880 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201c9bb-6611-4403-af8d-6678d6c0aa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:59.470521 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201c9bb-6611-4403-af8d-6678d6c0aa88 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:59.471061 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201c9bb-6611-4403-af8d-6678d6c0aa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:59.471643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201c9bb-6611-4403-af8d-6678d6c0aa88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:59.472968 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201c9bb-6611-4403-af8d-6678d6c0aa88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:46:59.473497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201c9bb-6611-4403-af8d-6678d6c0aa88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:59.476857 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f201c9bb-6611-4403-af8d-6678d6c0aa88 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:59.493276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1381/2739] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:46:59.498018 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bd004-009b-4441-962b-bc6ccb9ef3b1 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:59.510313 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9bd004-009b-4441-962b-bc6ccb9ef3b1 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:59.517209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12790bbd-0b7f-4964-95b6-5546fdf6bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:59.518189 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790bbd-0b7f-4964-95b6-5546fdf6bab3 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:59.518653 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790bbd-0b7f-4964-95b6-5546fdf6bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:59.519073 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12790bbd-0b7f-4964-95b6-5546fdf6bab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:59.519903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12790bbd-0b7f-4964-95b6-5546fdf6bab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:59.522120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12790bbd-0b7f-4964-95b6-5546fdf6bab3 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:59.659160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1359/2740] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:46:59 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:46:59.672900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201c9bb-6611-4403-af8d-6678d6c0aa88 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:46:59.686747 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201c9bb-6611-4403-af8d-6678d6c0aa88 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:46:59.712420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:46:59.798516 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec209df-5559-41dd-9941-db4affbb3330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:46:59.799252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec209df-5559-41dd-9941-db4affbb3330 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:46:59.799660 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec209df-5559-41dd-9941-db4affbb3330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:46:59.799930 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec209df-5559-41dd-9941-db4affbb3330 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:46:59.800740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec209df-5559-41dd-9941-db4affbb3330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:46:59.803445 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec209df-5559-41dd-9941-db4affbb3330 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:46:59.987836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1382/2741] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:46:59 2022] POST /identity/v3/users => generated 286 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:46:59.989279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12790bbd-0b7f-4964-95b6-5546fdf6bab3 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:00.006150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12790bbd-0b7f-4964-95b6-5546fdf6bab3 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:00.019393 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13992a16-0245-428d-a3f2-9f6bd8ed855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:00.044868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13992a16-0245-428d-a3f2-9f6bd8ed855a admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:00.044868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13992a16-0245-428d-a3f2-9f6bd8ed855a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:00.044868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13992a16-0245-428d-a3f2-9f6bd8ed855a admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:00.044868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13992a16-0245-428d-a3f2-9f6bd8ed855a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:00.044868 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13992a16-0245-428d-a3f2-9f6bd8ed855a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:00.058747 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1360/2742] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:46:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:47:00.065520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec209df-5559-41dd-9941-db4affbb3330 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:00.080074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec209df-5559-41dd-9941-db4affbb3330 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:00.095261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217192c-4a7f-45ba-825e-b67dcdeac77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:00.105682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217192c-4a7f-45ba-825e-b67dcdeac77e admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:00.105682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217192c-4a7f-45ba-825e-b67dcdeac77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:00.105682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217192c-4a7f-45ba-825e-b67dcdeac77e admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:00.105682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217192c-4a7f-45ba-825e-b67dcdeac77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:00.108065 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217192c-4a7f-45ba-825e-b67dcdeac77e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:00.122637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1383/2743] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:47:00.129402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13992a16-0245-428d-a3f2-9f6bd8ed855a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:00.150048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13992a16-0245-428d-a3f2-9f6bd8ed855a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:00.155574 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa0c33-1405-43b8-8f96-455b7f4c00c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:00.157345 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa0c33-1405-43b8-8f96-455b7f4c00c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:00.157699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa0c33-1405-43b8-8f96-455b7f4c00c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:00.158293 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa0c33-1405-43b8-8f96-455b7f4c00c4 admin admin] PATH_INFO: `/v3/projects/637f6a20cf0647e1aa672202424880a6/users/ff9cd819fbea4a10ae2f0891602e300e/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:00.179225 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa0c33-1405-43b8-8f96-455b7f4c00c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=637f6a20cf0647e1aa672202424880a6, user_id=ff9cd819fbea4a10ae2f0891602e300e, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:00.201738 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa0c33-1405-43b8-8f96-455b7f4c00c4 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:00.404856 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0663a7-7954-4299-a3e9-2575ea009da9 None None] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:00.406093 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0663a7-7954-4299-a3e9-2575ea009da9 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:00.406938 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0663a7-7954-4299-a3e9-2575ea009da9 None None] PATH_INFO: `/` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:00.408533 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1361/2744] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:47:00 2022] PUT /identity/v3/projects/637f6a20cf0647e1aa672202424880a6/users/ff9cd819fbea4a10ae2f0891602e300e/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:00.410144 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1384/2745] 10.222.0.48 () {54 vars in 921 bytes} [Thu Sep 1 05:47:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:47:00.420052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd3ad7-6e40-4914-8f37-d5ad14da6fe2 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:00.420494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd3ad7-6e40-4914-8f37-d5ad14da6fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:00.420728 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd3ad7-6e40-4914-8f37-d5ad14da6fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:00.425233 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f6676-1db8-4350-9ace-dd6099d66e8b None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:00.425865 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f6676-1db8-4350-9ace-dd6099d66e8b None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:00.426436 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f6676-1db8-4350-9ace-dd6099d66e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:00.470646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-da1f6676-1db8-4350-9ace-dd6099d66e8b None None] MFA Rules not processed for user `b7e84a5652df4d64aa1fd28f3d5383fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:00.470646 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-da1f6676-1db8-4350-9ace-dd6099d66e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:00.490419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-a7fd3ad7-6e40-4914-8f37-d5ad14da6fe2 None None] MFA Rules not processed for user `ff9cd819fbea4a10ae2f0891602e300e`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:00.492449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a7fd3ad7-6e40-4914-8f37-d5ad14da6fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:00.552902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:00.596094 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1385/2746] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Sep 1 05:47:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:47:00.659256 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1362/2747] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:00.672286 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f6676-1db8-4350-9ace-dd6099d66e8b None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:00.674966 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-da1f6676-1db8-4350-9ace-dd6099d66e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:00.688334 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd3ad7-6e40-4914-8f37-d5ad14da6fe2 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:00.690188 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a7fd3ad7-6e40-4914-8f37-d5ad14da6fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:00.726079 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd3ad7-6e40-4914-8f37-d5ad14da6fe2 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:00.743687 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f044e9-7f3c-462d-b140-298ceb44a83e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:00.744732 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f044e9-7f3c-462d-b140-298ceb44a83e service nova] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:00.745430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f044e9-7f3c-462d-b140-298ceb44a83e service nova] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:00.745932 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f044e9-7f3c-462d-b140-298ceb44a83e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:00.760677 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f044e9-7f3c-462d-b140-298ceb44a83e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:00.762845 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f044e9-7f3c-462d-b140-298ceb44a83e service nova] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:00.779481 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1363/2748] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:47:00.793750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f6676-1db8-4350-9ace-dd6099d66e8b None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:00.793750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a34fff-9aea-4f28-b4d4-eb8101320720 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:00.793750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a34fff-9aea-4f28-b4d4-eb8101320720 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:00.793750 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a34fff-9aea-4f28-b4d4-eb8101320720 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:00.794244 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a34fff-9aea-4f28-b4d4-eb8101320720 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:00.804869 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a34fff-9aea-4f28-b4d4-eb8101320720 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:00.806945 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a34fff-9aea-4f28-b4d4-eb8101320720 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:00.822023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1386/2749] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:47:00.858174 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f044e9-7f3c-462d-b140-298ceb44a83e service nova] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:00.965740 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f044e9-7f3c-462d-b140-298ceb44a83e service nova] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:00.974568 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:00.975147 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:00.975739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:00.975971 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] PATH_INFO: `/v3/users/ff9cd819fbea4a10ae2f0891602e300e` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:00.977993 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff9cd819fbea4a10ae2f0891602e300e)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:00.982748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:01.760505 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff9cd819fbea4a10ae2f0891602e300e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:01.783813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff9cd819fbea4a10ae2f0891602e300e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:01.966235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff9cd819fbea4a10ae2f0891602e300e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:01.966877 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff9cd819fbea4a10ae2f0891602e300e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:01.967494 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff9cd819fbea4a10ae2f0891602e300e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:02.022015 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1364/2750] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:47:00 2022] DELETE /identity/v3/users/ff9cd819fbea4a10ae2f0891602e300e => generated 0 bytes in 1170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:02.026801 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62d9fc-3c36-48c9-9994-d5ee784b9c98 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:02.032744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62d9fc-3c36-48c9-9994-d5ee784b9c98 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:02.032744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62d9fc-3c36-48c9-9994-d5ee784b9c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:02.055896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-ec62d9fc-3c36-48c9-9994-d5ee784b9c98 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:02.057219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ec62d9fc-3c36-48c9-9994-d5ee784b9c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:02.107686 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:02.210672 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1387/2751] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:02.223851 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:02.226282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:02.347419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:02.379480 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5dfcf3-6d63-49b0-a926-af344129caa9 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:02.392753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b5278-58ac-4de3-9081-f782827d3128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:02.393411 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b5278-58ac-4de3-9081-f782827d3128 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:02.393705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b5278-58ac-4de3-9081-f782827d3128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:02.393982 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b5278-58ac-4de3-9081-f782827d3128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:02.411353 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b5278-58ac-4de3-9081-f782827d3128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:02.414554 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b5278-58ac-4de3-9081-f782827d3128 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:02.428810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1365/2752] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:03.228976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62d9fc-3c36-48c9-9994-d5ee784b9c98 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:03.240790 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ec62d9fc-3c36-48c9-9994-d5ee784b9c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:03.249195 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62d9fc-3c36-48c9-9994-d5ee784b9c98 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:03.254775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:03.255417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:03.255705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:03.256163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e admin admin] PATH_INFO: `/v3/projects/637f6a20cf0647e1aa672202424880a6` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:03.257442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e admin admin] RBAC: Authorizing `identity:delete_project(project_id=637f6a20cf0647e1aa672202424880a6)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:03.259366 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:03.441100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637f6a20cf0647e1aa672202424880a6', 'request_id': 'req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:03.547464 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637f6a20cf0647e1aa672202424880a6', 'request_id': 'req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:03.560158 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637f6a20cf0647e1aa672202424880a6', 'request_id': 'req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:03.592172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e admin admin] The token cache is being invalidate because project 637f6a20cf0647e1aa672202424880a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:47:03.592172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:03.594238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-dd845e7e-f2ca-4cb3-ac6c-77ace397373e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:03.607223 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1388/2753] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:47:03 2022] DELETE /identity/v3/projects/637f6a20cf0647e1aa672202424880a6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:03.612956 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b5278-58ac-4de3-9081-f782827d3128 service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:03.616950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-923b5278-58ac-4de3-9081-f782827d3128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:03.649699 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b5278-58ac-4de3-9081-f782827d3128 service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:03.839438 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:03.840723 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:03.850911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:03.850911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] PATH_INFO: `/v3/users/8c9db80ccc5a4687b8d23516635c68df` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:03.850911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c9db80ccc5a4687b8d23516635c68df)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:03.850911 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:04.176694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c9db80ccc5a4687b8d23516635c68df'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:04.184695 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c9db80ccc5a4687b8d23516635c68df'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:04.386532 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c9db80ccc5a4687b8d23516635c68df'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:04.394365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c9db80ccc5a4687b8d23516635c68df'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:04.394365 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c9db80ccc5a4687b8d23516635c68df'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:04.418543 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1366/2754] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:47:03 2022] DELETE /identity/v3/users/8c9db80ccc5a4687b8d23516635c68df => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:04.424075 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736f189-8d84-45f5-be9a-d5534688d7cb None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:04.424948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736f189-8d84-45f5-be9a-d5534688d7cb None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:04.425417 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736f189-8d84-45f5-be9a-d5534688d7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:04.447579 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5736f189-8d84-45f5-be9a-d5534688d7cb None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:04.451542 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5736f189-8d84-45f5-be9a-d5534688d7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:04.534835 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1389/2755] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:04.541611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:04.543072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:04.632510 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834b4d8-d798-4617-aee1-8f0c42a25691 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:04.637880 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5d13d-28d7-4923-874c-1f05a59e51bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:04.638500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5d13d-28d7-4923-874c-1f05a59e51bd service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:04.638789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5d13d-28d7-4923-874c-1f05a59e51bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:04.639062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5d13d-28d7-4923-874c-1f05a59e51bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:04.657230 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5d13d-28d7-4923-874c-1f05a59e51bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:04.660081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5d13d-28d7-4923-874c-1f05a59e51bd service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:04.684647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1367/2756] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:05.538238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736f189-8d84-45f5-be9a-d5534688d7cb None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:05.539705 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5736f189-8d84-45f5-be9a-d5534688d7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:05.553581 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736f189-8d84-45f5-be9a-d5534688d7cb None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:05.560517 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911df4ab-474b-4f4b-b66a-6b22d686286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:05.561169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df4ab-474b-4f4b-b66a-6b22d686286f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:05.561487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df4ab-474b-4f4b-b66a-6b22d686286f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:05.561768 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911df4ab-474b-4f4b-b66a-6b22d686286f admin admin] PATH_INFO: `/v3/projects/59addc4e6d4c4de6b7f7dec961256b71` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:05.564120 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911df4ab-474b-4f4b-b66a-6b22d686286f admin admin] RBAC: Authorizing `identity:delete_project(project_id=59addc4e6d4c4de6b7f7dec961256b71)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:05.566614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911df4ab-474b-4f4b-b66a-6b22d686286f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:05.758358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-911df4ab-474b-4f4b-b66a-6b22d686286f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59addc4e6d4c4de6b7f7dec961256b71', 'request_id': 'req-911df4ab-474b-4f4b-b66a-6b22d686286f'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:05.770247 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:05.869612 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-911df4ab-474b-4f4b-b66a-6b22d686286f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59addc4e6d4c4de6b7f7dec961256b71', 'request_id': 'req-911df4ab-474b-4f4b-b66a-6b22d686286f'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:05.879666 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-911df4ab-474b-4f4b-b66a-6b22d686286f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59addc4e6d4c4de6b7f7dec961256b71', 'request_id': 'req-911df4ab-474b-4f4b-b66a-6b22d686286f'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:05.896789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-911df4ab-474b-4f4b-b66a-6b22d686286f admin admin] The token cache is being invalidate because project 59addc4e6d4c4de6b7f7dec961256b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:47:05.897159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-911df4ab-474b-4f4b-b66a-6b22d686286f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:05.897946 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-911df4ab-474b-4f4b-b66a-6b22d686286f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:05.899987 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1390/2757] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:47:05 2022] DELETE /identity/v3/projects/59addc4e6d4c4de6b7f7dec961256b71 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:05.905467 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f61d06-cf80-45be-8377-08a36e444da2 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:05.906688 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f61d06-cf80-45be-8377-08a36e444da2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:05.907192 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f61d06-cf80-45be-8377-08a36e444da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:05.922707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:05.930429 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-d0f61d06-cf80-45be-8377-08a36e444da2 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:05.931621 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d0f61d06-cf80-45be-8377-08a36e444da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:06.024898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1368/2758] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:47:06.033698 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00502ecd-3542-4561-a8b0-01331ff2830f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:06.033981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00502ecd-3542-4561-a8b0-01331ff2830f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:06.034260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00502ecd-3542-4561-a8b0-01331ff2830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:06.056302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-00502ecd-3542-4561-a8b0-01331ff2830f None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:06.057566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-00502ecd-3542-4561-a8b0-01331ff2830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:06.067899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1391/2759] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:06.079016 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f61d06-cf80-45be-8377-08a36e444da2 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:06.089645 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f61d06-cf80-45be-8377-08a36e444da2 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:06.095756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27946322-5f0b-452c-9246-6dea50b82d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:06.096478 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27946322-5f0b-452c-9246-6dea50b82d09 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:06.096794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27946322-5f0b-452c-9246-6dea50b82d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:06.097093 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27946322-5f0b-452c-9246-6dea50b82d09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:06.097938 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27946322-5f0b-452c-9246-6dea50b82d09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:47:06.098739 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27946322-5f0b-452c-9246-6dea50b82d09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:06.099975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27946322-5f0b-452c-9246-6dea50b82d09 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:06.121953 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1369/2760] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:47:06.130711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00502ecd-3542-4561-a8b0-01331ff2830f None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:06.147615 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00502ecd-3542-4561-a8b0-01331ff2830f None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:06.157901 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901885f-8fed-497b-820f-f686bad5553f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:06.159159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901885f-8fed-497b-820f-f686bad5553f admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:06.159740 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901885f-8fed-497b-820f-f686bad5553f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:06.160332 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901885f-8fed-497b-820f-f686bad5553f admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:06.161720 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901885f-8fed-497b-820f-f686bad5553f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:06.166195 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901885f-8fed-497b-820f-f686bad5553f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:06.427791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1392/2761] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:47:06 2022] POST /identity/v3/projects => generated 381 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:47:06.433762 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27946322-5f0b-452c-9246-6dea50b82d09 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:06.454615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27946322-5f0b-452c-9246-6dea50b82d09 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:06.557536 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d4e89-dc17-45cb-b183-f4651d8aa66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:06.574897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d4e89-dc17-45cb-b183-f4651d8aa66d admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:06.574897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d4e89-dc17-45cb-b183-f4651d8aa66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:06.574897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d4e89-dc17-45cb-b183-f4651d8aa66d admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:06.574897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d4e89-dc17-45cb-b183-f4651d8aa66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:06.574897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d4e89-dc17-45cb-b183-f4651d8aa66d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:06.724006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1370/2762] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:47:06 2022] POST /identity/v3/users => generated 291 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:47:06.728621 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901885f-8fed-497b-820f-f686bad5553f admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:06.740272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901885f-8fed-497b-820f-f686bad5553f admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:06.749248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ce39d-2efb-4262-b8c2-abe7ddbc6540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:06.750334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ce39d-2efb-4262-b8c2-abe7ddbc6540 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:06.750683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ce39d-2efb-4262-b8c2-abe7ddbc6540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:06.751114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ce39d-2efb-4262-b8c2-abe7ddbc6540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:06.752016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ce39d-2efb-4262-b8c2-abe7ddbc6540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:06.753857 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ce39d-2efb-4262-b8c2-abe7ddbc6540 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:06.772277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1393/2763] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:47:06.773500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d4e89-dc17-45cb-b183-f4651d8aa66d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:06.786995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d4e89-dc17-45cb-b183-f4651d8aa66d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:06.790908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44f6a6-ce5b-486e-94f4-c482a8c1fdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:06.791544 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44f6a6-ce5b-486e-94f4-c482a8c1fdcc admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:06.791829 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44f6a6-ce5b-486e-94f4-c482a8c1fdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:06.792123 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44f6a6-ce5b-486e-94f4-c482a8c1fdcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:06.792810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44f6a6-ce5b-486e-94f4-c482a8c1fdcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:06.794557 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44f6a6-ce5b-486e-94f4-c482a8c1fdcc admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:06.817422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1371/2764] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:47:06.822637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ce39d-2efb-4262-b8c2-abe7ddbc6540 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:06.836195 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ce39d-2efb-4262-b8c2-abe7ddbc6540 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:06.841935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123a37-a35f-4f3a-ac81-c933185c4cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:06.842963 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123a37-a35f-4f3a-ac81-c933185c4cef admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:06.843985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123a37-a35f-4f3a-ac81-c933185c4cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:06.845283 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25123a37-a35f-4f3a-ac81-c933185c4cef admin admin] PATH_INFO: `/v3/projects/f2c233e0846249089c33765e7d827b1b/users/2913d382d0c043ce88b926090a4372ad/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:06.866699 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123a37-a35f-4f3a-ac81-c933185c4cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c233e0846249089c33765e7d827b1b, user_id=2913d382d0c043ce88b926090a4372ad, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:06.869863 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25123a37-a35f-4f3a-ac81-c933185c4cef admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:06.989125 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1394/2765] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:47:06 2022] PUT /identity/v3/projects/f2c233e0846249089c33765e7d827b1b/users/2913d382d0c043ce88b926090a4372ad/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:06.994415 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0937f-d50d-4e3a-bb94-51d4e38f0f7d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:06.994989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0937f-d50d-4e3a-bb94-51d4e38f0f7d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:06.994989 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0937f-d50d-4e3a-bb94-51d4e38f0f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:07.027195 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-5da0937f-d50d-4e3a-bb94-51d4e38f0f7d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:07.032434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5da0937f-d50d-4e3a-bb94-51d4e38f0f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:07.168422 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1372/2766] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:07.181129 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123a37-a35f-4f3a-ac81-c933185c4cef admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:07.183500 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-25123a37-a35f-4f3a-ac81-c933185c4cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:07.283807 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25123a37-a35f-4f3a-ac81-c933185c4cef admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:07.288285 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a19b71-0c42-46c1-8475-b1af75588e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:07.289074 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a19b71-0c42-46c1-8475-b1af75588e60 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:07.289447 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a19b71-0c42-46c1-8475-b1af75588e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:07.290070 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a19b71-0c42-46c1-8475-b1af75588e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:07.310551 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a19b71-0c42-46c1-8475-b1af75588e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:07.312744 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a19b71-0c42-46c1-8475-b1af75588e60 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:07.335899 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1395/2767] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:09.151132 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9581a-2c00-4ffb-b046-54141f2cee7b None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:09.151945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9581a-2c00-4ffb-b046-54141f2cee7b None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:09.151945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9581a-2c00-4ffb-b046-54141f2cee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:09.192836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:09.196682 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-32a9581a-2c00-4ffb-b046-54141f2cee7b None None] MFA Rules not processed for user `2913d382d0c043ce88b926090a4372ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:09.198175 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-32a9581a-2c00-4ffb-b046-54141f2cee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:09.311420 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1373/2768] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:09.326178 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a19b71-0c42-46c1-8475-b1af75588e60 service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:09.331378 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-52a19b71-0c42-46c1-8475-b1af75588e60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:09.413049 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a19b71-0c42-46c1-8475-b1af75588e60 service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:09.417015 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff9257-e219-49d2-ac20-0af893d7865b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:09.417665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff9257-e219-49d2-ac20-0af893d7865b service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:09.417992 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff9257-e219-49d2-ac20-0af893d7865b service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:09.418220 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff9257-e219-49d2-ac20-0af893d7865b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:09.433076 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff9257-e219-49d2-ac20-0af893d7865b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:09.434643 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff9257-e219-49d2-ac20-0af893d7865b service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:09.450064 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1396/2769] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:12.086332 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc46ae-c482-44c8-a526-9f86c199c8f6 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:12.087316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc46ae-c482-44c8-a526-9f86c199c8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:12.087735 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc46ae-c482-44c8-a526-9f86c199c8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:12.112560 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-efcc46ae-c482-44c8-a526-9f86c199c8f6 None None] MFA Rules not processed for user `2913d382d0c043ce88b926090a4372ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:12.114232 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-efcc46ae-c482-44c8-a526-9f86c199c8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:12.122615 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1374/2770] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:12.459124 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d117-610a-4ebe-9a05-a7c1b887464f None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:12.459884 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d117-610a-4ebe-9a05-a7c1b887464f None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:12.460083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360d117-610a-4ebe-9a05-a7c1b887464f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-5360d117-610a-4ebe-9a05-a7c1b887464f None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:47:12.474408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:47:12.475838 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:47:12.476922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1397/2771] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:47:12 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 20 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 01 05:47:12.568863 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc46ae-c482-44c8-a526-9f86c199c8f6 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:12.570870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-efcc46ae-c482-44c8-a526-9f86c199c8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:12.597648 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc46ae-c482-44c8-a526-9f86c199c8f6 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:12.605713 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:12.608843 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:12.609902 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:12.610264 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] PATH_INFO: `/v3/users/ef02f05272274dd88fb669983a921103` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:12.611828 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef02f05272274dd88fb669983a921103)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:12.613995 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:12.960205 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef02f05272274dd88fb669983a921103'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:12.970678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef02f05272274dd88fb669983a921103'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:13.043444 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef02f05272274dd88fb669983a921103'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:13.044306 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef02f05272274dd88fb669983a921103'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:13.045876 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef02f05272274dd88fb669983a921103'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:13.089463 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1375/2772] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:47:12 2022] DELETE /identity/v3/users/ef02f05272274dd88fb669983a921103 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:13.095176 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f23dd6-a80a-40dc-a4f3-babc06eb99e1 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:13.096014 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f23dd6-a80a-40dc-a4f3-babc06eb99e1 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:13.096749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f23dd6-a80a-40dc-a4f3-babc06eb99e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:13.123172 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-70f23dd6-a80a-40dc-a4f3-babc06eb99e1 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:13.125793 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-70f23dd6-a80a-40dc-a4f3-babc06eb99e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:13.151410 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:13.204446 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1398/2773] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:13.216464 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:13.218514 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:13.286942 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3205e-30c3-41b3-a61e-291f3a74722f admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:13.291173 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31ca05-d058-414e-9258-9dd64ecd81d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:13.291788 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31ca05-d058-414e-9258-9dd64ecd81d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:13.292067 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31ca05-d058-414e-9258-9dd64ecd81d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:13.292344 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31ca05-d058-414e-9258-9dd64ecd81d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:13.305613 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31ca05-d058-414e-9258-9dd64ecd81d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:13.307674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31ca05-d058-414e-9258-9dd64ecd81d6 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:13.320996 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1376/2774] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:14.188694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f23dd6-a80a-40dc-a4f3-babc06eb99e1 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:14.191302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-70f23dd6-a80a-40dc-a4f3-babc06eb99e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:14.205413 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f23dd6-a80a-40dc-a4f3-babc06eb99e1 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:14.214160 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10427d91-efc4-42af-916d-0d1c8facf52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:14.215676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10427d91-efc4-42af-916d-0d1c8facf52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:14.216026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10427d91-efc4-42af-916d-0d1c8facf52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:14.216566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10427d91-efc4-42af-916d-0d1c8facf52b admin admin] PATH_INFO: `/v3/projects/1bcbb65929ac4eb38a4c5d9453f6c15f` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:14.218832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10427d91-efc4-42af-916d-0d1c8facf52b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bcbb65929ac4eb38a4c5d9453f6c15f)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:14.222116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10427d91-efc4-42af-916d-0d1c8facf52b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:14.430262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-10427d91-efc4-42af-916d-0d1c8facf52b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bcbb65929ac4eb38a4c5d9453f6c15f', 'request_id': 'req-10427d91-efc4-42af-916d-0d1c8facf52b'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:14.535420 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-10427d91-efc4-42af-916d-0d1c8facf52b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bcbb65929ac4eb38a4c5d9453f6c15f', 'request_id': 'req-10427d91-efc4-42af-916d-0d1c8facf52b'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:14.544898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-10427d91-efc4-42af-916d-0d1c8facf52b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bcbb65929ac4eb38a4c5d9453f6c15f', 'request_id': 'req-10427d91-efc4-42af-916d-0d1c8facf52b'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:14.562114 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-10427d91-efc4-42af-916d-0d1c8facf52b admin admin] The token cache is being invalidate because project 1bcbb65929ac4eb38a4c5d9453f6c15f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:47:14.562876 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-10427d91-efc4-42af-916d-0d1c8facf52b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:14.563634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-10427d91-efc4-42af-916d-0d1c8facf52b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:14.565627 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1399/2775] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:47:14 2022] DELETE /identity/v3/projects/1bcbb65929ac4eb38a4c5d9453f6c15f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:16.481935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31ca05-d058-414e-9258-9dd64ecd81d6 service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:16.484637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7b31ca05-d058-414e-9258-9dd64ecd81d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:16.503296 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31ca05-d058-414e-9258-9dd64ecd81d6 service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:16.513915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:16.623085 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:16.623969 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:16.625179 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:16.626150 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] PATH_INFO: `/v3/users/34b1deac363a4b208d1a87cfb555f6ed` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:16.628170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b1deac363a4b208d1a87cfb555f6ed)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:16.631005 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:16.884080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b1deac363a4b208d1a87cfb555f6ed'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:16.901718 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b1deac363a4b208d1a87cfb555f6ed'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:16.972842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b1deac363a4b208d1a87cfb555f6ed'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:16.973775 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b1deac363a4b208d1a87cfb555f6ed'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:16.974602 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b1deac363a4b208d1a87cfb555f6ed'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:17.005790 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1377/2776] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:47:16 2022] DELETE /identity/v3/users/34b1deac363a4b208d1a87cfb555f6ed => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:47:17.010277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2c1b1-d0e4-4cb5-8bca-d89b635ce163 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:17.010794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2c1b1-d0e4-4cb5-8bca-d89b635ce163 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:17.010918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2c1b1-d0e4-4cb5-8bca-d89b635ce163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:17.034127 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5dd2c1b1-d0e4-4cb5-8bca-d89b635ce163 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:17.038037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5dd2c1b1-d0e4-4cb5-8bca-d89b635ce163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:17.150071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1400/2777] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:47:17.161437 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:17.163452 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:17.305216 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd043973-50ed-4e35-82b5-060c96664d68 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:17.311487 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaad9f8-16fa-4766-99e8-d5cd560ab7a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:17.312748 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaad9f8-16fa-4766-99e8-d5cd560ab7a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:17.313222 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaad9f8-16fa-4766-99e8-d5cd560ab7a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:17.313856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaad9f8-16fa-4766-99e8-d5cd560ab7a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:17.326186 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaad9f8-16fa-4766-99e8-d5cd560ab7a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:17.327756 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaad9f8-16fa-4766-99e8-d5cd560ab7a7 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:17.339457 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1378/2778] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:18.175207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2c1b1-d0e4-4cb5-8bca-d89b635ce163 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:18.185738 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5dd2c1b1-d0e4-4cb5-8bca-d89b635ce163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:18.226967 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2c1b1-d0e4-4cb5-8bca-d89b635ce163 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:18.236442 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15ef9a-157d-4acb-ae30-117404677340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:18.237493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ef9a-157d-4acb-ae30-117404677340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:18.237940 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ef9a-157d-4acb-ae30-117404677340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:18.238421 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ef9a-157d-4acb-ae30-117404677340 admin admin] PATH_INFO: `/v3/projects/2947c28abd444fdebb5bec54dc2af29f` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:18.239842 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15ef9a-157d-4acb-ae30-117404677340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2947c28abd444fdebb5bec54dc2af29f)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:18.242189 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15ef9a-157d-4acb-ae30-117404677340 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:18.431898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:18.439942 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ab15ef9a-157d-4acb-ae30-117404677340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2947c28abd444fdebb5bec54dc2af29f', 'request_id': 'req-ab15ef9a-157d-4acb-ae30-117404677340'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:18.565614 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ab15ef9a-157d-4acb-ae30-117404677340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2947c28abd444fdebb5bec54dc2af29f', 'request_id': 'req-ab15ef9a-157d-4acb-ae30-117404677340'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:18.571885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ab15ef9a-157d-4acb-ae30-117404677340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2947c28abd444fdebb5bec54dc2af29f', 'request_id': 'req-ab15ef9a-157d-4acb-ae30-117404677340'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:18.585512 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ab15ef9a-157d-4acb-ae30-117404677340 admin admin] The token cache is being invalidate because project 2947c28abd444fdebb5bec54dc2af29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:47:18.585800 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ab15ef9a-157d-4acb-ae30-117404677340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:18.586453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ab15ef9a-157d-4acb-ae30-117404677340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:18.587918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1401/2779] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:47:18 2022] DELETE /identity/v3/projects/2947c28abd444fdebb5bec54dc2af29f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:18.593029 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5e4f3-b398-44e4-9f37-67d227eaca5e None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:18.594389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5e4f3-b398-44e4-9f37-67d227eaca5e None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:18.594389 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5e4f3-b398-44e4-9f37-67d227eaca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:18.614108 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-27f5e4f3-b398-44e4-9f37-67d227eaca5e None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:18.615308 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-27f5e4f3-b398-44e4-9f37-67d227eaca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:18.647320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:18.685329 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1379/2780] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:18.694087 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7c791-98d0-4509-9e8f-69f9de0eb8eb None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:18.694403 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7c791-98d0-4509-9e8f-69f9de0eb8eb None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:18.694687 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c7c791-98d0-4509-9e8f-69f9de0eb8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:18.717422 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-a4c7c791-98d0-4509-9e8f-69f9de0eb8eb None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:18.718141 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a4c7c791-98d0-4509-9e8f-69f9de0eb8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:18.726951 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1402/2781] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:18.732404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5e4f3-b398-44e4-9f37-67d227eaca5e None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:18.747710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5e4f3-b398-44e4-9f37-67d227eaca5e None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:18.754964 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b27f6-d700-46e1-8fcc-82d03f854f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:18.756086 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b27f6-d700-46e1-8fcc-82d03f854f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:18.756535 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b27f6-d700-46e1-8fcc-82d03f854f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:18.756827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b27f6-d700-46e1-8fcc-82d03f854f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:18.757757 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b27f6-d700-46e1-8fcc-82d03f854f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:47:18.758126 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b27f6-d700-46e1-8fcc-82d03f854f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:18.759939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b27f6-d700-46e1-8fcc-82d03f854f1d admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:18.777720 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1380/2782] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:47:18.782306 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7c791-98d0-4509-9e8f-69f9de0eb8eb None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:18.791842 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c7c791-98d0-4509-9e8f-69f9de0eb8eb None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:18.796755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135e62b-ad23-480e-b022-a26b08d67fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:18.797348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135e62b-ad23-480e-b022-a26b08d67fdb admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:18.797651 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135e62b-ad23-480e-b022-a26b08d67fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:18.797949 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135e62b-ad23-480e-b022-a26b08d67fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:18.798764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135e62b-ad23-480e-b022-a26b08d67fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:18.800663 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135e62b-ad23-480e-b022-a26b08d67fdb admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:18.973109 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1403/2783] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:47:18 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:47:18.977631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b27f6-d700-46e1-8fcc-82d03f854f1d admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:18.988041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b27f6-d700-46e1-8fcc-82d03f854f1d admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:19.053697 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034c12a-0492-46ab-9f6d-e4887477ab0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:19.054316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c12a-0492-46ab-9f6d-e4887477ab0a admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:19.056136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c12a-0492-46ab-9f6d-e4887477ab0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:19.056136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c12a-0492-46ab-9f6d-e4887477ab0a admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:19.056136 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c12a-0492-46ab-9f6d-e4887477ab0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:19.057500 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c12a-0492-46ab-9f6d-e4887477ab0a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:19.192871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1381/2784] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:47:18 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:47:19.200357 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135e62b-ad23-480e-b022-a26b08d67fdb admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:19.212710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135e62b-ad23-480e-b022-a26b08d67fdb admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:19.220604 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ed2ab-daab-4d07-bb0c-e4e90ae9482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:19.221227 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ed2ab-daab-4d07-bb0c-e4e90ae9482c admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:19.221539 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ed2ab-daab-4d07-bb0c-e4e90ae9482c admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:19.221824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ed2ab-daab-4d07-bb0c-e4e90ae9482c admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:19.222477 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ed2ab-daab-4d07-bb0c-e4e90ae9482c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:19.224138 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ed2ab-daab-4d07-bb0c-e4e90ae9482c admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:19.234513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabe684-2dda-4f7a-9d34-c13ddec11e69 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:19.234513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabe684-2dda-4f7a-9d34-c13ddec11e69 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:19.234513 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabe684-2dda-4f7a-9d34-c13ddec11e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:19.241935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1404/2785] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:47:19.246312 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ed2ab-daab-4d07-bb0c-e4e90ae9482c admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:19.258099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ed2ab-daab-4d07-bb0c-e4e90ae9482c admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:19.274193 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-beabe684-2dda-4f7a-9d34-c13ddec11e69 None None] MFA Rules not processed for user `2913d382d0c043ce88b926090a4372ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:19.274379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1224bd-05e7-42ea-ad18-0ae968713834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:19.274577 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-beabe684-2dda-4f7a-9d34-c13ddec11e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:19.274767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1224bd-05e7-42ea-ad18-0ae968713834 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:19.274767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1224bd-05e7-42ea-ad18-0ae968713834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:19.274767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1224bd-05e7-42ea-ad18-0ae968713834 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:19.274767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1224bd-05e7-42ea-ad18-0ae968713834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:19.274767 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1224bd-05e7-42ea-ad18-0ae968713834 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:19.279786 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1405/2786] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:47:19.284896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1224bd-05e7-42ea-ad18-0ae968713834 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:19.303023 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1224bd-05e7-42ea-ad18-0ae968713834 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:19.320467 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedd43b-73ac-41f3-b302-6d5b76f28226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:19.321478 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedd43b-73ac-41f3-b302-6d5b76f28226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:19.321764 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedd43b-73ac-41f3-b302-6d5b76f28226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:19.322046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedd43b-73ac-41f3-b302-6d5b76f28226 admin admin] PATH_INFO: `/v3/projects/75e1d38ebc7d4666827a62bf92d15bf2/users/a42a2144b8654775a802a1b6b8105d69/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:19.340228 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedd43b-73ac-41f3-b302-6d5b76f28226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e1d38ebc7d4666827a62bf92d15bf2, user_id=a42a2144b8654775a802a1b6b8105d69, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:19.343779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedd43b-73ac-41f3-b302-6d5b76f28226 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:19.345393 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1382/2787] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:47:19.540990 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1406/2788] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:47:19 2022] PUT /identity/v3/projects/75e1d38ebc7d4666827a62bf92d15bf2/users/a42a2144b8654775a802a1b6b8105d69/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:47:19.618912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30237648-ee6c-4e4e-87f4-b8d74594d50d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:19.619792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30237648-ee6c-4e4e-87f4-b8d74594d50d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:19.620074 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30237648-ee6c-4e4e-87f4-b8d74594d50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:19.623437 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639c643-4b57-4118-999b-093e89bf1287 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:19.623723 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639c643-4b57-4118-999b-093e89bf1287 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:19.624006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639c643-4b57-4118-999b-093e89bf1287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-7639c643-4b57-4118-999b-093e89bf1287 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:47:19.631108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:47:19.632215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:47:19.633406 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1407/2789] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:47:19 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Sep 01 05:47:19.657537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-30237648-ee6c-4e4e-87f4-b8d74594d50d None None] MFA Rules not processed for user `a42a2144b8654775a802a1b6b8105d69`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:19.659049 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-30237648-ee6c-4e4e-87f4-b8d74594d50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:19.709166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:19.734656 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1383/2790] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:19.748473 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639c643-4b57-4118-999b-093e89bf1287 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:19.751018 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-7639c643-4b57-4118-999b-093e89bf1287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:19.831917 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639c643-4b57-4118-999b-093e89bf1287 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:19.836002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74bb4f-e8bf-4222-8013-712c8a8afc07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:19.836629 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74bb4f-e8bf-4222-8013-712c8a8afc07 service cinder] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:19.836909 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74bb4f-e8bf-4222-8013-712c8a8afc07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:19.837182 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74bb4f-e8bf-4222-8013-712c8a8afc07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:19.848443 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74bb4f-e8bf-4222-8013-712c8a8afc07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:19.849991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74bb4f-e8bf-4222-8013-712c8a8afc07 service cinder] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:19.859487 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1408/2791] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:21.063690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516c17d-793b-4577-87bf-ac3d87250b22 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:21.064477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516c17d-793b-4577-87bf-ac3d87250b22 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:21.064477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516c17d-793b-4577-87bf-ac3d87250b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:21.087007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-6516c17d-793b-4577-87bf-ac3d87250b22 None None] MFA Rules not processed for user `eb75c0fb10484f3d80813962a4283b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:21.088256 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6516c17d-793b-4577-87bf-ac3d87250b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:21.174130 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1384/2792] 10.222.0.48 () {58 vars in 967 bytes} [Thu Sep 1 05:47:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:47:21.188855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74bb4f-e8bf-4222-8013-712c8a8afc07 service cinder] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:21.201797 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ed74bb4f-e8bf-4222-8013-712c8a8afc07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:21.297817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:21.317620 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74bb4f-e8bf-4222-8013-712c8a8afc07 service cinder] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:21.323278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aaaf9-e91f-4765-820d-19f604858e11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a0d07b79212443480c87f4a4ff3ca00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:21.339177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aaaf9-e91f-4765-820d-19f604858e11 service swift] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:21.339177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aaaf9-e91f-4765-820d-19f604858e11 service swift] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:21.339177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aaaf9-e91f-4765-820d-19f604858e11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:21.339177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1aaaf9-e91f-4765-820d-19f604858e11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:21.339177 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1aaaf9-e91f-4765-820d-19f604858e11 service swift] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:21.346684 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1409/2793] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Sep 1 05:47:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:47:25.005146 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516c17d-793b-4577-87bf-ac3d87250b22 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:25.080075 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516c17d-793b-4577-87bf-ac3d87250b22 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:25.085550 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:25.086202 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:25.086506 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:25.086787 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] PATH_INFO: `/v3/users/a42a2144b8654775a802a1b6b8105d69` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:25.087959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42a2144b8654775a802a1b6b8105d69)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:25.090043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:25.498570 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42a2144b8654775a802a1b6b8105d69'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:25.510121 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42a2144b8654775a802a1b6b8105d69'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:25.704471 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42a2144b8654775a802a1b6b8105d69'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:25.705113 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42a2144b8654775a802a1b6b8105d69'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:25.705783 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42a2144b8654775a802a1b6b8105d69'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:25.727381 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1385/2794] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:47:25 2022] DELETE /identity/v3/users/a42a2144b8654775a802a1b6b8105d69 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:25.733250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4156205-3a87-487a-92ad-067690449d9c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:25.733825 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4156205-3a87-487a-92ad-067690449d9c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:25.733932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4156205-3a87-487a-92ad-067690449d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:25.754328 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-e4156205-3a87-487a-92ad-067690449d9c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:25.755572 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e4156205-3a87-487a-92ad-067690449d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:25.850404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1410/2795] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:47:25.862719 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:25.864324 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:25.881426 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:25.944761 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d81f10-69e1-4415-855b-4a5f9471a6b6 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:25.949072 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbf75b-38c0-4f72-8565-537cf1ff557e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:25.949791 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbf75b-38c0-4f72-8565-537cf1ff557e service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:25.950080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbf75b-38c0-4f72-8565-537cf1ff557e service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:25.950347 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbbf75b-38c0-4f72-8565-537cf1ff557e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:25.960827 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbf75b-38c0-4f72-8565-537cf1ff557e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:25.962678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbbf75b-38c0-4f72-8565-537cf1ff557e service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:25.973474 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1386/2796] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:26.410790 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4156205-3a87-487a-92ad-067690449d9c None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:26.410790 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e4156205-3a87-487a-92ad-067690449d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:26.425855 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4156205-3a87-487a-92ad-067690449d9c None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:26.439622 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bbbd0-75c5-49db-830f-84359d87afc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:26.440778 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bbbd0-75c5-49db-830f-84359d87afc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:26.441261 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bbbd0-75c5-49db-830f-84359d87afc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:26.441783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bbbd0-75c5-49db-830f-84359d87afc9 admin admin] PATH_INFO: `/v3/users/8455993d7ec342d0b1e4f3ec899b60fd` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:26.443743 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bbbd0-75c5-49db-830f-84359d87afc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8455993d7ec342d0b1e4f3ec899b60fd)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:26.446694 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bbbd0-75c5-49db-830f-84359d87afc9 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:26.634592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbf75b-38c0-4f72-8565-537cf1ff557e service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:26.634592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-4fbbf75b-38c0-4f72-8565-537cf1ff557e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:26.641763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbbf75b-38c0-4f72-8565-537cf1ff557e service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:26.649745 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:26.650950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:26.651462 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:26.651912 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] PATH_INFO: `/v3/projects/75e1d38ebc7d4666827a62bf92d15bf2` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:26.653691 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e1d38ebc7d4666827a62bf92d15bf2)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:26.656592 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:26.890292 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e1d38ebc7d4666827a62bf92d15bf2', 'request_id': 'req-950097db-3a43-4a66-9023-6000ca3c703e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:26.898607 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e1d38ebc7d4666827a62bf92d15bf2', 'request_id': 'req-950097db-3a43-4a66-9023-6000ca3c703e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:26.899822 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-542bbbd0-75c5-49db-830f-84359d87afc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8455993d7ec342d0b1e4f3ec899b60fd'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:26.916919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-542bbbd0-75c5-49db-830f-84359d87afc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8455993d7ec342d0b1e4f3ec899b60fd'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:26.929945 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-542bbbd0-75c5-49db-830f-84359d87afc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8455993d7ec342d0b1e4f3ec899b60fd'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:27.037634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e1d38ebc7d4666827a62bf92d15bf2', 'request_id': 'req-950097db-3a43-4a66-9023-6000ca3c703e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:27.049988 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] The token cache is being invalidate because project 75e1d38ebc7d4666827a62bf92d15bf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:47:27.050382 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:27.051044 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:27.052539 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1387/2797] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:47:26 2022] DELETE /identity/v3/projects/75e1d38ebc7d4666827a62bf92d15bf2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:47:27.151547 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-542bbbd0-75c5-49db-830f-84359d87afc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8455993d7ec342d0b1e4f3ec899b60fd'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:27.169757 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-542bbbd0-75c5-49db-830f-84359d87afc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8455993d7ec342d0b1e4f3ec899b60fd'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:27.172384 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1411/2798] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:47:26 2022] DELETE /identity/v3/users/8455993d7ec342d0b1e4f3ec899b60fd => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:27.495915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:27.498076 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:27.592593 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950097db-3a43-4a66-9023-6000ca3c703e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:27.638340 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:27.656327 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be364d1d-4aae-424d-a1b0-c9a737f1f503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:27.656968 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be364d1d-4aae-424d-a1b0-c9a737f1f503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:27.657242 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be364d1d-4aae-424d-a1b0-c9a737f1f503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:27.657547 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be364d1d-4aae-424d-a1b0-c9a737f1f503 admin admin] PATH_INFO: `/v3/projects/f16a471f651c449d866e82634f6483e4` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:27.658681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be364d1d-4aae-424d-a1b0-c9a737f1f503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16a471f651c449d866e82634f6483e4)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:27.660624 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be364d1d-4aae-424d-a1b0-c9a737f1f503 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:27.805570 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-be364d1d-4aae-424d-a1b0-c9a737f1f503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16a471f651c449d866e82634f6483e4', 'request_id': 'req-be364d1d-4aae-424d-a1b0-c9a737f1f503'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:27.813285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-be364d1d-4aae-424d-a1b0-c9a737f1f503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16a471f651c449d866e82634f6483e4', 'request_id': 'req-be364d1d-4aae-424d-a1b0-c9a737f1f503'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:28.068612 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-be364d1d-4aae-424d-a1b0-c9a737f1f503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16a471f651c449d866e82634f6483e4', 'request_id': 'req-be364d1d-4aae-424d-a1b0-c9a737f1f503'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:28.080504 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-be364d1d-4aae-424d-a1b0-c9a737f1f503 admin admin] The token cache is being invalidate because project f16a471f651c449d866e82634f6483e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:47:28.080870 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-be364d1d-4aae-424d-a1b0-c9a737f1f503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:28.081596 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-be364d1d-4aae-424d-a1b0-c9a737f1f503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:28.083112 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1388/2799] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:47:27 2022] DELETE /identity/v3/projects/f16a471f651c449d866e82634f6483e4 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:28.088297 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39792ee-a85c-4330-aed3-c00e5e2560b2 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:28.088833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39792ee-a85c-4330-aed3-c00e5e2560b2 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:28.088932 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39792ee-a85c-4330-aed3-c00e5e2560b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:28.111497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-f39792ee-a85c-4330-aed3-c00e5e2560b2 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:28.112979 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f39792ee-a85c-4330-aed3-c00e5e2560b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:28.178017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:28.197225 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1412/2800] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:28.200041 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab5911-ddca-4853-a7d4-3261ebb65787 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:28.200399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab5911-ddca-4853-a7d4-3261ebb65787 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:28.200746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab5911-ddca-4853-a7d4-3261ebb65787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:28.231320 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-30ab5911-ddca-4853-a7d4-3261ebb65787 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:28.232631 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-30ab5911-ddca-4853-a7d4-3261ebb65787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:28.241867 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1389/2801] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:28.246349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39792ee-a85c-4330-aed3-c00e5e2560b2 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:28.261583 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39792ee-a85c-4330-aed3-c00e5e2560b2 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:28.268310 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b985e73-6bcd-421b-a113-56d112ae3aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:28.269005 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b985e73-6bcd-421b-a113-56d112ae3aea admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:28.269327 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b985e73-6bcd-421b-a113-56d112ae3aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:28.269635 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b985e73-6bcd-421b-a113-56d112ae3aea admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:28.270404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b985e73-6bcd-421b-a113-56d112ae3aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:47:28.270615 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b985e73-6bcd-421b-a113-56d112ae3aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:28.272268 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b985e73-6bcd-421b-a113-56d112ae3aea admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:28.288846 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1413/2802] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:47:28.290752 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab5911-ddca-4853-a7d4-3261ebb65787 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:28.302048 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab5911-ddca-4853-a7d4-3261ebb65787 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:28.308747 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3ba0b-4aa3-4ed2-92e1-485d511843f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:28.309366 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3ba0b-4aa3-4ed2-92e1-485d511843f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:28.309679 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3ba0b-4aa3-4ed2-92e1-485d511843f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:28.309952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3ba0b-4aa3-4ed2-92e1-485d511843f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:28.310605 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3ba0b-4aa3-4ed2-92e1-485d511843f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:28.314083 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3ba0b-4aa3-4ed2-92e1-485d511843f9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:28.496414 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1390/2803] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:47:28 2022] POST /identity/v3/projects => generated 397 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:47:28.501148 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b985e73-6bcd-421b-a113-56d112ae3aea admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:28.512335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b985e73-6bcd-421b-a113-56d112ae3aea admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:28.571418 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab642ed2-21e7-4579-9c65-719567f329b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:28.572043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab642ed2-21e7-4579-9c65-719567f329b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:28.572375 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab642ed2-21e7-4579-9c65-719567f329b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:28.572732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab642ed2-21e7-4579-9c65-719567f329b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:28.573309 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab642ed2-21e7-4579-9c65-719567f329b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:28.575277 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab642ed2-21e7-4579-9c65-719567f329b2 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:28.686057 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1414/2804] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:47:28 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:47:28.691294 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3ba0b-4aa3-4ed2-92e1-485d511843f9 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:28.701731 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3ba0b-4aa3-4ed2-92e1-485d511843f9 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:28.706392 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5262e5a-48fc-48ef-bb2d-92b81189523a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:28.707084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5262e5a-48fc-48ef-bb2d-92b81189523a admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:28.707272 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5262e5a-48fc-48ef-bb2d-92b81189523a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:28.707540 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5262e5a-48fc-48ef-bb2d-92b81189523a admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:28.708190 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5262e5a-48fc-48ef-bb2d-92b81189523a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:28.709886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5262e5a-48fc-48ef-bb2d-92b81189523a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:28.722881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1391/2805] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:47:28.740611 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab642ed2-21e7-4579-9c65-719567f329b2 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:28.751345 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab642ed2-21e7-4579-9c65-719567f329b2 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:28.763096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574c948-408c-4730-a114-0bd6d9a5f089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:28.763722 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574c948-408c-4730-a114-0bd6d9a5f089 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:28.763997 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574c948-408c-4730-a114-0bd6d9a5f089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:28.764272 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574c948-408c-4730-a114-0bd6d9a5f089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:28.765829 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574c948-408c-4730-a114-0bd6d9a5f089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:28.767664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574c948-408c-4730-a114-0bd6d9a5f089 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:28.780028 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1415/2806] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:47:28.785260 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5262e5a-48fc-48ef-bb2d-92b81189523a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:28.796773 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5262e5a-48fc-48ef-bb2d-92b81189523a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:28.801605 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069531fc-bb05-49cf-97f6-f0e43cec413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:28.802309 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069531fc-bb05-49cf-97f6-f0e43cec413f admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:28.802618 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069531fc-bb05-49cf-97f6-f0e43cec413f admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:28.802893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069531fc-bb05-49cf-97f6-f0e43cec413f admin admin] PATH_INFO: `/v3/projects/517d20ebe8184384bcbc0e8ed95f764d/users/bb557f888109438a995703c7b4d107b4/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:28.820255 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069531fc-bb05-49cf-97f6-f0e43cec413f admin admin] RBAC: Authorizing `identity:create_grant(project_id=517d20ebe8184384bcbc0e8ed95f764d, user_id=bb557f888109438a995703c7b4d107b4, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:28.823751 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069531fc-bb05-49cf-97f6-f0e43cec413f admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:28.992402 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1392/2807] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:47:28 2022] PUT /identity/v3/projects/517d20ebe8184384bcbc0e8ed95f764d/users/bb557f888109438a995703c7b4d107b4/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:47:29.003662 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5303-0118-4e37-b4dd-a5dd255670cf None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:29.003916 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5303-0118-4e37-b4dd-a5dd255670cf None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:29.004240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f5303-0118-4e37-b4dd-a5dd255670cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:29.036415 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-d30f5303-0118-4e37-b4dd-a5dd255670cf None None] MFA Rules not processed for user `bb557f888109438a995703c7b4d107b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:29.037711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d30f5303-0118-4e37-b4dd-a5dd255670cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:29.122719 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1416/2808] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:29.135236 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069531fc-bb05-49cf-97f6-f0e43cec413f admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:29.137084 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-069531fc-bb05-49cf-97f6-f0e43cec413f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:29.203520 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069531fc-bb05-49cf-97f6-f0e43cec413f admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:29.207537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebfb77-7637-47a0-a792-07c2d55c9997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:29.208159 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebfb77-7637-47a0-a792-07c2d55c9997 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:29.208436 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebfb77-7637-47a0-a792-07c2d55c9997 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:29.208705 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebfb77-7637-47a0-a792-07c2d55c9997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:29.218701 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebfb77-7637-47a0-a792-07c2d55c9997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:29.220166 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebfb77-7637-47a0-a792-07c2d55c9997 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:29.230538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1393/2809] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:29 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:35.668088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5303-0118-4e37-b4dd-a5dd255670cf None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:35.730043 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:35.736335 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f5303-0118-4e37-b4dd-a5dd255670cf None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:35.741026 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:35.741710 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:35.741994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:35.742271 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] PATH_INFO: `/v3/users/bb557f888109438a995703c7b4d107b4` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:35.743424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb557f888109438a995703c7b4d107b4)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:35.745347 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:36.017497 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb557f888109438a995703c7b4d107b4'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:36.031598 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb557f888109438a995703c7b4d107b4'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:36.041543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb557f888109438a995703c7b4d107b4'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:36.148292 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb557f888109438a995703c7b4d107b4'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:36.148918 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb557f888109438a995703c7b4d107b4'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:36.155832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1417/2810] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:47:35 2022] DELETE /identity/v3/users/bb557f888109438a995703c7b4d107b4 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:36.160379 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d6e84-a10f-4aed-8c3a-e326189daeac None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:36.161190 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d6e84-a10f-4aed-8c3a-e326189daeac None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:36.161497 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d6e84-a10f-4aed-8c3a-e326189daeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:36.187666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-899d6e84-a10f-4aed-8c3a-e326189daeac None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:36.189062 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-899d6e84-a10f-4aed-8c3a-e326189daeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:36.194766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:36.252372 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1394/2811] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:36.264811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:36.264811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:36.330163 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfc5a6-6c15-4c9d-a272-29c1caaf26a2 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:36.333755 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70e4e9-d2e9-4448-83d3-2b7f3659fde5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:36.334359 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70e4e9-d2e9-4448-83d3-2b7f3659fde5 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:36.334639 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70e4e9-d2e9-4448-83d3-2b7f3659fde5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:36.334914 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70e4e9-d2e9-4448-83d3-2b7f3659fde5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:36.345430 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70e4e9-d2e9-4448-83d3-2b7f3659fde5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:36.346887 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70e4e9-d2e9-4448-83d3-2b7f3659fde5 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:36.357207 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1418/2812] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:37.044311 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d6e84-a10f-4aed-8c3a-e326189daeac None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:37.046046 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-899d6e84-a10f-4aed-8c3a-e326189daeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:37.062646 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d6e84-a10f-4aed-8c3a-e326189daeac None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:37.065475 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99593ea2-ec31-4603-ba77-1680eea5afda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:37.066160 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99593ea2-ec31-4603-ba77-1680eea5afda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:37.066516 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99593ea2-ec31-4603-ba77-1680eea5afda admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:37.066667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99593ea2-ec31-4603-ba77-1680eea5afda admin admin] PATH_INFO: `/v3/projects/517d20ebe8184384bcbc0e8ed95f764d` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:37.067836 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99593ea2-ec31-4603-ba77-1680eea5afda admin admin] RBAC: Authorizing `identity:delete_project(project_id=517d20ebe8184384bcbc0e8ed95f764d)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:37.069844 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99593ea2-ec31-4603-ba77-1680eea5afda admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:37.228341 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-99593ea2-ec31-4603-ba77-1680eea5afda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517d20ebe8184384bcbc0e8ed95f764d', 'request_id': 'req-99593ea2-ec31-4603-ba77-1680eea5afda'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:37.242030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-99593ea2-ec31-4603-ba77-1680eea5afda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517d20ebe8184384bcbc0e8ed95f764d', 'request_id': 'req-99593ea2-ec31-4603-ba77-1680eea5afda'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:37.479894 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-99593ea2-ec31-4603-ba77-1680eea5afda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517d20ebe8184384bcbc0e8ed95f764d', 'request_id': 'req-99593ea2-ec31-4603-ba77-1680eea5afda'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:37.492254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-99593ea2-ec31-4603-ba77-1680eea5afda admin admin] The token cache is being invalidate because project 517d20ebe8184384bcbc0e8ed95f764d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81756) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:47:37.492588 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-99593ea2-ec31-4603-ba77-1680eea5afda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:37.493247 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-99593ea2-ec31-4603-ba77-1680eea5afda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:37.494799 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1395/2813] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:47:37 2022] DELETE /identity/v3/projects/517d20ebe8184384bcbc0e8ed95f764d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:37.501400 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d1571-ca7d-4107-951d-8db00ec17a2c None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:37.501892 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d1571-ca7d-4107-951d-8db00ec17a2c None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:37.502108 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d1571-ca7d-4107-951d-8db00ec17a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:37.523623 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-5c9d1571-ca7d-4107-951d-8db00ec17a2c None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:37.524888 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-5c9d1571-ca7d-4107-951d-8db00ec17a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:37.589169 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1419/2814] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:37.599914 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d98901-ef86-4125-b771-fc1a5341b54d None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:37.600337 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d98901-ef86-4125-b771-fc1a5341b54d None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:37.601019 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d98901-ef86-4125-b771-fc1a5341b54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:37.631434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-70d98901-ef86-4125-b771-fc1a5341b54d None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:37.631434 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-70d98901-ef86-4125-b771-fc1a5341b54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:37.641552 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1396/2815] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:37.646252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d1571-ca7d-4107-951d-8db00ec17a2c None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:37.656817 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d1571-ca7d-4107-951d-8db00ec17a2c None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:37.661791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ac6c-80d7-4bce-9421-0641afd90868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:37.670781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ac6c-80d7-4bce-9421-0641afd90868 admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:37.670781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ac6c-80d7-4bce-9421-0641afd90868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:37.670781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345ac6c-80d7-4bce-9421-0641afd90868 admin admin] PATH_INFO: `/v3/domains` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:37.670781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345ac6c-80d7-4bce-9421-0641afd90868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81757) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:47:37.670781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345ac6c-80d7-4bce-9421-0641afd90868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:37.670781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345ac6c-80d7-4bce-9421-0641afd90868 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:37.678461 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1420/2816] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:47:37.684754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d98901-ef86-4125-b771-fc1a5341b54d None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:37.696104 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d98901-ef86-4125-b771-fc1a5341b54d None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:37.701303 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a27e7-aa37-4728-802e-e1129ca4eb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:37.702813 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a27e7-aa37-4728-802e-e1129ca4eb0b admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:37.703315 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a27e7-aa37-4728-802e-e1129ca4eb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:37.703781 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a27e7-aa37-4728-802e-e1129ca4eb0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:37.704259 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a27e7-aa37-4728-802e-e1129ca4eb0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:37.706419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a27e7-aa37-4728-802e-e1129ca4eb0b admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:37.835810 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1397/2817] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:47:37 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:47:37.840348 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ac6c-80d7-4bce-9421-0641afd90868 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:37.847541 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:37.851792 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345ac6c-80d7-4bce-9421-0641afd90868 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:37.913645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6674ec-bcde-4589-8237-8fd21eeab3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:37.914260 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6674ec-bcde-4589-8237-8fd21eeab3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:37.914564 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6674ec-bcde-4589-8237-8fd21eeab3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:37.914948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6674ec-bcde-4589-8237-8fd21eeab3f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:37.915676 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6674ec-bcde-4589-8237-8fd21eeab3f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:37.917637 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6674ec-bcde-4589-8237-8fd21eeab3f5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:38.018221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1421/2818] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:47:37 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:47:38.023031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a27e7-aa37-4728-802e-e1129ca4eb0b admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:38.034959 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a27e7-aa37-4728-802e-e1129ca4eb0b admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:38.039886 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb96c1-cbe6-47c3-b07a-b3560c3b97db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:38.040512 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb96c1-cbe6-47c3-b07a-b3560c3b97db admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:38.040789 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb96c1-cbe6-47c3-b07a-b3560c3b97db admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:38.041060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb96c1-cbe6-47c3-b07a-b3560c3b97db admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:38.041746 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb96c1-cbe6-47c3-b07a-b3560c3b97db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:38.043439 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb96c1-cbe6-47c3-b07a-b3560c3b97db admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:38.055643 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1398/2819] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:47:38.060307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6674ec-bcde-4589-8237-8fd21eeab3f5 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:38.073322 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6674ec-bcde-4589-8237-8fd21eeab3f5 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:38.079131 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b3b1d-b12b-4ef8-8402-f9d2c56173de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:38.080680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b3b1d-b12b-4ef8-8402-f9d2c56173de admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:38.080680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b3b1d-b12b-4ef8-8402-f9d2c56173de admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:38.080680 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b3b1d-b12b-4ef8-8402-f9d2c56173de admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:38.080976 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b3b1d-b12b-4ef8-8402-f9d2c56173de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:38.082561 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b3b1d-b12b-4ef8-8402-f9d2c56173de admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:38.094832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1422/2820] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:47:38.099217 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb96c1-cbe6-47c3-b07a-b3560c3b97db admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:38.110872 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb96c1-cbe6-47c3-b07a-b3560c3b97db admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:38.115856 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707ece5-b477-4c83-8d44-0a9d7e08b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:38.116527 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707ece5-b477-4c83-8d44-0a9d7e08b8b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:38.116847 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707ece5-b477-4c83-8d44-0a9d7e08b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:38.117125 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707ece5-b477-4c83-8d44-0a9d7e08b8b9 admin admin] PATH_INFO: `/v3/projects/d8a60088d8bc4765ba381cc07e9ffe19/users/d5d77c0f3e5143d49337f7e41432adb3/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:38.134208 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707ece5-b477-4c83-8d44-0a9d7e08b8b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a60088d8bc4765ba381cc07e9ffe19, user_id=d5d77c0f3e5143d49337f7e41432adb3, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:38.136893 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707ece5-b477-4c83-8d44-0a9d7e08b8b9 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:38.241133 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1399/2821] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:47:38 2022] PUT /identity/v3/projects/d8a60088d8bc4765ba381cc07e9ffe19/users/d5d77c0f3e5143d49337f7e41432adb3/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:38.246865 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e810018-2511-4528-ae85-b5219ad7de60 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:38.247147 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e810018-2511-4528-ae85-b5219ad7de60 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:38.247412 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e810018-2511-4528-ae85-b5219ad7de60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:38.267811 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-9e810018-2511-4528-ae85-b5219ad7de60 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:38.269157 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-9e810018-2511-4528-ae85-b5219ad7de60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:38.343824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1423/2822] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:38.354860 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707ece5-b477-4c83-8d44-0a9d7e08b8b9 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:38.356594 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0707ece5-b477-4c83-8d44-0a9d7e08b8b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:38.407027 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:38.432842 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707ece5-b477-4c83-8d44-0a9d7e08b8b9 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:38.436840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae725b-d08a-4aa5-90ec-fe4dc06f4985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:38.437488 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae725b-d08a-4aa5-90ec-fe4dc06f4985 service neutron] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:38.437766 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae725b-d08a-4aa5-90ec-fe4dc06f4985 service neutron] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:38.438031 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae725b-d08a-4aa5-90ec-fe4dc06f4985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:38.448638 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae725b-d08a-4aa5-90ec-fe4dc06f4985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:38.450120 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae725b-d08a-4aa5-90ec-fe4dc06f4985 service neutron] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:38.460880 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1400/2823] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:45.772525 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657c287-3fec-45b8-999f-ef78a5505cf4 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:45.773095 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657c287-3fec-45b8-999f-ef78a5505cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:45.773221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657c287-3fec-45b8-999f-ef78a5505cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:45.805711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-f657c287-3fec-45b8-999f-ef78a5505cf4 None None] MFA Rules not processed for user `d5d77c0f3e5143d49337f7e41432adb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:45.807048 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-f657c287-3fec-45b8-999f-ef78a5505cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:45.888383 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1424/2824] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:47:45.893570 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae725b-d08a-4aa5-90ec-fe4dc06f4985 service neutron] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:45.903565 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae725b-d08a-4aa5-90ec-fe4dc06f4985 service neutron] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:45.910359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d96166-c3c3-492f-89e5-00dcbb2d98c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:45.910359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d96166-c3c3-492f-89e5-00dcbb2d98c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:45.910359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d96166-c3c3-492f-89e5-00dcbb2d98c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:45.910359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d96166-c3c3-492f-89e5-00dcbb2d98c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:45.911314 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d96166-c3c3-492f-89e5-00dcbb2d98c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:45.912794 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d96166-c3c3-492f-89e5-00dcbb2d98c1 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:46.026469 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1401/2825] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:47:45 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:47:46.031747 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657c287-3fec-45b8-999f-ef78a5505cf4 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:46.043317 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657c287-3fec-45b8-999f-ef78a5505cf4 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:46.053988 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:46.113844 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a433483-6506-4a1a-8bd2-d8547809e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:46.114644 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a433483-6506-4a1a-8bd2-d8547809e285 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:46.114982 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a433483-6506-4a1a-8bd2-d8547809e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:46.115355 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a433483-6506-4a1a-8bd2-d8547809e285 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:46.116077 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a433483-6506-4a1a-8bd2-d8547809e285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:46.118130 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a433483-6506-4a1a-8bd2-d8547809e285 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:46.223726 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1425/2826] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:47:46 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:47:46.228430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d96166-c3c3-492f-89e5-00dcbb2d98c1 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:46.241502 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d96166-c3c3-492f-89e5-00dcbb2d98c1 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:46.246359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801d901-7d80-445e-bd19-b17915856c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:46.247152 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801d901-7d80-445e-bd19-b17915856c20 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:46.247479 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801d901-7d80-445e-bd19-b17915856c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:46.247841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801d901-7d80-445e-bd19-b17915856c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:46.248694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801d901-7d80-445e-bd19-b17915856c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:46.250532 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801d901-7d80-445e-bd19-b17915856c20 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:46.261754 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1402/2827] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:47:46.266655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a433483-6506-4a1a-8bd2-d8547809e285 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:46.277025 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a433483-6506-4a1a-8bd2-d8547809e285 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:46.282896 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d8f24-ed72-45f9-b2b7-4ee9bba5eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:46.283566 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d8f24-ed72-45f9-b2b7-4ee9bba5eb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:46.283836 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d8f24-ed72-45f9-b2b7-4ee9bba5eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:46.284116 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d8f24-ed72-45f9-b2b7-4ee9bba5eb28 admin admin] PATH_INFO: `/v3/projects/b5dd7c9f76e24f189a53962cb2d04c2a/users/802be6c674524ef1b98e5365c8b6017e/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:46.301602 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d8f24-ed72-45f9-b2b7-4ee9bba5eb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dd7c9f76e24f189a53962cb2d04c2a, user_id=802be6c674524ef1b98e5365c8b6017e, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:46.304360 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d8f24-ed72-45f9-b2b7-4ee9bba5eb28 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:46.400250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1426/2828] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:47:46 2022] PUT /identity/v3/projects/b5dd7c9f76e24f189a53962cb2d04c2a/users/802be6c674524ef1b98e5365c8b6017e/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:46.404508 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801d901-7d80-445e-bd19-b17915856c20 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:46.417972 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801d901-7d80-445e-bd19-b17915856c20 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:46.489555 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209395ab-4b3a-4258-970e-61b3fddd4320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:46.490282 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209395ab-4b3a-4258-970e-61b3fddd4320 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:46.490629 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209395ab-4b3a-4258-970e-61b3fddd4320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:46.490977 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209395ab-4b3a-4258-970e-61b3fddd4320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:46.491694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209395ab-4b3a-4258-970e-61b3fddd4320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:46.493692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209395ab-4b3a-4258-970e-61b3fddd4320 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:46.505939 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1403/2829] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:47:46.510824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d8f24-ed72-45f9-b2b7-4ee9bba5eb28 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:46.522668 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d8f24-ed72-45f9-b2b7-4ee9bba5eb28 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:46.527556 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6c33f-394f-4d75-bfdc-f809661526b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:46.528389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6c33f-394f-4d75-bfdc-f809661526b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:46.528531 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6c33f-394f-4d75-bfdc-f809661526b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:46.528761 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6c33f-394f-4d75-bfdc-f809661526b3 admin admin] PATH_INFO: `/v3/projects/b5dd7c9f76e24f189a53962cb2d04c2a/users/802be6c674524ef1b98e5365c8b6017e/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:46.532454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6c33f-394f-4d75-bfdc-f809661526b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dd7c9f76e24f189a53962cb2d04c2a, user_id=802be6c674524ef1b98e5365c8b6017e, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:46.535572 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd6c33f-394f-4d75-bfdc-f809661526b3 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:46.561948 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1427/2830] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:47:46 2022] PUT /identity/v3/projects/b5dd7c9f76e24f189a53962cb2d04c2a/users/802be6c674524ef1b98e5365c8b6017e/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:49.495009 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209395ab-4b3a-4258-970e-61b3fddd4320 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:49.497053 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-209395ab-4b3a-4258-970e-61b3fddd4320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:49.524371 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209395ab-4b3a-4258-970e-61b3fddd4320 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:49.622632 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049efb9-3d42-4ddc-ac3a-d2e657df04fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:49.623922 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049efb9-3d42-4ddc-ac3a-d2e657df04fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:49.624279 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049efb9-3d42-4ddc-ac3a-d2e657df04fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:49.624627 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049efb9-3d42-4ddc-ac3a-d2e657df04fe admin admin] PATH_INFO: `/v3/users/2913d382d0c043ce88b926090a4372ad` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:49.626224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049efb9-3d42-4ddc-ac3a-d2e657df04fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2913d382d0c043ce88b926090a4372ad)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:49.629399 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049efb9-3d42-4ddc-ac3a-d2e657df04fe admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:49.960387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:49.972163 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e049efb9-3d42-4ddc-ac3a-d2e657df04fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2913d382d0c043ce88b926090a4372ad'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:49.987515 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e049efb9-3d42-4ddc-ac3a-d2e657df04fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2913d382d0c043ce88b926090a4372ad'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:50.083030 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e049efb9-3d42-4ddc-ac3a-d2e657df04fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2913d382d0c043ce88b926090a4372ad'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:50.088477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e049efb9-3d42-4ddc-ac3a-d2e657df04fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2913d382d0c043ce88b926090a4372ad'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:50.088477 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-e049efb9-3d42-4ddc-ac3a-d2e657df04fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2913d382d0c043ce88b926090a4372ad'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:50.127224 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1404/2831] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:47:49 2022] DELETE /identity/v3/users/2913d382d0c043ce88b926090a4372ad => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:50.465732 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6c33f-394f-4d75-bfdc-f809661526b3 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:50.468099 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ccd6c33f-394f-4d75-bfdc-f809661526b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:50.485727 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6c33f-394f-4d75-bfdc-f809661526b3 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:50.570285 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72122df6-0943-4559-973e-88c8b7c22966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:50.571550 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72122df6-0943-4559-973e-88c8b7c22966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:50.571832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72122df6-0943-4559-973e-88c8b7c22966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:50.572101 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72122df6-0943-4559-973e-88c8b7c22966 admin admin] PATH_INFO: `/v3/projects/f2c233e0846249089c33765e7d827b1b` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:50.573289 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72122df6-0943-4559-973e-88c8b7c22966 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c233e0846249089c33765e7d827b1b)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:50.575431 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72122df6-0943-4559-973e-88c8b7c22966 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:50.725427 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-72122df6-0943-4559-973e-88c8b7c22966 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c233e0846249089c33765e7d827b1b', 'request_id': 'req-72122df6-0943-4559-973e-88c8b7c22966'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:50.887034 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-72122df6-0943-4559-973e-88c8b7c22966 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c233e0846249089c33765e7d827b1b', 'request_id': 'req-72122df6-0943-4559-973e-88c8b7c22966'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:50.895262 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-72122df6-0943-4559-973e-88c8b7c22966 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c233e0846249089c33765e7d827b1b', 'request_id': 'req-72122df6-0943-4559-973e-88c8b7c22966'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:50.902929 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:50.922756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-72122df6-0943-4559-973e-88c8b7c22966 admin admin] The token cache is being invalidate because project f2c233e0846249089c33765e7d827b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:47:50.923664 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-72122df6-0943-4559-973e-88c8b7c22966 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:50.927205 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-72122df6-0943-4559-973e-88c8b7c22966 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:47:50.929364 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1428/2832] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:47:50 2022] DELETE /identity/v3/projects/f2c233e0846249089c33765e7d827b1b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:50.935659 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934db98c-396f-4c59-80f7-5f17dafb0fc1 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:50.936832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934db98c-396f-4c59-80f7-5f17dafb0fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:50.936832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934db98c-396f-4c59-80f7-5f17dafb0fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:50.975183 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-934db98c-396f-4c59-80f7-5f17dafb0fc1 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:50.977598 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-934db98c-396f-4c59-80f7-5f17dafb0fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:51.117650 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1405/2833] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:51.126011 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7e5d1-3bbf-4773-9d5a-af2ced2f0453 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:51.126779 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7e5d1-3bbf-4773-9d5a-af2ced2f0453 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:51.127206 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7e5d1-3bbf-4773-9d5a-af2ced2f0453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:51.159046 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-d1f7e5d1-3bbf-4773-9d5a-af2ced2f0453 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:51.160994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d1f7e5d1-3bbf-4773-9d5a-af2ced2f0453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:51.177491 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1429/2834] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:47:51.179098 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934db98c-396f-4c59-80f7-5f17dafb0fc1 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:51.191449 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934db98c-396f-4c59-80f7-5f17dafb0fc1 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:51.197790 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3bf95-dc15-4a9c-9660-fefa55a65eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:51.198427 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3bf95-dc15-4a9c-9660-fefa55a65eee admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:51.198708 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3bf95-dc15-4a9c-9660-fefa55a65eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:51.198985 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3bf95-dc15-4a9c-9660-fefa55a65eee admin admin] PATH_INFO: `/v3/domains` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:51.199681 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3bf95-dc15-4a9c-9660-fefa55a65eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81756) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:47:51.199987 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3bf95-dc15-4a9c-9660-fefa55a65eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:51.202281 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3bf95-dc15-4a9c-9660-fefa55a65eee admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:51.238820 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1406/2835] 10.222.0.48 () {58 vars in 1153 bytes} [Thu Sep 1 05:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:47:51.242660 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7e5d1-3bbf-4773-9d5a-af2ced2f0453 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:51.257881 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7e5d1-3bbf-4773-9d5a-af2ced2f0453 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:51.269824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47fca8-eccf-4bba-8a06-37bf07d2b56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:51.270405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47fca8-eccf-4bba-8a06-37bf07d2b56e admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:51.270682 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47fca8-eccf-4bba-8a06-37bf07d2b56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:51.270952 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47fca8-eccf-4bba-8a06-37bf07d2b56e admin admin] PATH_INFO: `/v3/projects` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:51.271652 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47fca8-eccf-4bba-8a06-37bf07d2b56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:51.274054 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47fca8-eccf-4bba-8a06-37bf07d2b56e admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:51.495307 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1430/2836] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:47:51 2022] POST /identity/v3/projects => generated 383 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:47:51.501043 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3bf95-dc15-4a9c-9660-fefa55a65eee admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:51.511558 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3bf95-dc15-4a9c-9660-fefa55a65eee admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:51.601667 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92babb9b-6d7f-4fc1-b46e-c46391825efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:51.602233 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92babb9b-6d7f-4fc1-b46e-c46391825efc admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:51.604060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92babb9b-6d7f-4fc1-b46e-c46391825efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:51.604060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92babb9b-6d7f-4fc1-b46e-c46391825efc admin admin] PATH_INFO: `/v3/users` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:51.604060 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92babb9b-6d7f-4fc1-b46e-c46391825efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:51.605751 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92babb9b-6d7f-4fc1-b46e-c46391825efc admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:51.791333 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1407/2837] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:47:51 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:47:51.800072 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47fca8-eccf-4bba-8a06-37bf07d2b56e admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:51.819220 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47fca8-eccf-4bba-8a06-37bf07d2b56e admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:51.824734 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0cd5f-46d0-49f0-bd1c-1b5eba2fc18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:51.825501 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0cd5f-46d0-49f0-bd1c-1b5eba2fc18b admin admin] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:51.825866 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0cd5f-46d0-49f0-bd1c-1b5eba2fc18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:51.826319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0cd5f-46d0-49f0-bd1c-1b5eba2fc18b admin admin] PATH_INFO: `/v3/roles` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:51.827440 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0cd5f-46d0-49f0-bd1c-1b5eba2fc18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:51.829889 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0cd5f-46d0-49f0-bd1c-1b5eba2fc18b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:51.843296 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1431/2838] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:47:51.847528 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92babb9b-6d7f-4fc1-b46e-c46391825efc admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:51.867491 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92babb9b-6d7f-4fc1-b46e-c46391825efc admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:51.873975 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bddc4-5e2d-4864-a4e2-a3065160db58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:51.874777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bddc4-5e2d-4864-a4e2-a3065160db58 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:51.875369 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bddc4-5e2d-4864-a4e2-a3065160db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:51.875857 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bddc4-5e2d-4864-a4e2-a3065160db58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:51.876763 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53bddc4-5e2d-4864-a4e2-a3065160db58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:51.879283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53bddc4-5e2d-4864-a4e2-a3065160db58 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:51.896237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1408/2839] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:47:51.901219 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0cd5f-46d0-49f0-bd1c-1b5eba2fc18b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:51.910609 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0cd5f-46d0-49f0-bd1c-1b5eba2fc18b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:51.916100 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94992937-0fef-4474-bfbb-77d26c4f2341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:51.916792 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992937-0fef-4474-bfbb-77d26c4f2341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:51.917079 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992937-0fef-4474-bfbb-77d26c4f2341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:51.917405 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992937-0fef-4474-bfbb-77d26c4f2341 admin admin] PATH_INFO: `/v3/projects/ac30e6894f4c482895f9f16897740e70/users/770c08802fe44a209fe96b89deaf918a/roles/d27b7d5ab3274b85a416d9f8f7f75648` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:51.935453 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94992937-0fef-4474-bfbb-77d26c4f2341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac30e6894f4c482895f9f16897740e70, user_id=770c08802fe44a209fe96b89deaf918a, role_id=d27b7d5ab3274b85a416d9f8f7f75648)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:51.939045 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94992937-0fef-4474-bfbb-77d26c4f2341 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:52.072824 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1432/2840] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:47:51 2022] PUT /identity/v3/projects/ac30e6894f4c482895f9f16897740e70/users/770c08802fe44a209fe96b89deaf918a/roles/d27b7d5ab3274b85a416d9f8f7f75648 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:47:52.074841 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c626bf-48be-425b-a6c6-8b7af8ccbb86 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:52.075717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c626bf-48be-425b-a6c6-8b7af8ccbb86 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:52.076490 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c626bf-48be-425b-a6c6-8b7af8ccbb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:52.097935 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-76c626bf-48be-425b-a6c6-8b7af8ccbb86 None None] MFA Rules not processed for user `b2b7855ba5724e86b7da7d610ca3fc58`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:52.099511 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-76c626bf-48be-425b-a6c6-8b7af8ccbb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:52.120349 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:52.175144 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1409/2841] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:52.186953 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94992937-0fef-4474-bfbb-77d26c4f2341 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:52.189221 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-94992937-0fef-4474-bfbb-77d26c4f2341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:52.275433 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94992937-0fef-4474-bfbb-77d26c4f2341 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:52.280520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c970a-44bd-42d4-ae39-471193b75298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:52.281445 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c970a-44bd-42d4-ae39-471193b75298 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:52.281783 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c970a-44bd-42d4-ae39-471193b75298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:52.282246 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c970a-44bd-42d4-ae39-471193b75298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:52.292665 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c970a-44bd-42d4-ae39-471193b75298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:52.294175 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c970a-44bd-42d4-ae39-471193b75298 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:52.305334 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1433/2842] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:54.214564 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ecddf-f23b-4b96-9f51-246d2d573309 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:54.221554 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ecddf-f23b-4b96-9f51-246d2d573309 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:54.221554 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ecddf-f23b-4b96-9f51-246d2d573309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:54.254316 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-6a3ecddf-f23b-4b96-9f51-246d2d573309 None None] MFA Rules not processed for user `802be6c674524ef1b98e5365c8b6017e`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:54.255875 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-6a3ecddf-f23b-4b96-9f51-246d2d573309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:54.379630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1410/2843] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:47:54.402310 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c970a-44bd-42d4-ae39-471193b75298 service neutron] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:47:54.402310 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a84c970a-44bd-42d4-ae39-471193b75298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:54.496605 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c970a-44bd-42d4-ae39-471193b75298 service neutron] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:47:54.503196 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fa807-1294-46c1-bbca-dcf84b97a6b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7e84a5652df4d64aa1fd28f3d5383fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:47:54.503830 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fa807-1294-46c1-bbca-dcf84b97a6b4 service nova] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:54.504110 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fa807-1294-46c1-bbca-dcf84b97a6b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:54.504385 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fa807-1294-46c1-bbca-dcf84b97a6b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:54.506253 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-a72fa807-1294-46c1-bbca-dcf84b97a6b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:54.547387 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:47:54.579775 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fa807-1294-46c1-bbca-dcf84b97a6b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:47:54.582356 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fa807-1294-46c1-bbca-dcf84b97a6b4 service nova] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:47:54.599404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1434/2844] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:47:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:47:59.735117 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39f9e0-f168-4949-9076-f9fec9342c96 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:47:59.735945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39f9e0-f168-4949-9076-f9fec9342c96 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:47:59.735945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39f9e0-f168-4949-9076-f9fec9342c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:47:59.757346 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-0f39f9e0-f168-4949-9076-f9fec9342c96 None None] MFA Rules not processed for user `d5d77c0f3e5143d49337f7e41432adb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:47:59.759950 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0f39f9e0-f168-4949-9076-f9fec9342c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:47:59.776080 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1411/2845] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:47:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:48:00.611523 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246fae9-36ef-4185-85ee-7d8d1ffdb45a None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:00.612096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246fae9-36ef-4185-85ee-7d8d1ffdb45a None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:00.612096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246fae9-36ef-4185-85ee-7d8d1ffdb45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:00.645520 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-e246fae9-36ef-4185-85ee-7d8d1ffdb45a None None] MFA Rules not processed for user `770c08802fe44a209fe96b89deaf918a`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:48:00.646922 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e246fae9-36ef-4185-85ee-7d8d1ffdb45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:00.747771 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1435/2846] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:48:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:48:00.753298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39f9e0-f168-4949-9076-f9fec9342c96 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:00.769291 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39f9e0-f168-4949-9076-f9fec9342c96 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:00.773443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e672c-b017-4f8f-8460-8339dafa7f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:00.774298 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e672c-b017-4f8f-8460-8339dafa7f4e admin admin] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:00.774933 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e672c-b017-4f8f-8460-8339dafa7f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:00.775952 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e672c-b017-4f8f-8460-8339dafa7f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:00.776637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e672c-b017-4f8f-8460-8339dafa7f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:00.779134 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e672c-b017-4f8f-8460-8339dafa7f4e admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:00.947973 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1412/2847] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Sep 1 05:48:00 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:48:00.953010 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246fae9-36ef-4185-85ee-7d8d1ffdb45a None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:00.968083 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246fae9-36ef-4185-85ee-7d8d1ffdb45a None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:01.086149 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc497e6-0602-4207-9902-9ef63ca2a608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:01.087086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc497e6-0602-4207-9902-9ef63ca2a608 admin admin] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:01.087527 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc497e6-0602-4207-9902-9ef63ca2a608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:01.088002 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc497e6-0602-4207-9902-9ef63ca2a608 admin admin] PATH_INFO: `/v3/users` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:01.088935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc497e6-0602-4207-9902-9ef63ca2a608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:01.096518 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc497e6-0602-4207-9902-9ef63ca2a608 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:01.242991 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1436/2848] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Sep 1 05:48:00 2022] POST /identity/v3/users => generated 299 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:48:01.244352 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e672c-b017-4f8f-8460-8339dafa7f4e admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:01.258853 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e672c-b017-4f8f-8460-8339dafa7f4e admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:01.264286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b5ba6-10e9-4335-9051-adbed1214d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:01.264927 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b5ba6-10e9-4335-9051-adbed1214d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:01.265425 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b5ba6-10e9-4335-9051-adbed1214d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:01.265710 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b5ba6-10e9-4335-9051-adbed1214d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:01.266384 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b5ba6-10e9-4335-9051-adbed1214d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:01.268032 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b5ba6-10e9-4335-9051-adbed1214d11 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:01.285611 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1413/2849] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:48:01.290174 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc497e6-0602-4207-9902-9ef63ca2a608 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:01.303159 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc497e6-0602-4207-9902-9ef63ca2a608 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:01.308634 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08429131-6daf-404e-822a-f6303845daa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:01.311920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08429131-6daf-404e-822a-f6303845daa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:01.311920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08429131-6daf-404e-822a-f6303845daa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:01.311920 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08429131-6daf-404e-822a-f6303845daa5 admin admin] PATH_INFO: `/v3/projects/5b6e3d2689c04ca89ffb036fe1accd07/users/4882a0c9e5824005b5f72ad5e05dae51/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:01.328241 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08429131-6daf-404e-822a-f6303845daa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6e3d2689c04ca89ffb036fe1accd07, user_id=4882a0c9e5824005b5f72ad5e05dae51, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:01.331000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08429131-6daf-404e-822a-f6303845daa5 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:01.522653 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1437/2850] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:48:01 2022] PUT /identity/v3/projects/5b6e3d2689c04ca89ffb036fe1accd07/users/4882a0c9e5824005b5f72ad5e05dae51/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:48:01.526636 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b5ba6-10e9-4335-9051-adbed1214d11 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:01.542077 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b5ba6-10e9-4335-9051-adbed1214d11 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:01.640387 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84611329-ec8a-4150-8f75-769902135532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:01.641012 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84611329-ec8a-4150-8f75-769902135532 admin admin] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:01.641285 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84611329-ec8a-4150-8f75-769902135532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:01.641590 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84611329-ec8a-4150-8f75-769902135532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:01.642235 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84611329-ec8a-4150-8f75-769902135532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:01.643832 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84611329-ec8a-4150-8f75-769902135532 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:01.655717 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1414/2851] 10.222.0.48 () {58 vars in 1122 bytes} [Thu Sep 1 05:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:48:01.659994 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08429131-6daf-404e-822a-f6303845daa5 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:01.670455 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08429131-6daf-404e-822a-f6303845daa5 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:01.675349 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3959c-c16f-4c31-a182-b6c938f4ba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:01.676025 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3959c-c16f-4c31-a182-b6c938f4ba5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:01.676302 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3959c-c16f-4c31-a182-b6c938f4ba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:01.676575 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3959c-c16f-4c31-a182-b6c938f4ba5b admin admin] PATH_INFO: `/v3/projects/5b6e3d2689c04ca89ffb036fe1accd07/users/4882a0c9e5824005b5f72ad5e05dae51/roles/91cb2a98aba34b5dab105da573aa67b0` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:01.678860 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3959c-c16f-4c31-a182-b6c938f4ba5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6e3d2689c04ca89ffb036fe1accd07, user_id=4882a0c9e5824005b5f72ad5e05dae51, role_id=91cb2a98aba34b5dab105da573aa67b0)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:01.681488 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3959c-c16f-4c31-a182-b6c938f4ba5b admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:01.693809 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1438/2852] 10.222.0.48 () {60 vars in 1483 bytes} [Thu Sep 1 05:48:01 2022] PUT /identity/v3/projects/5b6e3d2689c04ca89ffb036fe1accd07/users/4882a0c9e5824005b5f72ad5e05dae51/roles/91cb2a98aba34b5dab105da573aa67b0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:48:09.319840 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98708135-cbe0-4202-8860-6cca0b4602d5 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:09.320430 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98708135-cbe0-4202-8860-6cca0b4602d5 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:09.320690 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98708135-cbe0-4202-8860-6cca0b4602d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:09.330777 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:09.359231 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-98708135-cbe0-4202-8860-6cca0b4602d5 None None] MFA Rules not processed for user `4882a0c9e5824005b5f72ad5e05dae51`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:48:09.360903 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-98708135-cbe0-4202-8860-6cca0b4602d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:09.459907 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1415/2853] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:48:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:48:09.473020 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3959c-c16f-4c31-a182-b6c938f4ba5b admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:09.475203 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-aaa3959c-c16f-4c31-a182-b6c938f4ba5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:09.494389 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:09.556576 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3959c-c16f-4c31-a182-b6c938f4ba5b admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:09.562248 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d7dee-d7c7-4f27-87f5-b840e80792a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c596e424ab8e4637bae1721488c9fcc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:09.563202 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d7dee-d7c7-4f27-87f5-b840e80792a9 service glance] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:09.563655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d7dee-d7c7-4f27-87f5-b840e80792a9 service glance] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:09.564130 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d7dee-d7c7-4f27-87f5-b840e80792a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:09.637476 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d7dee-d7c7-4f27-87f5-b840e80792a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:09.639408 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19d7dee-d7c7-4f27-87f5-b840e80792a9 service glance] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:09.651756 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1439/2854] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:48:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:48:10.013413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce689f1-d379-45fe-8c2d-cf1a8a88a8ce None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:10.013413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce689f1-d379-45fe-8c2d-cf1a8a88a8ce None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:10.013413 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce689f1-d379-45fe-8c2d-cf1a8a88a8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:10.038526 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-3ce689f1-d379-45fe-8c2d-cf1a8a88a8ce None None] MFA Rules not processed for user `eb75c0fb10484f3d80813962a4283b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:48:10.039881 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3ce689f1-d379-45fe-8c2d-cf1a8a88a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:10.112419 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1416/2855] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:48:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:48:10.143222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d7dee-d7c7-4f27-87f5-b840e80792a9 service glance] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:10.145843 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d19d7dee-d7c7-4f27-87f5-b840e80792a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:10.242000 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19d7dee-d7c7-4f27-87f5-b840e80792a9 service glance] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:10.249529 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec6cff-aee6-4cbc-95a0-c96e3967ffe2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a0d07b79212443480c87f4a4ff3ca00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:10.250238 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec6cff-aee6-4cbc-95a0-c96e3967ffe2 service swift] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:10.250560 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec6cff-aee6-4cbc-95a0-c96e3967ffe2 service swift] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:10.250879 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec6cff-aee6-4cbc-95a0-c96e3967ffe2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:10.260908 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec6cff-aee6-4cbc-95a0-c96e3967ffe2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:10.263266 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec6cff-aee6-4cbc-95a0-c96e3967ffe2 service swift] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:10.272707 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1440/2856] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Sep 1 05:48:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:48:16.363580 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce689f1-d379-45fe-8c2d-cf1a8a88a8ce None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:16.365170 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3ce689f1-d379-45fe-8c2d-cf1a8a88a8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:16.440523 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce689f1-d379-45fe-8c2d-cf1a8a88a8ce None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:16.446343 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de9e79-32c4-442c-8457-5e0442391f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e03daa3b2e334436ad4d0b2915a61aa1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:16.452036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de9e79-32c4-442c-8457-5e0442391f18 service cinder] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:16.452036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de9e79-32c4-442c-8457-5e0442391f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:16.452036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de9e79-32c4-442c-8457-5e0442391f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:16.452036 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-47de9e79-32c4-442c-8457-5e0442391f18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:16.516047 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=100 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:16.556897 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de9e79-32c4-442c-8457-5e0442391f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:16.558599 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de9e79-32c4-442c-8457-5e0442391f18 service cinder] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:16.574685 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1417/2857] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:48:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:48:17.141454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118496a-1701-4be0-b6cb-319efeeb7b27 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:17.327590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118496a-1701-4be0-b6cb-319efeeb7b27 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:17.327590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118496a-1701-4be0-b6cb-319efeeb7b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:17.327590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application [None req-d118496a-1701-4be0-b6cb-319efeeb7b27 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:48:17.327590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:48:17.327590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:48:17.327590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:48:17.327590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:48:17.327590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:48:17.327590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:48:17.327590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:48:17.329832 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:48:17.331934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:48:17.331934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:48:17.331934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:48:17.331934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: ERROR keystone.server.flask.application Sep 01 05:48:17.331934 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1441/2858] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:48:17 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 01 05:48:20.269183 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=74 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:23.431177 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a42ec-4e8a-43a5-b3c0-1c33c888e77a None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:23.431849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a42ec-4e8a-43a5-b3c0-1c33c888e77a None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:23.431849 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a42ec-4e8a-43a5-b3c0-1c33c888e77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:23.470237 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-bb6a42ec-4e8a-43a5-b3c0-1c33c888e77a None None] MFA Rules not processed for user `770c08802fe44a209fe96b89deaf918a`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:48:23.472386 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-bb6a42ec-4e8a-43a5-b3c0-1c33c888e77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:23.489458 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1418/2859] 10.222.0.48 () {58 vars in 958 bytes} [Thu Sep 1 05:48:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:48:23.538904 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118496a-1701-4be0-b6cb-319efeeb7b27 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:23.547993 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-d118496a-1701-4be0-b6cb-319efeeb7b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:23.556543 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118496a-1701-4be0-b6cb-319efeeb7b27 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:23.560981 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34a030-8db8-406e-b517-2f444fd484bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c596e424ab8e4637bae1721488c9fcc9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:23.562093 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34a030-8db8-406e-b517-2f444fd484bf service glance] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:23.562594 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34a030-8db8-406e-b517-2f444fd484bf service glance] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:23.563088 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34a030-8db8-406e-b517-2f444fd484bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:23.565670 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0e34a030-8db8-406e-b517-2f444fd484bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:23.584794 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34a030-8db8-406e-b517-2f444fd484bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:23.586259 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34a030-8db8-406e-b517-2f444fd484bf service glance] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:23.593116 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b698b8b-5799-44bd-8997-5b538707aaac None None] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:23.594359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b698b8b-5799-44bd-8997-5b538707aaac None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:23.594359 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b698b8b-5799-44bd-8997-5b538707aaac None None] PATH_INFO: `/` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:23.595637 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1419/2860] 10.222.0.48 () {54 vars in 961 bytes} [Thu Sep 1 05:48:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:48:23.600295 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1442/2861] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:48:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:48:23.605537 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68957f-4a42-4cfb-a7b5-9189f5bce990 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:23.606323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68957f-4a42-4cfb-a7b5-9189f5bce990 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:23.606323 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68957f-4a42-4cfb-a7b5-9189f5bce990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:23.640254 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.auth.core [None req-0c68957f-4a42-4cfb-a7b5-9189f5bce990 None None] MFA Rules not processed for user `055823f7760f485eb91266a0d63db602`. Rule list: `[]` (Enabled: `True`). {{(pid=81756) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:48:23.641871 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-0c68957f-4a42-4cfb-a7b5-9189f5bce990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:23.718707 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1420/2862] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Sep 1 05:48:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:48:23.727006 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34a030-8db8-406e-b517-2f444fd484bf service glance] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:23.738645 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34a030-8db8-406e-b517-2f444fd484bf service glance] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:23.744027 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6db0ee-fc8d-4cb9-9451-c9270aac621e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055823f7760f485eb91266a0d63db602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:23.744652 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6db0ee-fc8d-4cb9-9451-c9270aac621e service placement] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:23.745037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6db0ee-fc8d-4cb9-9451-c9270aac621e service placement] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:23.745222 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6db0ee-fc8d-4cb9-9451-c9270aac621e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:23.747241 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ff6db0ee-fc8d-4cb9-9451-c9270aac621e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:23.760143 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6db0ee-fc8d-4cb9-9451-c9270aac621e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:23.761789 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6db0ee-fc8d-4cb9-9451-c9270aac621e service placement] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:23.776648 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1443/2863] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:48:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:48:23.896007 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f618a5b-5d12-4a29-b9b8-dbfbd62549f2 None None] REQUEST_METHOD: `POST` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:23.896404 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f618a5b-5d12-4a29-b9b8-dbfbd62549f2 None None] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:23.896689 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f618a5b-5d12-4a29-b9b8-dbfbd62549f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application [None req-6f618a5b-5d12-4a29-b9b8-dbfbd62549f2 None None] Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:48:23.903753 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application return f(*args, **kwargs) Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 182, in authenticate_for_token Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application auth_info = core.AuthInfo.create(auth=auth) Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 126, in create Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application auth_info._validate_and_normalize_auth_data(scope_only) Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 340, in _validate_and_normalize_auth_data Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application self._validate_and_normalize_scope_data() Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 290, in _validate_and_normalize_scope_data Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application project_ref = self._lookup_project(self.auth['scope']['project']) Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/core.py", line 194, in _lookup_project Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application raise exception.ValidationError(attribute='domain', Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application keystone.exception.ValidationError: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Sep 01 05:48:23.905081 dv-cinder-852208-15-smb devstack@keystone.service[81756]: ERROR keystone.server.flask.application Sep 01 05:48:23.906319 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1421/2864] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Sep 1 05:48:23 2022] POST /identity/v3/auth/tokens => generated 230 bytes in 10 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Sep 01 05:48:24.048919 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab4d75-8d93-489d-a129-3a3848c6c065 None None] REQUEST_METHOD: `POST` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:24.049482 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab4d75-8d93-489d-a129-3a3848c6c065 None None] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:24.050016 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab4d75-8d93-489d-a129-3a3848c6c065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:24.071555 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.auth.core [None req-1fab4d75-8d93-489d-a129-3a3848c6c065 None None] MFA Rules not processed for user `eb75c0fb10484f3d80813962a4283b02`. Rule list: `[]` (Enabled: `True`). {{(pid=81757) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:48:24.072781 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-1fab4d75-8d93-489d-a129-3a3848c6c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:24.080898 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1444/2865] 10.222.0.48 () {58 vars in 967 bytes} [Thu Sep 1 05:48:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:48:24.098433 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f618a5b-5d12-4a29-b9b8-dbfbd62549f2 None None] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:24.127970 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f618a5b-5d12-4a29-b9b8-dbfbd62549f2 None None] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:24.133248 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f98ded-97be-4b10-88c3-7477c6610494 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a0d07b79212443480c87f4a4ff3ca00', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:24.133898 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f98ded-97be-4b10-88c3-7477c6610494 service swift] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:24.134176 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f98ded-97be-4b10-88c3-7477c6610494 service swift] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:24.134577 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f98ded-97be-4b10-88c3-7477c6610494 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:24.145668 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f98ded-97be-4b10-88c3-7477c6610494 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:24.147286 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f98ded-97be-4b10-88c3-7477c6610494 service swift] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:24.160283 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1422/2866] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Sep 1 05:48:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:48:28.277047 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab4d75-8d93-489d-a129-3a3848c6c065 None None] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:28.296935 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab4d75-8d93-489d-a129-3a3848c6c065 None None] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:28.308844 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a89e7-3f17-4a09-bda3-2cd79d118ba2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055823f7760f485eb91266a0d63db602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:28.311644 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a89e7-3f17-4a09-bda3-2cd79d118ba2 service placement] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:28.312424 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a89e7-3f17-4a09-bda3-2cd79d118ba2 service placement] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:28.313162 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a89e7-3f17-4a09-bda3-2cd79d118ba2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:28.317103 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-095a89e7-3f17-4a09-bda3-2cd79d118ba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:28.359395 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a89e7-3f17-4a09-bda3-2cd79d118ba2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:28.362441 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a89e7-3f17-4a09-bda3-2cd79d118ba2 service placement] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:28.379707 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1445/2867] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:48:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:48:28.486703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f98ded-97be-4b10-88c3-7477c6610494 service swift] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:28.488859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-d9f98ded-97be-4b10-88c3-7477c6610494 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:28.595468 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f98ded-97be-4b10-88c3-7477c6610494 service swift] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:28.608859 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:28.609834 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:28.610253 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:28.610678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] PATH_INFO: `/v3/users/d5d77c0f3e5143d49337f7e41432adb3` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:28.612642 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d77c0f3e5143d49337f7e41432adb3)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:28.615209 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:28.944164 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d77c0f3e5143d49337f7e41432adb3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:28.955024 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:28.959348 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d77c0f3e5143d49337f7e41432adb3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:29.164945 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d77c0f3e5143d49337f7e41432adb3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:29.165674 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d77c0f3e5143d49337f7e41432adb3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:29.166328 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d77c0f3e5143d49337f7e41432adb3'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:29.191034 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1423/2868] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:48:28 2022] DELETE /identity/v3/users/d5d77c0f3e5143d49337f7e41432adb3 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:48:29.566276 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a89e7-3f17-4a09-bda3-2cd79d118ba2 service placement] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:29.578250 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a89e7-3f17-4a09-bda3-2cd79d118ba2 service placement] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:29.650861 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:29.651514 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:29.651799 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:29.652071 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] PATH_INFO: `/v3/projects/d8a60088d8bc4765ba381cc07e9ffe19` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:29.653557 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a60088d8bc4765ba381cc07e9ffe19)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:29.655683 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:29.870798 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a60088d8bc4765ba381cc07e9ffe19', 'request_id': 'req-eb20d49b-876e-4308-b53e-6cb45c873aef'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:29.982589 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a60088d8bc4765ba381cc07e9ffe19', 'request_id': 'req-eb20d49b-876e-4308-b53e-6cb45c873aef'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:29.990837 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a60088d8bc4765ba381cc07e9ffe19', 'request_id': 'req-eb20d49b-876e-4308-b53e-6cb45c873aef'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:30.005358 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] The token cache is being invalidate because project d8a60088d8bc4765ba381cc07e9ffe19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:48:30.005677 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:30.006608 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:30.008401 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1446/2869] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:48:29 2022] DELETE /identity/v3/projects/d8a60088d8bc4765ba381cc07e9ffe19 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:48:30.012931 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:30.014435 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:30.033694 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd01e6-e324-43e1-bcf2-4fadd8760998 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:30.095616 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:30.096715 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:30.097094 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:30.097530 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] PATH_INFO: `/v3/users/802be6c674524ef1b98e5365c8b6017e` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:30.099200 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=802be6c674524ef1b98e5365c8b6017e)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:30.101915 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:30.440569 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '802be6c674524ef1b98e5365c8b6017e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:30.448004 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '802be6c674524ef1b98e5365c8b6017e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:30.584722 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '802be6c674524ef1b98e5365c8b6017e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:30.585538 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '802be6c674524ef1b98e5365c8b6017e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:30.586273 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '802be6c674524ef1b98e5365c8b6017e'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:30.614796 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1424/2870] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:48:30 2022] DELETE /identity/v3/users/802be6c674524ef1b98e5365c8b6017e => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:48:30.997828 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:30.999449 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:31.016465 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20d49b-876e-4308-b53e-6cb45c873aef admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:31.070619 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:31.095701 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:31.096404 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:31.097814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:31.097814 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] PATH_INFO: `/v3/projects/b5dd7c9f76e24f189a53962cb2d04c2a` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:31.099017 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5dd7c9f76e24f189a53962cb2d04c2a)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:31.103379 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:31.248655 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5dd7c9f76e24f189a53962cb2d04c2a', 'request_id': 'req-0de20c9f-7508-459d-bccf-8dd7985caa9d'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:31.361858 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5dd7c9f76e24f189a53962cb2d04c2a', 'request_id': 'req-0de20c9f-7508-459d-bccf-8dd7985caa9d'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:31.368317 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5dd7c9f76e24f189a53962cb2d04c2a', 'request_id': 'req-0de20c9f-7508-459d-bccf-8dd7985caa9d'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:31.381749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] The token cache is being invalidate because project b5dd7c9f76e24f189a53962cb2d04c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:48:31.382038 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:31.382709 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:31.384505 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1447/2871] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:48:30 2022] DELETE /identity/v3/projects/b5dd7c9f76e24f189a53962cb2d04c2a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:48:35.291666 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:35.294678 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:35.365443 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:35.385630 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e3888-1d2c-4247-a08d-ea0abeb693a7 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:35.448050 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:35.448692 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:35.448971 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:35.449385 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] PATH_INFO: `/v3/users/770c08802fe44a209fe96b89deaf918a` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:35.451005 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=770c08802fe44a209fe96b89deaf918a)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:35.452966 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:35.640676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '770c08802fe44a209fe96b89deaf918a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:35.647909 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '770c08802fe44a209fe96b89deaf918a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:35.756265 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '770c08802fe44a209fe96b89deaf918a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:35.756990 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '770c08802fe44a209fe96b89deaf918a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:35.757712 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '770c08802fe44a209fe96b89deaf918a'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:35.779908 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1425/2872] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:48:35 2022] DELETE /identity/v3/users/770c08802fe44a209fe96b89deaf918a => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:48:36.052240 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:36.053791 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:36.131878 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de20c9f-7508-459d-bccf-8dd7985caa9d admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:36.197493 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:36.198037 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:36.198313 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:36.198590 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] PATH_INFO: `/v3/projects/ac30e6894f4c482895f9f16897740e70` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:36.199885 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac30e6894f4c482895f9f16897740e70)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:36.202211 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:36.231573 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:36.383126 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac30e6894f4c482895f9f16897740e70', 'request_id': 'req-ef80a54b-47f9-4a02-8f93-a3136b56841f'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:36.718298 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac30e6894f4c482895f9f16897740e70', 'request_id': 'req-ef80a54b-47f9-4a02-8f93-a3136b56841f'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:36.724533 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac30e6894f4c482895f9f16897740e70', 'request_id': 'req-ef80a54b-47f9-4a02-8f93-a3136b56841f'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:36.736969 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] The token cache is being invalidate because project ac30e6894f4c482895f9f16897740e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:48:36.737252 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:36.737921 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:36.739399 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1448/2873] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:48:36 2022] DELETE /identity/v3/projects/ac30e6894f4c482895f9f16897740e70 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:48:36.744063 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:36.746676 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:36.760321 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5227a-de3e-4ea7-bca4-4cb167cefc50 admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:36.827301 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:36.827966 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:36.828249 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:36.828524 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] PATH_INFO: `/v3/users/4882a0c9e5824005b5f72ad5e05dae51` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:36.829774 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4882a0c9e5824005b5f72ad5e05dae51)` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:36.831759 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:36.845770 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:37.071149 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4882a0c9e5824005b5f72ad5e05dae51'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:37.078670 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4882a0c9e5824005b5f72ad5e05dae51'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:37.187234 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4882a0c9e5824005b5f72ad5e05dae51'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:37.188006 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4882a0c9e5824005b5f72ad5e05dae51'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:37.188698 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.notifications [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4882a0c9e5824005b5f72ad5e05dae51'} {{(pid=81756) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:37.214213 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1426/2874] 10.222.0.48 () {58 vars in 1224 bytes} [Thu Sep 1 05:48:36 2022] DELETE /identity/v3/users/4882a0c9e5824005b5f72ad5e05dae51 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:48:37.532572 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:48:37.534096 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:48:37.548706 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef80a54b-47f9-4a02-8f93-a3136b56841f admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:48:37.613343 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2b7855ba5724e86b7da7d610ca3fc58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e8d7d100674ce3a5c0d91110f5524d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:48:37.614086 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:48:37.614454 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:48:37.614749 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] PATH_INFO: `/v3/projects/5b6e3d2689c04ca89ffb036fe1accd07` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:48:37.616007 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6e3d2689c04ca89ffb036fe1accd07)` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:48:37.618008 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:48:37.735849 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6e3d2689c04ca89ffb036fe1accd07', 'request_id': 'req-916bd492-5fec-439a-9762-d18d72d87d29'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:37.907053 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6e3d2689c04ca89ffb036fe1accd07', 'request_id': 'req-916bd492-5fec-439a-9762-d18d72d87d29'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:37.913754 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6e3d2689c04ca89ffb036fe1accd07', 'request_id': 'req-916bd492-5fec-439a-9762-d18d72d87d29'} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:37.928027 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] The token cache is being invalidate because project 5b6e3d2689c04ca89ffb036fe1accd07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81757) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:48:37.928320 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:37.928985 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.notifications [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81757) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:48:37.930512 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1449/2875] 10.222.0.48 () {58 vars in 1233 bytes} [Thu Sep 1 05:48:37 2022] DELETE /identity/v3/projects/5b6e3d2689c04ca89ffb036fe1accd07 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:48:47.210055 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:DELETE=10,keystone:SELECT=22,keystone:INSERT=1 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:48:47.924833 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=66,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:51:32.382052 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] Authenticating user token {{(pid=81756) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:51:32.383546 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:51:32.501634 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3702ec7-0724-4c45-be2d-7002952d475a admin admin] Validating token access rules against request {{(pid=81756) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:51:32.581703 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178a1c5-7d85-4b01-9a4c-0874d2af6f3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '055823f7760f485eb91266a0d63db602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81756) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:51:32.582326 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178a1c5-7d85-4b01-9a4c-0874d2af6f3a service placement] REQUEST_METHOD: `GET` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:51:32.582606 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178a1c5-7d85-4b01-9a4c-0874d2af6f3a service placement] SCRIPT_NAME: `/identity` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:51:32.583002 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178a1c5-7d85-4b01-9a4c-0874d2af6f3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81756) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:51:32.584792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.fernet_utils [None req-3178a1c5-7d85-4b01-9a4c-0874d2af6f3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81756) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:51:32.596792 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178a1c5-7d85-4b01-9a4c-0874d2af6f3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:51:32.598428 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178a1c5-7d85-4b01-9a4c-0874d2af6f3a service placement] RBAC: Authorization granted {{(pid=81756) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:51:32.609090 dv-cinder-852208-15-smb devstack@keystone.service[81756]: [pid: 81756|app: 0|req: 1427/2876] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:51:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:51:42.604647 dv-cinder-852208-15-smb devstack@keystone.service[81756]: DEBUG dbcounter [-] [81756] Writing DB stats keystone:SELECT=74 {{(pid=81756) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:52:25.348173 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] Authenticating user token {{(pid=81757) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:52:25.349711 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:52:25.429617 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916bd492-5fec-439a-9762-d18d72d87d29 admin admin] Validating token access rules against request {{(pid=81757) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:52:25.433278 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f45d7d-3f59-49ae-957b-fc4c77e2a975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d31c0ec474c428ed932882b989d2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e57c3fe9229c45f1bfd295115ef94cd7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81757) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:52:25.433900 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f45d7d-3f59-49ae-957b-fc4c77e2a975 service neutron] REQUEST_METHOD: `GET` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:52:25.434181 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f45d7d-3f59-49ae-957b-fc4c77e2a975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:52:25.434502 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f45d7d-3f59-49ae-957b-fc4c77e2a975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81757) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:52:25.436215 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.fernet_utils [None req-e3f45d7d-3f59-49ae-957b-fc4c77e2a975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81757) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:52:25.446848 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f45d7d-3f59-49ae-957b-fc4c77e2a975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:52:25.448274 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f45d7d-3f59-49ae-957b-fc4c77e2a975 service neutron] RBAC: Authorization granted {{(pid=81757) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:52:25.457319 dv-cinder-852208-15-smb devstack@keystone.service[81757]: [pid: 81757|app: 0|req: 1450/2877] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Sep 1 05:52:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:52:35.452850 dv-cinder-852208-15-smb devstack@keystone.service[81757]: DEBUG dbcounter [-] [81757] Writing DB stats keystone:SELECT=35 {{(pid=81757) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}